Had some fun writing this one. Thanks to @towardsdatascience.com for publishing it!
towardsdatascience.com/what-the-rel...
towardsdatascience.com
What the ReLU Revolution Revealed About Biological Plausibility
The activation function was never a fixed biological commitment but a working hypothesis revised under empirical pressure.