Activation Functions: Why does “tanh” outperform “logistic sigmoid”?
Recently, I was trying to build a CNN-LeNet with an MNIST dataset using the sigmoid activation function, I was really shocked by the results it gave, then I tried it using the tanh activation function. It gave the best result, which can’t be compared to the sigmoid. Then, I actually thought of going back to…

#activationfunctions#cnnlenet#mainobjective#dropouts#laerdstatistics#nonlinearity#dataset#deeplearning