Activation Functions : Why “tanh” outperforms “logistic sigmoid”medium.datadriveninvestor.com/activation-functions-why-tanh-outperforms-logistic-sigmoid-3f26469ac0d1
Activation Functions: Why does “tanh” outperform “logistic sigmoid”?
Recently, I was trying to build a CNN-LeNet with an MNIST dataset using the sigmoid activation function, I was really shocked by the results it gave, then I tried it using the tanh activation function. It gave the best result, which can’t be compared to the sigmoid. Then, I actually thought of going back to…
This story appeared on medium.datadriveninvestor.com, 2023-05-26.