Activation Functions : Why “tanh” outperforms “logistic sigmoid”

Activation Functions: Why does “tanh” outperform “logistic sigmoid”?
Recently, I was trying to build a CNN-LeNet with an MNIST dataset using the sigmoid activation function, I was really shocked by the results it gave, then I tried it using the tanh activation function. It gave the best result, which can’t be compared to the sigmoid. Then, I actually thought of going back to…

This story appeared on, 2023-05-26.
The Web's Most Comprehensive Business News Hub. Free to Use →