Categories: Deep Learning
In artificial neural network, activation function is a function which transforms the incoming input signal of artificial neuron. Activation function is useful to introduce non linearity into the neural network so that the network can learn complex relationship between input and output data.
The popular activation functions are – step function, sigmoid function, softmax function, tanh function, ReLU , Leaky ReLU
« Back to Glossary Index
