Activation Function
-
Activation FunctionsMLAI/DeepLearning 2020. 1. 30. 14:32
1. Overview In artificial neural networks, the activation function of a node defines the output of that node given an input or set of inputs. A standard computer chip circuit can be seen as a digital network of activation functions that can be "ON" (1) or "OFF" (0), depending on the input. This is similar to the behavior of the linear perceptron in neural networks. However, only nonlinear activa..