Cross-Entropy function
-
Softmax and Cross-Entropy with CNNMLAI/DeepLearning 2019. 10. 16. 15:56
1. Overview 2. Description How come two output values add up to one? 2.1 Softmax function(Normalized exponential function) $$f_{j}(z)=\frac{e^{zj}}{\sum_{k}e^{zk}}$$ Normally, the dog and the cat neurons would have any kind of real values. Applying the softmax function which is written up over there at the top, and that would bring these values to be between zero and one and it would make them a..