Lecture 3. Loss Functions and Optimization

IIPhysResearch iphysresearch.github.io 2018/08/20

Table of Contents 1. Multiclass SVM loss 1.1 Regularization 2. Softmax loss (Multinomial Logistic Regression) 3. Softmax vs. SVM 4. Optimization 4.1 Stochastic Gradient Descent (SGD) 5. Aside: Image F…