Optimization is the process of finding the set of parameters W that minimize the loss function. Support Vector Machine (SVM) You can't use 'macro parameter character #' in math mode+ \underbrace{\lambda R(W)}_{\text{regularization loss}}$$ $$L = \frac{1}{N} \sum_i \sum_{j \ne y_i} \big[ \max(0, f(x_i; W)j - f(x_i; W){y_i} + \Delta) \big] + \lambda R(W)$$ # Information theory view