Softmax

Softmaxlogistic SoftmaxMNIST10Softmax/ MNIST NYU Yann LeCun

logistic logistic (hypothesis function)

softmax logistic 2 1 0 MNIST

j1

1

Softmax

softmax

1 0

logisticlogistic

Softmaxlogistic SoftmaxSoftmax

L-BFGS

🙁

softmax (weight decay)

Softmax ()

softmax Softmax

Hessian /

0 softmax

() Hessian L-BFGS

softmax logistic softmax logistic softmax

softmax:

softmax logistic

k softmax logistic k

k= 4softmaxk5

4 logistic

(i) sofmax 3logistic (ii) softmax logistic

softmax logistic

SoftmaxExercise:Softmax Regression