1.Linear Regression

 

2.Logistic Regression

where is called sigmoid or logistic function. can be interpreted as the probability that .

Logistic回归可以看作是用sigmoid函数归一化的线性回归。

3.Softmax Regression

注意,当K=2时,Softmax回归即退化为Logistic回归。