Ordinary Least Squares is
a method for finding the linear combination of features that best fits the observed outcome in the following sense.
If the vector of outcomes to be predicted is y, and the explanatory variables form the matrix X, then OLS will find the vector β solving
minβ|y^ - y|22,
w...