Foundations of Machine Learning: Part 5

This post is the ninth (and probably last) one of our series on the history and foundations of econometric and machine learning models. The first four were on econometrics techniques. Part 8 is online here.

Optimization and Algorithmic Aspects

In econometrics, (numerical) optimization became omnipresent as soon as we left the Gaussian model. We briefly mentioned it in the section on the exponential family, and the use of the Fisher score (gradient descent) to solve the first order condition