Various optimization methods for linear regression implemented from scratch.
See model.ipynb.
Course assignment @ St. Petersburg State University.
Construct multidimensional linear regression models using the dataset of airline delays by the US Bureau of Transportation Statistics.
- Mini-batch stochastic gradient descent
- AdaGrad
- RMSProp
- Adam
With regularization:
- Lasso
- Ridge