The method of least squares is a parameters estimation method in regression analysis based on minimizing the sum of the squares of the residuals (difference between an observed value and the fitted value provided by the model).
There is a wide variety of least squares estimation methods including:
- Ordinary Least Squares Estimation (Linear LSE)
- Nonlinear Least Squares Estimation