Fit gives the best fit function:
LinearModelFit allows for extraction of additional information about the fitting:
This is the sum of squares error for a line

:
These are the coefficients given by
Fit:
This is the sum of squares error for a quadratic

:
These are the coefficients given by
Fit:
When a polynomial fit is done to a high enough degree,
Fit returns the interpolating polynomial:
The result is consistent with that given by
InterpolatingPolynomial: