Cookies on Macro by Mark.We use essential cookies for sign-in, locale, and security. With your permission, we also use optional cookies for preferences, for analytics, and for advertising measurement with the Meta (Facebook) Pixel. Read our cookie policy.
L2-penalized linear regression - shrinks coefficients toward zero to stabilize forecasts when predictors are many or collinear.
Follow the same equations and assumptions one section at a time or in a continuous reading.
Hover or focus a symbol defined in this model to find its exact matches. Select it to keep the highlight; Escape clears the selection.
The ridge estimator minimizes the penalized residual sum of squares. The penalty adds times the squared L2 norm of the coefficient vector to the OLS objective.
The SVD representation reveals the geometry: ridge regression shrinks each principal component of the regression toward zero by a factor that depends on the component's singular value relative to the penalty. Components with small singular values (those aligned with collinear directions) get shrunk most.
The ridge objective. The first term is the usual sum of squared residuals. The second term penalizes large coefficients.
First-order condition. Setting the gradient to zero and solving for .
Closed-form solution. The matrix is always invertible for , even when is singular ().
Bayesian interpretation
Ridge is the posterior mean of under the model with prior . The penalty parameter maps to the prior variance: where is the prior variance of each coefficient.
Conditioning on information at T separates the sample from the projection. The forecast can be smooth even when later realized data will not be.
The bridge point is shared so the eye can see the handoff. After that point, the red line is a model forecast, not observed history.
Do not score the forecast segment as realized data or read it as a policy promise.
Each future innovation contributes through its impulse weight . Unless the future is degenerate, longer horizons carry more conditional variance.
The band widens when shocks accumulate through the model recursion.
Do not treat the band edge as an alternative deterministic scenario.
The history segment is realized data available at the forecast origin.
The forecast path is a conditional expectation, so it can be smooth while future realizations remain volatile.
Band width is horizon-specific uncertainty, not a second deterministic transition.