Skip to main content

Cookies on Macro by Mark.We use essential cookies for sign-in, locale, and security. With your permission, we also use optional cookies for preferences, for analytics, and for advertising measurement with the Meta (Facebook) Pixel. Read our cookie policy.

Macro by MarkMacro by Mark
  • Home
Loading…
Loading…
← Models
MacroConceptsPolicyModels

Gradient boosting Model

Sequential tree ensemble that fits residual structure stage by stage and uses validation loss to control overfitting.

OverviewGraphMathReferences

Gradient boosting references: sources and use guidance

Where the framework comes from, what it assumes, and how to interpret its results.

Academic and research sources

Academic and research sources

[S1] The Annals of Statistics ↗

Friedman (2001) -- Greedy function approximation: a gradient boosting machine. Introduced functional gradient descent, pseudo-residuals, and shrinkage.

The Annals of Statistics · 2001

[S2] Computational Statistics & Data Analysis ↗

Friedman (2002) -- Stochastic gradient boosting. Added row subsampling at each round as additional regularization.

Computational Statistics & Data Analysis · 2002

[S3] Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining ↗

Chen and Guestrin (2016) -- XGBoost: a scalable tree boosting system. Second-order Taylor expansion, regularized objective, sparsity-aware splits, system-level optimizations.

Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · 2016

[S4] Advances in Neural Information Processing Systems ↗

Ke, Meng, Finley, Wang, Chen, Ma, Ye, Liu (2017) -- LightGBM: a highly efficient gradient boosting decision tree. Gradient-based one-side sampling (GOSS) and exclusive feature bundling (EFB).

Advances in Neural Information Processing Systems · 2017

[S5] Advances in Neural Information Processing Systems ↗

Prokhorenkova, Gusev, Vorobev, Dorogush, Gulin (2018) -- CatBoost: unbiased boosting with categorical features. Ordered boosting to prevent target leakage.

Advances in Neural Information Processing Systems · 2018

[S6] The Review of Financial Studies ↗

Gu, Kelly, Xiu (2020) -- Empirical asset pricing via machine learning. Large-scale comparison finding gradient-boosted trees competitive with neural networks.

The Review of Financial Studies · 2020

[S7] Journal of Business & Economic Statistics ↗

Medeiros, Vasconcelos, Veiga, Zilberman (2021) -- Forecasting US CPI inflation in a data-rich environment (FRED-MD). Headline result: random forests dominate; boosted trees among the nonlinear methods beating penalized linear benchmarks.

Journal of Business & Economic Statistics · 2021

[S8] International Journal of Forecasting ↗

Garcia, Medeiros, Vasconcelos (2017) -- Real-time inflation forecasting with high-dimensional models for Brazil.

International Journal of Forecasting · 2017

How to read this list

Start with original sources for claims and measurements. Use research papers to understand mechanisms, assumptions, and limits.

These sources ground the framework; they do not automatically validate the parameters selected on the graph.

Source mix

8 · Academic and research sources

Macro by Mark
Help
Privacy PolicyTerms of UseEthics and Compliance

© 2026 Mark Jayson Nation LLC