Fontes acadêmicas e de pesquisa
Friedman (2001) -- Greedy function approximation: a gradient boosting machine. Introduced functional gradient descent, pseudo-residuals, and shrinkage.
The Annals of Statistics · 2001
Friedman (2002) -- Stochastic gradient boosting. Added row subsampling at each round as additional regularization.
Computational Statistics & Data Analysis · 2002
Chen and Guestrin (2016) -- XGBoost: a scalable tree boosting system. Second-order Taylor expansion, regularized objective, sparsity-aware splits, system-level optimizations.
Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · 2016
Ke, Meng, Finley, Wang, Chen, Ma, Ye, Liu (2017) -- LightGBM: a highly efficient gradient boosting decision tree. Gradient-based one-side sampling (GOSS) and exclusive feature bundling (EFB).
Advances in Neural Information Processing Systems · 2017
Prokhorenkova, Gusev, Vorobev, Dorogush, Gulin (2018) -- CatBoost: unbiased boosting with categorical features. Ordered boosting to prevent target leakage.
Advances in Neural Information Processing Systems · 2018
Gu, Kelly, Xiu (2020) -- Empirical asset pricing via machine learning. Large-scale comparison finding gradient-boosted trees competitive with neural networks.
The Review of Financial Studies · 2020
Medeiros, Vasconcelos, Veiga, Zilberman (2021) -- Forecasting US CPI inflation in a data-rich environment (FRED-MD). Headline result: random forests dominate; boosted trees among the nonlinear methods beating penalized linear benchmarks.
Journal of Business & Economic Statistics · 2021
Garcia, Medeiros, Vasconcelos (2017) -- Real-time inflation forecasting with high-dimensional models for Brazil.
International Journal of Forecasting · 2017