Gradient Boosting

2 stories tagged Gradient Boosting on Learning Fanatic.

Lesson 5.2: Decision trees, random forests and gradient boosting Learn how a decision tree chooses its splits, why forests of trees beat a single tree, and how gradient boosting builds a model one correction at a time.
Foundation models for tabular data: where they beat boosted trees Pre-trained models such as TabPFN, TabICL and Mitra now rival tuned XGBoost on small tables. How they differ, where they fall short and who can use them.