English
Related papers

Related papers: FairGBM: Gradient Boosting with Fairness Constrain…

200 papers

Graph-based methods are becoming increasingly popular in machine learning due to their ability to model complex data and relations. Insurance fraud is a prime use case, since fraudulent claims are often the result of organised criminals…

Machine Learning · Computer Science 2026-05-18 Félix Vandervorst , Bruno Deprez , Wouter Verbeke , Tim Verdonck

Gradient boosting machines (GBMs) based on decision trees consistently demonstrate state-of-the-art results on regression and classification tasks with tabular data, often outperforming deep neural networks. However, these models do not…

Machine Learning · Computer Science 2023-02-23 Tristan Cinquin , Tammo Rukat , Philipp Schmidt , Martin Wistuba , Artur Bekasov

Gradient Boosting Machine (GBM) introduced by Friedman is a powerful supervised learning algorithm that is very widely used in practice---it routinely features as a leading algorithm in machine learning competitions such as Kaggle and the…

Machine Learning · Computer Science 2020-09-17 Haihao Lu , Rahul Mazumder

Meta-learning offers a principled framework leveraging \emph{task-invariant} priors from related tasks, with which \emph{task-specific} models can be fine-tuned on downstream tasks, even with limited data records. Gradient-based…

Machine Learning · Computer Science 2026-04-16 Yilang Zhang , Abraham Jaeger Mountain , Bingcong Li , Georgios B. Giannakis

Practitioners who wish to build real-world applications that rely on ranking models, need to decide which modelling paradigm to follow. This is not an easy choice to make, as the research literature on this topic has been shifting in recent…

Gradient boosting decision tree (GBDT) is an ensemble machine learning algorithm, which is widely used in industry, due to its good performance and easy interpretation. Due to the problem of data isolation and the requirement of privacy,…

Machine Learning · Computer Science 2024-06-21 Tao Fan , Weijing Chen , Guoqiang Ma , Yan Kang , Lixin Fan , Qiang Yang

Graph neural networks (GNNs) have been demonstrated to achieve state-of-the-art for a number of graph-based learning tasks, which leads to a rise in their employment in various domains. However, it has been shown that GNNs may inherit and…

Machine Learning · Computer Science 2022-05-23 O. Deniz Kose , Yanning Shen

The Gradient Boosted Tree (GBT) algorithm is one of the most popular machine learning algorithms used in production, for tasks that include Click-Through Rate (CTR) prediction and learning-to-rank. To deal with the massive datasets…

Machine Learning · Computer Science 2019-05-30 Theodore Vasiloudis , Hyunsu Cho , Henrik Boström

Highly regulated domains such as finance have long favoured the use of machine learning algorithms that are scalable, transparent, robust and yield better performance. One of the most prominent examples of such an algorithm is XGBoost.…

Artificial Intelligence · Computer Science 2020-10-08 Srinivasan Ravichandran , Drona Khurana , Bharath Venkatesh , Narayanan Unny Edakunni

Multi-layered representation is believed to be the key ingredient of deep neural networks especially in cognitive tasks like computer vision. While non-differentiable models such as gradient boosting decision trees (GBDTs) are the dominant…

Machine Learning · Computer Science 2020-07-07 Ji Feng , Yang Yu , Zhi-Hua Zhou

Gradient Boosting Decision Tree (GBDT) has achieved remarkable success in a wide variety of applications. The split finding algorithm, which determines the tree construction process, is one of the most crucial components of GBDT. However,…

Machine Learning · Computer Science 2023-05-19 Zheyu Zhang , Tianping Zhang , Jian Li

Gradient Boosted Decision Trees (GBDTs) are widely used for building ranking and relevance models in search and recommendation. Considerations such as latency and interpretability dictate the use of as few features as possible to train…

Machine Learning · Statistics 2021-09-07 Cuize Han , Nikhil Rao , Daria Sorokina , Karthik Subbian

The widespread use of AI and ML models in sensitive areas raises significant concerns about fairness. While the research community has introduced various methods for bias mitigation in binary classification tasks, the issue remains…

Machine Learning · Computer Science 2026-03-24 Maryam Boubekraoui , Giordano d'Aloisio , Antinisca Di Marco

Artificial intelligence (AI) and machine learning (ML) have become vital to remain competitive for financial services companies around the globe. The two models currently competing for the pole position in credit risk management are deep…

Machine Learning · Computer Science 2022-05-24 Marc Schmitt

Recent years have witnessed significant success in Gradient Boosting Decision Trees (GBDT) for a wide range of machine learning applications. Generally, a consensus about GBDT's training algorithms is gradients and statistics are computed…

Machine Learning · Computer Science 2023-01-18 Yu Shi , Guolin Ke , Zhuoming Chen , Shuxin Zheng , Tie-Yan Liu

Gradient Boosted Decision Tree (GBDT) is a widely-used machine learning algorithm that has been shown to achieve state-of-the-art results on many standard data science problems. We are interested in its application to multioutput problems…

Machine Learning · Computer Science 2022-11-24 Leonid Iosipoi , Anton Vakhrushev

Gradient Boosting (GB) is a popular methodology used to solve prediction problems by minimizing a differentiable loss function, $L$. GB performs very well on tabular machine learning (ML) problems; however, as a pure ML solver it lacks the…

Machine Learning · Computer Science 2022-11-08 Michael T. Horrell

Gradient boosting is widely popular due to its flexibility and predictive accuracy. However, statistical inference and uncertainty quantification for gradient boosting remain challenging and under-explored. We propose a unified framework…

Machine Learning · Statistics 2025-09-30 Haimo Fang , Kevin Tan , Giles Hooker

Despite the rise to dominance of deep learning in unstructured data domains, tree-based methods such as Random Forests (RF) and Gradient Boosted Decision Trees (GBDT) are still the workhorses for handling discriminative tasks on tabular…

Machine Learning · Computer Science 2025-04-21 João Bravo

Machine learning models are increasingly used in critical decision-making applications. However, these models are susceptible to replicating or even amplifying bias present in real-world data. While there are various bias mitigation methods…

Machine Learning · Computer Science 2024-01-05 Shih-Chi Ma , Tatiana Ermakova , Benjamin Fabian