English
Related papers

Related papers: Challenging Gradient Boosted Decision Trees with T…

200 papers

For classification and regression on tabular data, the dominance of gradient-boosted decision trees (GBDTs) has recently been challenged by often much slower deep learning methods with extensive hyperparameter tuning. We address this…

Machine Learning · Computer Science 2025-01-16 David Holzmüller , Léo Grinsztajn , Ingo Steinwart

The Gradient Boosted Tree (GBT) algorithm is one of the most popular machine learning algorithms used in production, for tasks that include Click-Through Rate (CTR) prediction and learning-to-rank. To deal with the massive datasets…

Machine Learning · Computer Science 2019-05-30 Theodore Vasiloudis , Hyunsu Cho , Henrik Boström

Gradient Boosted Decision Trees (GBDT) is a very successful ensemble learning algorithm widely used across a variety of applications. Recently, several variants of GBDT training algorithms and implementations have been designed and heavily…

Machine Learning · Computer Science 2019-06-27 Yu Shi , Jian Li , Zhize Li

This paper introduces a cutting-edge method for enhancing recommender systems through the integration of generative self-supervised learning (SSL) with a Residual Graph Transformer. Our approach emphasizes the importance of superior data…

Information Retrieval · Computer Science 2025-04-16 Eya Mhedhbi , Youssef Mourchid , Alice Othmani

We introduce S-BDT: a novel $(\varepsilon,\delta)$-differentially private distributed gradient boosted decision tree (GBDT) learner that improves the protection of single training data points (privacy) while achieving meaningful learning…

Cryptography and Security · Computer Science 2024-08-19 Thorsten Peinemann , Moritz Kirschte , Joshua Stock , Carlos Cotrini , Esfandiar Mohammadi

With the rapid development of e-commerce, e-commerce platforms are facing an increasing number of fraud threats. Effectively identifying and preventing these fraudulent activities has become a critical research problem. Traditional fraud…

Machine Learning · Computer Science 2025-03-25 Xuan Li , Yuting Peng , Xiaoxuan Sun , Yifei Duan , Zhou Fang , Tengda Tang

Dealing with label noise in tabular classification tasks poses a persistent challenge in machine learning. While robust boosting methods have shown promise in binary classification, their effectiveness in complex, multi-class scenarios is…

Machine Learning · Computer Science 2024-03-19 Jiaqi Luo , Yuedong Quan , Shixin Xu

Credit card fraud detection (CCFD) is a critical application of Machine Learning (ML) in the financial sector, where accurately identifying fraudulent transactions is essential for mitigating financial losses. ML models have demonstrated…

Cryptography and Security · Computer Science 2025-08-21 Jan Lum Fok , Qingwen Zeng , Shiping Chen , Oscar Fawkes , Huaming Chen

Developing effective and efficient recommendation methods is very challenging for modern e-commerce platforms. Generally speaking, two essential modules named "Click-Through Rate Prediction" (\textit{CTR}) and "Conversion Rate Prediction"…

Machine Learning · Computer Science 2018-11-20 Hong Wen , Jing Zhang , Quan Lin , Keping Yang , Pipei Huang

In response to legislation mandating companies to honor the \textit{right to be forgotten} by erasing user data, it has become imperative to enable data removal in Vertical Federated Learning (VFL) where multiple parties provide private…

Machine Learning · Computer Science 2023-11-23 Jian Zhang , Bowen Li Jie Li , Chentao Wu

Transformer-based models have shown promising performance on tabular data compared to their classical counterparts such as neural networks and Gradient Boosted Decision Trees (GBDTs) in scenarios with limited training data. They utilize…

Machine Learning · Computer Science 2025-11-21 Pasan Dissanayake , Sanghamitra Dutta

Large Language Models (LLM) have brought numerous of new applications to Machine Learning (ML). In the context of tabular data (TD), recent studies show that TabLLM is a very powerful mechanism for few-shot-learning (FSL) applications, even…

Machine Learning · Computer Science 2024-11-08 Carlos Huertas

As online fraud becomes more sophisticated and pervasive, traditional fraud detection methods are struggling to keep pace with the evolving tactics employed by fraudsters. This paper explores the transformative role of machine learning in…

Machine Learning · Computer Science 2024-10-29 Md Kamrul Hasan Chy

Credit card fraud incurs a considerable cost for both cardholders and issuing banks. Contemporary methods apply machine learning-based classifiers to detect fraudulent behavior from labeled transaction records. But labeled data are usually…

Machine Learning · Computer Science 2024-12-25 Sheng Xiang , Mingzhi Zhu , Dawei Cheng , Enxia Li , Ruihui Zhao , Yi Ouyang , Ling Chen , Yefeng Zheng

Deep neural networks are able to learn multi-layered representation via back propagation (BP). Although the gradient boosting decision tree (GBDT) is effective for modeling tabular data, it is non-differentiable with respect to its input,…

Machine Learning · Computer Science 2021-09-28 Zhendong Zhang

Despite the rise to dominance of deep learning in unstructured data domains, tree-based methods such as Random Forests (RF) and Gradient Boosted Decision Trees (GBDT) are still the workhorses for handling discriminative tasks on tabular…

Machine Learning · Computer Science 2025-04-21 João Bravo

Secure online transaction is an essential task for e-commerce platforms. Alipay, one of the world's leading cashless payment platform, provides the payment service to both merchants and individual customers. The fraud detection models are…

Machine Learning · Computer Science 2020-04-06 Wenjing Fang , Chaochao Chen , Bowen Song , Li Wang , Jun Zhou , Kenny Q. Zhu

Uplift modeling comprises a collection of machine learning techniques designed for managers to predict the incremental impact of specific actions on customer outcomes. However, accurately estimating this incremental impact poses significant…

Machine Learning · Computer Science 2025-02-10 Junjie Gao , Xiangyu Zheng , DongDong Wang , Zhixiang Huang , Bangqi Zheng , Kai Yang

Machine learning (ML) will likely play a large role in many processes in the future, also for insurance companies. However, ML models are at risk of being attacked and manipulated. In this work, the robustness of Gradient Boosted Decision…

Machine Learning · Computer Science 2025-09-30 Robin Kühlem , Daniel Otten , Daniel Ludwig , Anselm Hudde , Alexander Rosenbaum , Andreas Mauthe

Fraud detection remains a critical task in high-stakes domains such as finance and e-commerce, where undetected fraudulent transactions can lead to significant economic losses. In this study, we systematically compare the performance of…

Machine Learning · Computer Science 2025-09-19 Chao Wang , Chuanhao Nie , Yunbo Liu