中文
相关论文

相关论文: Enhancing Robustness of Gradient-Boosted Decision …

200 篇论文

Medical diagnosis is a crucial task in the medical field, in terms of providing accurate classification and respective treatments. Having near-precise decisions based on correct diagnosis can affect a patient's life itself, and may…

机器学习 · 计算机科学 2025-08-27 A. Yarkın Yıldız , Asli Kalayci

Gradient Boosting Machines (GBM) are hugely popular for solving tabular data problems. However, practitioners are not only interested in point predictions, but also in probabilistic predictions in order to quantify the uncertainty of the…

机器学习 · 计算机科学 2021-06-08 Olivier Sprangers , Sebastian Schelter , Maarten de Rijke

We present Gradient Boosting Reinforcement Learning (GBRL), a framework that adapts the strengths of gradient boosting trees (GBT) to reinforcement learning (RL) tasks. While neural networks (NNs) have become the de facto choice for RL,…

机器学习 · 计算机科学 2025-10-21 Benjamin Fuhrer , Chen Tessler , Gal Dalal

Gradient boosting machines (GBMs) based on decision trees consistently demonstrate state-of-the-art results on regression and classification tasks with tabular data, often outperforming deep neural networks. However, these models do not…

机器学习 · 计算机科学 2023-02-23 Tristan Cinquin , Tammo Rukat , Philipp Schmidt , Martin Wistuba , Artur Bekasov

Label noise, which refers to the mislabeling of instances in a dataset, can significantly impair classifier performance, increase model complexity, and affect feature selection. While most research has concentrated on deep neural networks…

机器学习 · 计算机科学 2025-01-07 Anita Eisenbürger , Daniel Otten , Anselm Hudde , Frank Hopfgartner

Graph neural networks (GNNs) are powerful models that have been successful in various graph representation learning tasks. Whereas gradient boosted decision trees (GBDT) often outperform other machine learning methods when faced with…

机器学习 · 计算机科学 2021-04-01 Sergei Ivanov , Liudmila Prokhorenkova

Decision trees are widely used for classification and regression tasks in a variety of application fields due to their interpretability and good accuracy. During the past decade, growing attention has been devoted to globally optimized…

机器学习 · 计算机科学 2025-01-28 Antonio Consolo , Edoardo Amaldi , Andrea Manno

Gradient Boosted Decision Tree (GBDT) is a widely-used machine learning algorithm that has been shown to achieve state-of-the-art results on many standard data science problems. We are interested in its application to multioutput problems…

机器学习 · 计算机科学 2022-11-24 Leonid Iosipoi , Anton Vakhrushev

Gradient Boosting Decision Trees (GBDTs) have become very successful in recent years, with many awards in machine learning and data mining competitions. There have been several recent studies on how to train GBDTs in the federated learning…

机器学习 · 计算机科学 2019-12-16 Qinbin Li , Zeyi Wen , Bingsheng He

Deep neural networks are able to learn multi-layered representation via back propagation (BP). Although the gradient boosting decision tree (GBDT) is effective for modeling tabular data, it is non-differentiable with respect to its input,…

机器学习 · 计算机科学 2021-09-28 Zhendong Zhang

Gradient Boosted Decision Trees (GBDTs) are widely used for building ranking and relevance models in search and recommendation. Considerations such as latency and interpretability dictate the use of as few features as possible to train…

机器学习 · 统计学 2021-09-07 Cuize Han , Nikhil Rao , Daria Sorokina , Karthik Subbian

Gradient boosting decision tree (GBDT) is an ensemble machine learning algorithm, which is widely used in industry, due to its good performance and easy interpretation. Due to the problem of data isolation and the requirement of privacy,…

机器学习 · 计算机科学 2024-06-21 Tao Fan , Weijing Chen , Guoqiang Ma , Yan Kang , Lixin Fan , Qiang Yang

Uplift modeling comprises a collection of machine learning techniques designed for managers to predict the incremental impact of specific actions on customer outcomes. However, accurately estimating this incremental impact poses significant…

机器学习 · 计算机科学 2025-02-10 Junjie Gao , Xiangyu Zheng , DongDong Wang , Zhixiang Huang , Bangqi Zheng , Kai Yang

Gradient Boosting Decision Trees (GBDTs) dominate tabular machine learning, with modern implementations like XGBoost, LightGBM, and CatBoost being based on Newton boosting: a second-order descent step in the space of decision trees. Despite…

机器学习 · 统计学 2026-05-04 Nikita Zozoulenko , Daniel Falkowski , Thomas Cass , Lukas Gonon

Large pre-trained models have demonstrated extensive applications across various fields. However, fine-tuning these models for specific downstream tasks demands significant computational resources and storage. One fine-tuning method,…

机器学习 · 计算机科学 2025-07-02 Xuanbo Liu , Liu Liu , Fuxiang Wu , Fusheng Hao , Xianglong Liu

Classification and Regression Tree (CART), Random Forest (RF) and Gradient Boosting Tree (GBT) are probably the most popular set of statistical learning methods. However, their statistical consistency can only be proved under very…

统计理论 · 数学 2025-02-17 Haoran Zhan , Yu Liu , Yingcun Xia

Understanding how "black-box" models arrive at their predictions has sparked significant interest from both within and outside the AI community. Our work focuses on doing this by generating local explanations about individual predictions…

机器学习 · 计算机科学 2019-07-08 Ana Lucic , Hinda Haned , Maarten de Rijke

Despite the success of deep learning in computer vision and natural language processing, Gradient Boosted Decision Tree (GBDT) is yet one of the most powerful tools for applications with tabular data such as e-commerce and FinTech. However,…

机器学习 · 计算机科学 2022-01-25 ZhenZhe Ying , Zhuoer Xu , Zhifeng Li , Weiqiang Wang , Changhua Meng

Simulating complex diffusion-reaction systems is often prohibitively expensive due to the high dimensionality and stiffness of the underlying ODEs, where state variables may span tens of orders of magnitude. Deep learning has recently…

动力系统 · 数学 2025-12-08 Yuxiao Yi , Weizong Wang , Tianhan Zhang , Zhi-Qin John Xu

The application of deep learning to non-stationary temporal datasets can lead to overfitted models that underperform under regime changes. In this work, we propose a modular machine learning pipeline for ranking predictions on temporal…

计算金融 · 定量金融 2023-08-11 Thomas Wong , Mauricio Barahona