中文
相关论文

相关论文: UTBoost: Gradient Boosted Decision Trees for Uplif…

200 篇论文

Gradient boosting is widely popular due to its flexibility and predictive accuracy. However, statistical inference and uncertainty quantification for gradient boosting remain challenging and under-explored. We propose a unified framework…

机器学习 · 统计学 2025-09-30 Haimo Fang , Kevin Tan , Giles Hooker

The goal of uplift modeling is to recommend actions that optimize specific outcomes by determining which entities should receive treatment. One common approach involves two steps: first, an inference step that estimates conditional average…

机器学习 · 计算机科学 2025-05-21 Simon De Vos , Christopher Bockel-Rickermann , Stefan Lessmann , Wouter Verbeke

Several methods have been proposed for correcting the elevation bias in digital elevation models (DEMs) for example, linear regression. Nowadays, supervised machine learning enables the modelling of complex relationships between variables,…

机器学习 · 计算机科学 2024-02-13 Chukwuma Okolie , Adedayo Adeleke , Julian Smit , Jon Mills , Iyke Maduako , Caleb Ogbeta

Uplift modeling is widely used in performance marketing to estimate effects of promotion campaigns (e.g., increase of customer retention rate). Since it is impossible to observe outcomes of a recipient in treatment (e.g., receiving a…

机器学习 · 计算机科学 2023-12-18 Yao Zhao , Haipeng Zhang , Shiwei Lyu , Ruiying Jiang , Jinjie Gu , Guannan Zhang

Uplift modeling is aimed at estimating the incremental impact of an action on an individual's behavior, which is useful in various application domains such as targeted marketing (advertisement campaigns) and personalized medicine (medical…

机器学习 · 统计学 2018-11-21 Ikko Yamane , Florian Yger , Jamal Atif , Masashi Sugiyama

In this manuscript (ms), we propose causal inference based single-branch ensemble trees for uplift modeling, namely CIET. Different from standard classification methods for predictive probability modeling, CIET aims to achieve the change in…

机器学习 · 计算机科学 2023-02-06 Fanglan Zheng , Menghan Wang , Kun Li , Jiang Tian , Xiaojia Xiang

Latent Gaussian models and boosting are widely used techniques in statistics and machine learning. Tree-boosting shows excellent prediction accuracy on many data sets, but potential drawbacks are that it assumes conditional independence of…

机器学习 · 计算机科学 2022-08-24 Fabio Sigrist

A new attention-based model for the gradient boosting machine (GBM) called AGBoost (the attention-based gradient boosting) is proposed for solving regression problems. The main idea behind the proposed AGBoost model is to assign attention…

机器学习 · 计算机科学 2022-07-13 Andrei Konstantinov , Lev Utkin , Stanislav Kirpichenko

Forecasting product demand in retail supply chains presents a complex challenge due to noisy, heterogeneous features and rapidly shifting consumer behavior. While traditional gradient boosting decision trees (GBDT) offer strong predictive…

机器学习 · 计算机科学 2026-03-06 Yadi Liu , Xiaoli Ma , Muxin Ge , Zeyu Han , Jingxi Qiu , Ye Aung Moe , Yilan Shen , Wenbin Wei , Cheng Huang

Gradient boosting machines (GBMs) based on decision trees consistently demonstrate state-of-the-art results on regression and classification tasks with tabular data, often outperforming deep neural networks. However, these models do not…

机器学习 · 计算机科学 2023-02-23 Tristan Cinquin , Tammo Rukat , Philipp Schmidt , Martin Wistuba , Artur Bekasov

Despite the growing popularity of machine-learning techniques in decision-making, the added value of causal-oriented strategies with respect to pure machine-learning approaches has rarely been quantified in the literature. These strategies…

机器学习 · 计算机科学 2023-09-22 Théo Verhelst , Robin Petit , Wouter Verbeke , Gianluca Bontempi

Gradient boosting decision tree (GBDT) is an ensemble machine learning algorithm, which is widely used in industry, due to its good performance and easy interpretation. Due to the problem of data isolation and the requirement of privacy,…

机器学习 · 计算机科学 2024-06-21 Tao Fan , Weijing Chen , Guoqiang Ma , Yan Kang , Lixin Fan , Qiang Yang

Gradient boosted trees are competition-winning, general-purpose, non-parametric regressors, which exploit sequential model fitting and gradient descent to minimize a specific loss function. The most popular implementations are tailored to…

机器学习 · 计算机科学 2022-08-23 Lorenzo Nespoli , Vasco Medici

The gradient boosting machine is a powerful ensemble-based machine learning method for solving regression problems. However, one of the difficulties of its using is a possible discontinuity of the regression function, which arises when…

机器学习 · 计算机科学 2020-06-22 Andrei V. Konstantinov , Lev V. Utkin

Additive models, such as produced by gradient boosting, and full interaction models, such as classification and regression trees (CART), are widely used algorithms that have been investigated largely in isolation. We show that these models…

For many practical, high-risk applications, it is essential to quantify uncertainty in a model's predictions to avoid costly mistakes. While predictive uncertainty is widely studied for neural networks, the topic seems to be under-explored…

机器学习 · 计算机科学 2021-04-05 Andrey Malinin , Liudmila Prokhorenkova , Aleksei Ustimenko

Gradient Boosted Decision Trees (GBDTs) are dominant machine learning algorithms for modeling discrete or tabular data. Unlike neural networks with millions of trainable parameters, GBDTs optimize loss function in an additive manner and…

机器学习 · 计算机科学 2022-11-22 Jean Pachebat , Sergei Ivanov

Uplift modeling is a machine learning technique that aims to model treatment effects heterogeneity. It has been used in business and health sectors to predict the effect of a specific action on a given individual. Despite its advantages,…

机器学习 · 计算机科学 2017-04-20 Atef Shaar , Talel Abdessalem , Olivier Segard

We address the problem of finding influential training samples for a particular case of tree ensemble-based models, e.g., Random Forest (RF) or Gradient Boosted Decision Trees (GBDT). A natural way of formalizing this problem is studying…

机器学习 · 计算机科学 2018-03-14 Boris Sharchilev , Yury Ustinovsky , Pavel Serdyukov , Maarten de Rijke

The use of multivariate classifiers, especially neural networks and decision trees, has become commonplace in particle physics. Typically, a series of classifiers is trained rather than just one to enhance the performance; this is known as…

核实验 · 物理学 2015-06-16 Justin Stevens , Mike Williams