English
Related papers

Related papers: Unpack Local Model Interpretation for GBDT

200 papers

Gradient Boost Decision Trees (GBDT) is a powerful additive model based on tree ensembles. Its nature makes GBDT a black-box model even though there are multiple explainable artificial intelligence (XAI) models obtaining information by…

Gradient Boosting Decision Tree (GBDT) has achieved remarkable success in a wide variety of applications. The split finding algorithm, which determines the tree construction process, is one of the most crucial components of GBDT. However,…

Machine Learning · Computer Science 2023-05-19 Zheyu Zhang , Tianping Zhang , Jian Li

Gradient Boosting Decision Tree (GBDT) is one of the most popular machine learning models in various applications. However, in the traditional settings, all data should be simultaneously accessed in the training procedure: it does not allow…

Machine Learning · Computer Science 2025-02-04 Huawei Lin , Jun Woo Chung , Yingjie Lao , Weijie Zhao

Gradient Boosting Decision Tree (GBDT) are popular machine learning algorithms with implementations such as LightGBM and in popular machine learning toolkits like Scikit-Learn. Many implementations can only produce trees in an offline…

Machine Learning · Statistics 2020-02-06 Chapman Siu

Gradient Boosted Decision Trees (GBDTs) are widely used for building ranking and relevance models in search and recommendation. Considerations such as latency and interpretability dictate the use of as few features as possible to train…

Machine Learning · Statistics 2021-09-07 Cuize Han , Nikhil Rao , Daria Sorokina , Karthik Subbian

Uplift modeling comprises a collection of machine learning techniques designed for managers to predict the incremental impact of specific actions on customer outcomes. However, accurately estimating this incremental impact poses significant…

Machine Learning · Computer Science 2025-02-10 Junjie Gao , Xiangyu Zheng , DongDong Wang , Zhixiang Huang , Bangqi Zheng , Kai Yang

Gradient boosted decision trees (GBDTs) are widely used in machine learning, and the output of current GBDT implementations is a single variable. When there are multiple outputs, GBDT constructs multiple trees corresponding to the output…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Zhendong Zhang , Cheolkon Jung

Multi-layered representation is believed to be the key ingredient of deep neural networks especially in cognitive tasks like computer vision. While non-differentiable models such as gradient boosting decision trees (GBDTs) are the dominant…

Machine Learning · Computer Science 2020-07-07 Ji Feng , Yang Yu , Zhi-Hua Zhou

A method for the local and global interpretation of a black-box model on the basis of the well-known generalized additive models is proposed. It can be viewed as an extension or a modification of the algorithm using the neural additive…

Machine Learning · Computer Science 2020-10-16 Andrei V. Konstantinov , Lev V. Utkin

Gradient Boosted Decision Trees (GBDT) is a very successful ensemble learning algorithm widely used across a variety of applications. Recently, several variants of GBDT training algorithms and implementations have been designed and heavily…

Machine Learning · Computer Science 2019-06-27 Yu Shi , Jian Li , Zhize Li

Practitioners who wish to build real-world applications that rely on ranking models, need to decide which modelling paradigm to follow. This is not an easy choice to make, as the research literature on this topic has been shifting in recent…

Despite the success of deep learning in computer vision and natural language processing, Gradient Boosted Decision Tree (GBDT) is yet one of the most powerful tools for applications with tabular data such as e-commerce and FinTech. However,…

Machine Learning · Computer Science 2022-01-25 ZhenZhe Ying , Zhuoer Xu , Zhifeng Li , Weiqiang Wang , Changhua Meng

Influence estimation analyzes how changes to the training data can lead to different model predictions; this analysis can help us better understand these predictions, the models making those predictions, and the data sets they're trained…

Machine Learning · Computer Science 2023-06-01 Jonathan Brophy , Zayd Hammoudeh , Daniel Lowd

Understanding how "black-box" models arrive at their predictions has sparked significant interest from both within and outside the AI community. Our work focuses on doing this by generating local explanations about individual predictions…

Machine Learning · Computer Science 2019-07-08 Ana Lucic , Hinda Haned , Maarten de Rijke

The Gradient Boosting Decision Tree (GBDT) is a popular machine learning model for various tasks in recent years. In this paper, we study how to improve model accuracy of GBDT while preserving the strong guarantee of differential privacy.…

Machine Learning · Computer Science 2022-10-11 Qinbin Li , Zhaomin Wu , Zeyi Wen , Bingsheng He

In this work, we propose a simple but effective method to interpret black-box machine learning models globally. That is, we use a compact binary tree, the interpretation tree, to explicitly represent the most important decision rules that…

Machine Learning · Computer Science 2018-05-24 Chengliang Yang , Anand Rangarajan , Sanjay Ranka

Gradient Boosted Decision Trees (GBDTs) are dominant machine learning algorithms for modeling discrete or tabular data. Unlike neural networks with millions of trainable parameters, GBDTs optimize loss function in an additive manner and…

Machine Learning · Computer Science 2022-11-22 Jean Pachebat , Sergei Ivanov

Gradient Boosted Decision Tree (GBDT) is a widely-used machine learning algorithm that has been shown to achieve state-of-the-art results on many standard data science problems. We are interested in its application to multioutput problems…

Machine Learning · Computer Science 2022-11-24 Leonid Iosipoi , Anton Vakhrushev

Class imbalance remains a significant challenge in machine learning, particularly for tabular data classification tasks. While Gradient Boosting Decision Trees (GBDT) models have proven highly effective for such tasks, their performance can…

Machine Learning · Computer Science 2024-07-22 Jiaqi Luo , Yuan Yuan , Shixin Xu

Gradient boosting decision tree (GBDT) is a powerful and widely-used machine learning model, which has achieved state-of-the-art performance in many academic areas and production environment. However, communication overhead is the main…

Data Structures and Algorithms · Computer Science 2019-09-18 Ziyue Huang , Ke Yi
‹ Prev 1 2 3 10 Next ›