English
Related papers

Related papers: QBDT, a new boosting decision tree method with sys…

200 papers

Gradient Boosting Decision Tree (GBDT) are popular machine learning algorithms with implementations such as LightGBM and in popular machine learning toolkits like Scikit-Learn. Many implementations can only produce trees in an offline…

Machine Learning · Statistics 2020-02-06 Chapman Siu

Gradient Boost Decision Trees (GBDT) is a powerful additive model based on tree ensembles. Its nature makes GBDT a black-box model even though there are multiple explainable artificial intelligence (XAI) models obtaining information by…

Gradient Boosted Decision Trees (GBDT) is a very successful ensemble learning algorithm widely used across a variety of applications. Recently, several variants of GBDT training algorithms and implementations have been designed and heavily…

Machine Learning · Computer Science 2019-06-27 Yu Shi , Jian Li , Zhize Li

Gradient boosting decision tree (GBDT) is an ensemble machine learning algorithm, which is widely used in industry, due to its good performance and easy interpretation. Due to the problem of data isolation and the requirement of privacy,…

Machine Learning · Computer Science 2024-06-21 Tao Fan , Weijing Chen , Guoqiang Ma , Yan Kang , Lixin Fan , Qiang Yang

Machine learning (ML) has been widely applied in high energy physics to help the physical community in particle classification and data analysis. Here we describe the application of machine learning to solve the problem of classifying…

Instrumentation and Detectors · Physics 2020-09-03 Alexey Grobov , Aidar Ilyasov

Training features used to analyse physical processes are often highly correlated and determining which ones are most important for the classification is a non-trivial tasks. For the use case of a search for a top-quark pair produced in…

Data Analysis, Statistics and Probability · Physics 2019-06-14 Paul Glaysher , Judith M. Katzy , Sitong An

Multi-layered representation is believed to be the key ingredient of deep neural networks especially in cognitive tasks like computer vision. While non-differentiable models such as gradient boosting decision trees (GBDTs) are the dominant…

Machine Learning · Computer Science 2020-07-07 Ji Feng , Yang Yu , Zhi-Hua Zhou

The Gradient Boosted Tree (GBT) algorithm is one of the most popular machine learning algorithms used in production, for tasks that include Click-Through Rate (CTR) prediction and learning-to-rank. To deal with the massive datasets…

Machine Learning · Computer Science 2019-05-30 Theodore Vasiloudis , Hyunsu Cho , Henrik Boström

We present an application of a particular machine-learning method (Boosted Decision Trees, BDTs using AdaBoost) to separate stars and galaxies in photometric images using their catalog characteristics. BDTs are a well established machine…

Instrumentation and Methods for Astrophysics · Physics 2015-04-28 Ignacio Sevilla-Noarbe , Penélope Etayo-Sotos

We study the binary discrimination problem of identification of boosted $H\to gg$ decays from massive QCD jets in a systematic expansion in the strong coupling. Though this decay mode of the Higgs is unlikely to be discovered at the LHC, we…

High Energy Physics - Phenomenology · Physics 2025-04-23 Andrew J. Larkoski

Machine learning techniques are becoming an integral component of data analysis in High Energy Physics (HEP). These tools provide a significant improvement in sensitivity over traditional analyses by exploiting subtle patterns in…

Data Analysis, Statistics and Probability · Physics 2021-10-04 Aishik Ghosh , Benjamin Nachman , Daniel Whiteson

State-of-the-art machine learning solutions mainly focus on creating highly accurate models without constraints on hardware resources. Stream mining algorithms are designed to run on resource-constrained devices, thus a focus on low power…

Machine Learning · Computer Science 2022-05-09 Eva Garcia-Martin , Albert Bifet , Niklas Lavesson , Rikard König , Henrik Linusson

Time-series data classification is central to the analysis and control of autonomous systems, such as robots and self-driving cars. Temporal logic-based learning algorithms have been proposed recently as classifiers of such data. However,…

Machine Learning · Computer Science 2022-07-08 Erfan Aasi , Cristian Ioan Vasile , Mahroo Bahreinian , Calin Belta

Machine learning applications such as finance and medicine demand accurate and justifiable predictions, barring most deep learning methods from use. In response, previous work combines decision trees with deep learning, yielding models that…

Computer Vision and Pattern Recognition · Computer Science 2021-01-29 Alvin Wan , Lisa Dunlap , Daniel Ho , Jihan Yin , Scott Lee , Henry Jin , Suzanne Petryk , Sarah Adel Bargal , Joseph E. Gonzalez

Gradient Boosting Decision Tree (GBDT) is one of the most popular machine learning models in various applications. However, in the traditional settings, all data should be simultaneously accessed in the training procedure: it does not allow…

Machine Learning · Computer Science 2025-02-04 Huawei Lin , Jun Woo Chung , Yingjie Lao , Weijie Zhao

Uplift modeling comprises a collection of machine learning techniques designed for managers to predict the incremental impact of specific actions on customer outcomes. However, accurately estimating this incremental impact poses significant…

Machine Learning · Computer Science 2025-02-10 Junjie Gao , Xiangyu Zheng , DongDong Wang , Zhixiang Huang , Bangqi Zheng , Kai Yang

Recent years have witnessed significant success in Gradient Boosting Decision Trees (GBDT) for a wide range of machine learning applications. Generally, a consensus about GBDT's training algorithms is gradients and statistics are computed…

Machine Learning · Computer Science 2023-01-18 Yu Shi , Guolin Ke , Zhuoming Chen , Shuxin Zheng , Tie-Yan Liu

Gradient boosted decision trees (GBDTs) are widely used in machine learning, and the output of current GBDT implementations is a single variable. When there are multiple outputs, GBDT constructs multiple trees corresponding to the output…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Zhendong Zhang , Cheolkon Jung

A deep-learning-based hybrid strategy for short-term load forecasting is presented. The strategy proposes a novel tree-based ensemble method Warm-start Gradient Tree Boosting (WGTB). Current strategies either ensemble submodels of a single…

Machine Learning · Computer Science 2020-12-08 Yuexin Zhang , Jiahong Wang

Extracting bounds on BSM operators at hadron colliders can be a highly non-trivial task. It can be useful or, depending on the complexity of the event structure, even essential to employ modern analysis techniques in order to measure…

High Energy Physics - Phenomenology · Physics 2024-08-01 Philipp Englert