English
Related papers

Related papers: An Empirical Evaluation of Four Algorithms for Mul…

200 papers

Gradient boosting algorithms construct a regression predictor using a linear combination of ``base learners''. Boosting also offers an approach to obtaining robust non-parametric regression estimators that are scalable to applications with…

Methodology · Statistics 2020-08-11 Xiaomeng Ju , Matías Salibián-Barrera

In many applications of supervised learning, multiple classification or regression outputs have to be predicted jointly. We consider several extensions of gradient boosting to address such problems. We first propose a straightforward…

Machine Learning · Statistics 2019-05-21 Arnaud Joly , Louis Wehenkel , Pierre Geurts

Bayesian Additive Regression Trees(BART) is a Bayesian nonparametric approach which has been shown to be competitive with the best modern predictive methods such as random forest and Gradient Boosting Decision Tree.The sum of trees…

Applications · Statistics 2021-08-27 Hao Ran , Yang Bai

In this article we propose a boosting algorithm for regression with functional explanatory variables and scalar responses. The algorithm uses decision trees constructed with multiple projections as the "base-learners", which we call…

Methodology · Statistics 2023-04-07 Xiaomeng Ju , Matías Salibián-Barrera

In recent years, there has been growing attention to interpretable machine learning models which can give explanatory insights on their behaviour. Thanks to their interpretability, decision trees have been intensively studied for…

Optimization and Control · Mathematics 2023-10-10 Federico D'Onofrio , Giorgio Grani , Marta Monaci , Laura Palagi

This study assessed the effectiveness of machine learning models in predicting poverty levels in the Philippines using five boosting algorithms: Adaptive Boosting (AdaBoost), CatBoosting (CatBoost), Gradient Boosting Machine (GBM), Light…

Computers and Society · Computer Science 2024-07-19 Erika Lynet Salvador

The sensitivity of Adaboost to random label noise is a well-studied problem. LogitBoost, BrownBoost and RobustBoost are boosting algorithms claimed to be less sensitive to noise than AdaBoost. We present the results of experiments…

Machine Learning · Computer Science 2014-09-11 Sunsern Cheamanunkul , Evan Ettinger , Yoav Freund

Answer selection (AS) is a critical subtask of the open-domain question answering (QA) problem. The present paper proposes a method called RLAS-BIABC for AS, which is established on attention mechanism-based long short-term memory (LSTM)…

Computation and Language · Computer Science 2023-01-10 Hamid Gharagozlou , Javad Mohammadzadeh , Azam Bastanfard , Saeed Shiry Ghidary

The efficacy of particle identification is compared using artificial neutral networks and boosted decision trees. The comparison is performed in the context of the MiniBooNE, an experiment at Fermilab searching for neutrino oscillations.…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Byron P. Roe , Hai-Jun Yang , Ji Zhu , Yong Liu , Ion Stancu , Gordon McGregor

This paper explores advancements in Artificial Intelligence technologies to enhance classroom learning, highlighting contributions from companies like IBM, Microsoft, Google, and ChatGPT, as well as the potential of brain signal analysis.…

Computers and Society · Computer Science 2025-03-11 Shadeeb Hossain

Despite their theoretical appeal, totally corrective boosting methods based on linear programming have received limited empirical attention. In this paper, we conduct the first large-scale experimental study of six LP-based boosting…

Machine Learning · Computer Science 2025-12-22 Fabian Akkerman , Julien Ferry , Christian Artigues , Emmanuel Hebrard , Thibaut Vidal

This study evaluates the integration of Bloom's Taxonomy into OneClickQuiz, an Artificial Intelligence (AI) driven plugin for automating Multiple-Choice Question (MCQ) generation in Moodle. Bloom's Taxonomy provides a structured framework…

Artificial Intelligence · Computer Science 2025-09-03 Antoun Yaacoub , Jérôme Da-Rugna , Zainab Assaghir

ProBoost, a new boosting algorithm for probabilistic classifiers, is proposed in this work. This algorithm uses the epistemic uncertainty of each training sample to determine the most challenging/uncertain ones; the relevance of these…

Multiple Additive Regression Trees (MART), an ensemble model of boosted regression trees, is known to deliver high prediction accuracy for diverse tasks, and it is widely used in practice. However, it suffers an issue which we call…

Machine Learning · Computer Science 2015-05-11 K. V. Rashmi , Ran Gilad-Bachrach

Boosting is a method for learning a single accurate predictor by linearly combining a set of less accurate weak learners. Recently, structured learning has found many applications in computer vision. Inspired by structured support vector…

Machine Learning · Computer Science 2020-03-10 Chunhua Shen , Guosheng Lin , Anton van den Hengel

Gradient boosted trees and other regression tree models perform well in a wide range of real-world, industrial applications. These tree models (i) offer insight into important prediction features, (ii) effectively manage sparse data, and…

Machine Learning · Statistics 2021-05-19 Alexander Thebelt , Jan Kronqvist , Miten Mistry , Robert M. Lee , Nathan Sudermann-Merx , Ruth Misener

We study a generalization of boosting to the multiclass setting. We introduce a weak learning condition for multiclass classification that captures the original notion of weak learnability as being "slightly better than random guessing". We…

Machine Learning · Computer Science 2023-07-04 Nataly Brukhim , Amit Daniely , Yishay Mansour , Shay Moran

This paper proposes a hybrid framework combining LSTM (Long Short-Term Memory) networks with LightGBM and CatBoost for stock price prediction. The framework processes time-series financial data and evaluates performance using seven models:…

Machine Learning · Computer Science 2025-05-30 Chang Yu , Fang Liu , Jie Zhu , Shaobo Guo , Yifan Gao , Zhongheng Yang , Meiwei Liu , Qianwen Xing

Musical instrument classification, a key area in Music Information Retrieval, has gained considerable interest due to its applications in education, digital music production, and consumer media. Recent advances in machine learning,…

Sound · Computer Science 2024-11-04 Joanikij Chulev

This paper introduces ICET, a new algorithm for cost-sensitive classification. ICET uses a genetic algorithm to evolve a population of biases for a decision tree induction algorithm. The fitness function of the genetic algorithm is the…

Artificial Intelligence · Computer Science 2009-09-25 P. D. Turney