English
Related papers

Related papers: Dimension Reduction Using Rule Ensemble Machine Le…

200 papers

There is a long history in machine learning of model ensembling, beginning with boosting and bagging and continuing to the present day. Much of this history has focused on combining models for classification and regression, but recently…

Machine Learning · Computer Science 2024-05-28 Ira Globus-Harris , Varun Gupta , Michael Kearns , Aaron Roth

Given the continuous increase in dataset sizes and the complexity of forecasting models, the trade-off between forecast accuracy and computational cost is emerging as an extremely relevant topic, especially in the context of ensemble…

Machine Learning · Computer Science 2025-07-10 Marco Zanotti

Current deep neural networks suffer from two problems; first, they are hard to interpret, and second, they suffer from overfitting. There have been many attempts to define interpretability in neural networks, but they typically lack…

Machine Learning · Computer Science 2019-08-15 Sean Tao

In this paper, we consider ensemble classifiers, that is, machine learning based classifiers that utilize a combination of scoring functions. We provide a framework for categorizing such classifiers, and we outline several ensemble…

Cryptography and Security · Computer Science 2021-03-24 Mark Stamp , Aniket Chandak , Gavin Wong , Allen Ye

Machine Learning-based supervised approaches require highly customized and fine-tuned methodologies to deliver outstanding performance. This paper presents a dataset-driven design and performance evaluation of a machine learning classifier…

Cryptography and Security · Computer Science 2022-05-13 Zeinab Zoghi , Gursel Serpen

Predictions in the form of probability distributions are crucial for effective decision-making. Quantile regression enables such predictions within spatial prediction settings that aim to create improved precipitation datasets by merging…

Machine Learning · Computer Science 2025-08-05 Georgia Papacharalampous , Hristos Tyralis , Nikolaos Doulamis , Anastasios Doulamis

Ensemble learning is characterized by flexibility, high precision, and refined structure. As a critical component within computational finance, option pricing with machine learning requires both high predictive accuracy and reduced…

Machine Learning · Computer Science 2025-06-09 Zeyuan Li , Qingdao Huang

Tree ensemble models like random forests and gradient boosting machines are widely used in machine learning due to their excellent predictive performance. However, a high-performance ensemble consisting of a large number of decision trees…

Machine Learning · Statistics 2024-10-28 Zebin Yang , Agus Sudjianto , Xiaoming Li , Aijun Zhang

Reliable detection and quantification of quantum entanglement, particularly in high-spin or many-body systems, present significant computational challenges for traditional methods. This study examines the effectiveness of ensemble machine…

Quantum Physics · Physics 2025-07-18 M. Y. Abd-Rabbou , Amr M. Abdallah , Ahmed A. Zahia , Ashraf A. Gouda , Cong-Feng Qiao

Few-shot learning has been proposed and rapidly emerging as a viable means for completing various tasks. Many few-shot models have been widely used for relation learning tasks. However, each of these models has a shortage of capturing a…

Computation and Language · Computer Science 2021-05-26 Qing Lin , Yongbin Liu , Wen Wen , Zhihua Tao

One of the most promising approaches for complex technical systems analysis employs ensemble methods of classification. Ensemble methods enable to build a reliable decision rules for feature space classification in the presence of many…

Artificial Intelligence · Computer Science 2016-01-11 Alexei Zhukov , Victor Kurbatsky , Nikita Tomin , Denis Sidorov , Daniil Panasetsky , Aoife Foley

Ensembling is a powerful technique for improving the accuracy of machine learning models, with methods like stacking achieving strong results in tabular tasks. In time series forecasting, however, ensemble methods remain underutilized, with…

Machine Learning · Computer Science 2025-11-20 Nathanael Bosch , Oleksandr Shchur , Nick Erickson , Michael Bohlke-Schneider , Caner Türkmen

Ensemble learning serves as a straightforward way to improve the performance of almost any machine learning algorithm. Existing deep ensemble methods usually naively train many different models and then aggregate their predictions. This is…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Le Zhang , Qibin Hou , Yun Liu , Jia-Wang Bian , Xun Xu , Joey Tianyi Zhou , Ce Zhu

Quantum neural networks hold significant promise for numerous applications, particularly as they can be executed on the current generation of quantum hardware. However, due to limited qubits or hardware noise, conducting large-scale…

We investigate the use of sequence analysis for behavior modeling, emphasizing that sequential context often outweighs the value of aggregate features in understanding human behavior. We discuss framing common problems in fields like…

Machine Learning · Computer Science 2024-11-06 Maxime Kawawa-Beaudan , Srijan Sood , Soham Palande , Ganapathy Mani , Tucker Balch , Manuela Veloso

Recognizing apparel attributes has recently drawn great interest in the computer vision community. Methods based on various deep neural networks have been proposed for image classification, which could be applied to apparel attributes…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Tianqi Han , Zhihui Fu , Hongyu Li

We consider the problem of learning decision rules for prediction with feature budget constraint. In particular, we are interested in pruning an ensemble of decision trees to reduce expected feature cost while maintaining high prediction…

Machine Learning · Statistics 2016-01-06 Feng Nan , Joseph Wang , Venkatesh Saligrama

Ensemble methods are powerful machine learning algorithms that combine multiple models to enhance prediction capabilities and reduce generalization errors. However, their potential to generate effective test cases for fault detection in a…

Software Engineering · Computer Science 2024-09-10 Sheikh Md. Mushfiqur Rahman , Nasir U. Eisty

An ensemble method should cleverly combine a group of base classifiers to yield an improved classifier. The majority vote is an example of a methodology used to combine classifiers in an ensemble method. In this paper, we propose to combine…

Machine Learning · Computer Science 2020-09-21 Rodolfo Anibal Lobo , Marcos Eduardo Valle

An approach to evolutionary ensemble learning for classification is proposed in which boosting is used to construct a stack of programs. Each application of boosting identifies a single champion and a residual dataset, i.e. the training…

Neural and Evolutionary Computing · Computer Science 2023-11-27 Zhilei Zhou , Ziyu Qiu , Brad Niblett , Andrew Johnston , Jeffrey Schwartzentruber , Nur Zincir-Heywood , Malcolm Heywood