English
Related papers

Related papers: Regularized Neural Ensemblers

200 papers

Local decision rules are commonly understood to be more explainable, due to the local nature of the patterns involved. With numerical optimization methods such as gradient boosting, ensembles of local decision rules can gain good predictive…

Machine Learning · Computer Science 2025-08-27 Xin Du , Subramanian Ramamoorthy , Wouter Duivesteijn , Jin Tian , Mykola Pechenizkiy

In recent years, research on learning with noisy labels has focused on devising novel algorithms that can achieve robustness to noisy training labels while generalizing to clean data. These algorithms often incorporate sophisticated…

Machine Learning · Computer Science 2023-07-12 Hui Kang , Sheng Liu , Huaxi Huang , Jun Yu , Bo Han , Dadong Wang , Tongliang Liu

Density aggregation is a central problem in machine learning, for instance when combining predictions from a Deep Ensemble. The choice of aggregation remains an open question with two commonly proposed approaches being linear pooling…

Deep learning classifiers are assisting humans in making decisions and hence the user's trust in these models is of paramount importance. Trust is often a function of constant behavior. From an AI model perspective it means given the same…

Ensembling is among the most popular tools in machine learning (ML) due to its effectiveness in minimizing variance and thus improving generalization. Most ensembling methods for black-box base learners fall under the umbrella of "stacked…

Machine Learning · Computer Science 2025-12-17 Hilaf Hasson , Danielle C. Maddix , Yuyang Wang , Gaurav Gupta , Youngsuk Park

Training multiple deep neural networks (DNNs) and averaging their outputs is a simple way to improve the predictive performance. Nevertheless, the multiplied training cost prevents this ensemble method to be practical and efficient. Several…

Machine Learning · Computer Science 2021-10-27 Feng Wang , Guoyizhe Wei , Qiao Liu , Jinxiang Ou , Xian Wei , Hairong Lv

We present new methods for multilabel classification, relying on ensemble learning on a collection of random output graphs imposed on the multilabel and a kernel-based structured output learner as the base classifier. For ensemble learning,…

Machine Learning · Computer Science 2013-11-19 Hongyu Su , Juho Rousu

Ensemble techniques are powerful approaches that combine several weak learners to build a stronger one. As a meta-learning framework, ensemble techniques can easily be applied to many machine learning methods. Inspired by ensemble…

Machine Learning · Computer Science 2018-10-29 Hamideh Hajiabadi , Reza Monsefi , Hadi Sadoghi Yazdi

Randomized ensemble classifiers (RECs), where one classifier is randomly selected during inference, have emerged as an attractive alternative to traditional ensembling methods for realizing adversarially robust classifiers with limited…

Machine Learning · Computer Science 2023-05-30 Hassan Dbouk , Naresh R. Shanbhag

We propose an ensemble method to improve the generalization performance of trading strategies trained by deep reinforcement learning algorithms in a highly stochastic environment of intraday cryptocurrency portfolio trading. We adopt a…

Trading and Market Microstructure · Quantitative Finance 2023-09-06 Shuyang Wang , Diego Klabjan

The strength of machine learning models stems from their ability to learn complex function approximations from data; however, this strength also makes training deep neural networks challenging. Notably, the complex models tend to memorize…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Mofassir ul Islam Arif , Mohsan Jameel , Josif Grabocka , Lars Schmidt-Thieme

Modern deep neural networks can produce badly calibrated predictions, especially when train and test distributions are mismatched. Training an ensemble of models and averaging their predictions can help alleviate these issues. We propose a…

Machine Learning · Computer Science 2020-07-09 Asa Cooper Stickland , Iain Murray

Despite deep neural network (DNN)'s impressive prediction performance in various domains, it is well known now that a set of DNN models trained with the same model specification and the same data can produce very different prediction…

Machine Learning · Computer Science 2020-08-18 Zhe Chen , Yuyan Wang , Dong Lin , Derek Zhiyuan Cheng , Lichan Hong , Ed H. Chi , Claire Cui

Inverse problems are common and important in many applications in computational physics but are inherently ill-posed with many possible model parameters resulting in satisfactory results in the observation space. When solving the inverse…

Computational Physics · Physics 2020-06-24 Xin-Lei Zhang , Carlos Michelén-Ströfer , Heng Xiao

The popularity of data augmentation techniques in machine learning has increased in recent years, as they enable the creation of new samples from existing datasets. Rotational augmentation, in particular, has shown great promise by…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Unai Muñoz-Aseguinolaza , Basilio Sierra , Naiara Aginako

In this paper, we present an Adaptive Ensemble Learning framework that aims to boost the performance of deep neural networks by intelligently fusing features through ensemble learning techniques. The proposed framework integrates ensemble…

Artificial Intelligence · Computer Science 2023-04-07 Neelesh Mungoli

Ensemble learning is characterized by flexibility, high precision, and refined structure. As a critical component within computational finance, option pricing with machine learning requires both high predictive accuracy and reduced…

Machine Learning · Computer Science 2025-06-09 Zeyuan Li , Qingdao Huang

In recent years, multi-label classification problem has become a controversial issue. In this kind of classification, each sample is associated with a set of class labels. Ensemble approaches are supervised learning algorithms in which an…

Machine Learning · Computer Science 2018-01-09 Amirreza Mahdavi-Shahri , Mahboobeh Houshmand , Mahdi Yaghoobi , Mehrdad Jalali

Ensemble-based adversarial training is a principled approach to achieve robustness against adversarial attacks. An important technique of this approach is to control the transferability of adversarial examples among ensemble members. We…

Computer Vision and Pattern Recognition · Computer Science 2022-02-08 Anh Bui , Trung Le , He Zhao , Paul Montague , Olivier deVel , Tamas Abraham , Dinh Phung

Ensemble learning has been widely recognized as a pivotal technique for boosting predictive performance by combining multiple base models. Nevertheless, conventional margin-based ensemble methods predominantly focus on maximizing the…

Machine Learning · Computer Science 2025-09-15 Zexu Jin