English
Related papers

Related papers: An Ensemble Generation Method Based on Instance Ha…

200 papers

In this paper, we consider ensemble classifiers, that is, machine learning based classifiers that utilize a combination of scoring functions. We provide a framework for categorizing such classifiers, and we outline several ensemble…

Cryptography and Security · Computer Science 2021-03-24 Mark Stamp , Aniket Chandak , Gavin Wong , Allen Ye

Ensemble learning is a methodology that integrates multiple DNN learners for improving prediction performance of individual learners. Diversity is greater when the errors of the ensemble prediction is more uniformly distributed. Greater…

Machine Learning · Computer Science 2019-08-30 Ling Liu , Wenqi Wei , Ka-Ho Chow , Margaret Loper , Emre Gursoy , Stacey Truex , Yanzhao Wu

In this paper, we propose a novel dynamic ensemble selection framework using meta-learning. The framework is divided into three steps. In the first step, the pool of classifiers is generated from the training data. The second phase is…

Machine Learning · Computer Science 2018-11-06 Rafael M. O. Cruz , Robert Sabourin , George D. C. Cavalcanti

We present a principled framework to address resource allocation for realizing boosting algorithms on substrates with communication or computation noise. Boosting classifiers (e.g., AdaBoost) make a final decision via a weighted vote from…

Machine Learning · Computer Science 2020-10-28 Yongjune Kim , Yuval Cassuto , Lav R. Varshney

Ensembling has a long history in statistical data analysis, with many impactful applications. However, in many modern machine learning settings, the benefits of ensembling are less ubiquitous and less obvious. We study, both theoretically…

Machine Learning · Statistics 2023-05-23 Ryan Theisen , Hyunsuk Kim , Yaoqing Yang , Liam Hodgkinson , Michael W. Mahoney

We propose an ensemble algorithm, which provides a new approach for evaluating and summing up a set of function samples. The proposed algorithm is not a quantum algorithm, insofar it does not involve quantum entanglement. The query…

Quantum Physics · Physics 2009-11-07 C. D'Helon , V. Protopopescu

Incrementally training deep neural networks to recognize new classes is a challenging problem. Most existing class-incremental learning methods store data or use generative replay, both of which have drawbacks, while 'rehearsal-free'…

Machine Learning · Computer Science 2023-11-10 Gido M. van de Ven , Zhe Li , Andreas S. Tolias

Neural network ensembles is a simple yet effective approach for enhancing generalization capabilities. The most common method involves independently training multiple neural networks initialized with different weights and then averaging…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Shunsuke Sakai , Shunsuke Tsuge , Tatsuhito Hasegawa

Extracting meaning from uncertain, noisy data is a fundamental problem across time series analysis, pattern recognition, and language modeling. This survey presents a unified mathematical framework that connects classical estimation theory,…

Machine Learning · Computer Science 2025-08-22 Mohammed Elmusrati

Accuracy predictor is trained to predict the validation accuracy of an network from its architecture encoding. It can effectively assist in designing networks and improving Neural Architecture Search(NAS) efficiency. However, a…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Ruyi Zhang , Ziwei Yang , Zhi Yang , Xubo Yang , Lei Wang , Zheyang Li

Novel and high-performance medical image classification pipelines are heavily utilizing ensemble learning strategies. The idea of ensemble learning is to assemble diverse models or multiple predictions and, thus, boost prediction…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Dominik Müller , Iñaki Soto-Rey , Frank Kramer

Data pruning, or instance selection, is an important problem in machine learning especially in terms of nearest neighbour classifier. However, in data pruning which speeds up the prediction phase, there is an issue related to the speed and…

Machine Learning · Computer Science 2025-01-22 Marcin Blachnik , Piotr Ciepliński

Heterogeneous ensembles built from the predictions of a wide variety and large number of diverse base predictors represent a potent approach to building predictive models for problems where the ideal base/individual predictor may not be…

Machine Learning · Computer Science 2021-03-01 Ana Stanescu , Gaurav Pandey

Class imbalance and distributional differences in large datasets present significant challenges for classification tasks machine learning, often leading to biased models and poor predictive performance for minority classes. This work…

Machine Learning · Statistics 2024-12-20 Alex Mak , Shubham Sahoo , Shivani Pandey , Yidan Yue , Linglong Kong

Statistical estimates can often be improved by fusion of data from several different sources. One example is so-called ensemble methods which have been successfully applied in areas such as machine learning for classification and…

Physics and Society · Physics 2013-09-03 Johan Dahlin , Pontus Svenson

In this paper, we propose an ensemble learning algorithm called \textit{under-bagging $k$-nearest neighbors} (\textit{under-bagging $k$-NN}) for imbalanced classification problems. On the theoretical side, by developing a new learning…

Machine Learning · Statistics 2021-09-03 Hanyuan Hang , Yuchao Cai , Hanfang Yang , Zhouchen Lin

Recent studies indicate that deep neural networks degrade in generalization performance under noisy supervision. Existing methods focus on isolating clean subsets or correcting noisy labels, facing limitations such as high computational…

Machine Learning · Computer Science 2025-10-30 Kuan Zhang , Chengliang Chai , Jingzhe Xu , Chi Zhang , Han Han , Ye Yuan , Guoren Wang , Lei Cao

It is widely known in the machine learning community that class noise can be (and often is) detrimental to inducing a model of the data. Many current approaches use a single, often biased, measurement to determine if an instance is noisy. A…

Machine Learning · Statistics 2014-03-11 Michael R. Smith , Tony Martinez

Ensemble learning combines several individual models to obtain better generalization performance. Currently, deep learning architectures are showing better performance compared to the shallow or traditional models. Deep ensemble learning…

Machine Learning · Computer Science 2022-08-09 M. A. Ganaie , Minghui Hu , A. K. Malik , M. Tanveer , P. N. Suganthan

Class imbalance is a substantial challenge in classifying many real-world cases. Synthetic over-sampling methods have been effective to improve the performance of classifiers for imbalance problems. However, most synthetic over-sampling…

Machine Learning · Computer Science 2021-08-11 Hadi A. Khorshidi , Uwe Aickelin