English
Related papers

Related papers: Diversity of Ensembles for Data Stream Classificat…

200 papers

The problem of data non-stationarity is commonly addressed in data stream processing. In a dynamic environment, methods should continuously be ready to analyze time-varying data -- hence, they should enable incremental training and respond…

Machine Learning · Computer Science 2026-05-29 Joanna Komorniczak

Continual learning from data streams is among the most important topics in contemporary machine learning. One of the biggest challenges in this domain lies in creating algorithms that can continuously adapt to arriving data. However,…

Machine Learning · Computer Science 2021-04-22 Łukasz Korycki , Bartosz Krawczyk

The Ensemble of Classifiers (EoC) has been shown to be effective in improving the performance of single classifiers by combining their outputs, and one of the most important properties involved in the selection of the best EoC from a pool…

Machine Learning · Computer Science 2014-08-14 Albert H. R. Ko , Robert Sabourin , Alceu S. Britto , Luiz E. S. Oliveira

Deep learning classifiers are assisting humans in making decisions and hence the user's trust in these models is of paramount importance. Trust is often a function of constant behavior. From an AI model perspective it means given the same…

Ensembles of neural networks achieve superior performance compared to stand-alone networks in terms of accuracy, uncertainty calibration and robustness to dataset shift. \emph{Deep ensembles}, a state-of-the-art method for uncertainty…

Machine Learning · Computer Science 2022-02-23 Sheheryar Zaidi , Arber Zela , Thomas Elsken , Chris Holmes , Frank Hutter , Yee Whye Teh

Ensemble discriminative tracking utilizes a committee of classifiers, to label data samples, which are in turn, used for retraining the tracker to localize the target using the collective knowledge of the committee. Committee members could…

Computer Vision and Pattern Recognition · Computer Science 2018-06-08 Kourosh Meshgi , Shigeyuki Oba , Shin Ishii

Most classification methods are based on the assumption that data conforms to a stationary distribution. The machine learning domain currently suffers from a lack of classification techniques that are able to detect the occurrence of a…

Machine Learning · Statistics 2012-01-05 Alzennyr Da Silva , Yves Lechevallier , Fabrice Rossi , Francisco De A. T. De Carvahlo

In the pursuit of autonomous learning systems, the foundational assumption of stationarity, the premise that data distributions and model behaviors remain constant, is fundamentally untenable. Historically, the research community has…

Machine Learning · Computer Science 2026-05-05 Xiaoyu Yang , En Yu , Jie Lu

Classic results establish that encouraging predictive diversity improves performance in ensembles of low-capacity models, e.g. through bagging or boosting. Here we demonstrate that these intuitions do not apply to high-capacity neural…

Machine Learning · Computer Science 2024-01-11 Taiga Abe , E. Kelly Buchanan , Geoff Pleiss , John P. Cunningham

Data-driven learning algorithms are employed in many online applications, in which data become available over time, like network monitoring, stock price prediction, job applications, etc. The underlying data distribution might evolve over…

Machine Learning · Computer Science 2021-08-16 Vasileios Iosifidis , Wenbin Zhang , Eirini Ntoutsi

Streaming data are increasingly present in real-world applications such as sensor measurements, satellite data feed, stock market, and financial data. The main characteristics of these applications are the online arrival of data…

Machine Learning · Computer Science 2020-07-01 Vinicius M. A. Souza , Denis M. dos Reis , Andre G. Maletzke , Gustavo E. A. P. A. Batista

Machine learning (ML) datasets, often perceived as neutral, inherently encapsulate abstract and disputed social constructs. Dataset curators frequently employ value-laden terms such as diversity, bias, and quality to characterize datasets.…

Machine Learning · Computer Science 2024-07-12 Dora Zhao , Jerone T. A. Andrews , Orestis Papakyriakopoulos , Alice Xiang

Practical tools for clustering streaming data must be fast enough to handle the arrival rate of the observations. Typically, they also must adapt on the fly to possible lack of stationarity; i.e., the data statistics may be time-dependent…

Machine Learning · Computer Science 2022-03-01 Or Dinari , Oren Freifeld

Modern data analytics take advantage of ensemble learning and transfer learning approaches to tackle some of the most relevant issues in data analysis, such as lack of labeled data to use to train the analysis models, sparsity of the…

This work is aimed at the experimental studying the influence of local data characteristics and drifts on the difficulties of learning various online classifiers from multi-class imbalanced data streams. Firstly we present a categorization…

Machine Learning · Computer Science 2022-10-18 Agnieszka Lipska , Jerzy Stefanowski

Classifier ensemble generally should combine diverse component classifiers. However, it is difficult to give a definitive connection between diversity measure and ensemble accuracy. Given a list of available component classifiers, how to…

Machine Learning · Computer Science 2014-06-06 Xu-Cheng Yin , Chun Yang , Hong-Wei Hao

Machine learning methods have achieved good performance and been widely applied in various real-world applications. They can learn the model adaptively and be better fit for special requirements of different tasks. Generally, a good machine…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Zhiqiang Gong , Ping Zhong , Weidong Hu

Ensemble learning is widely applied in Machine Learning (ML) to improve model performance and to mitigate decision risks. In this approach, predictions from a diverse set of learners are combined to obtain a joint decision. Recently,…

Machine Learning · Computer Science 2020-07-14 Yingshui Tan , Baihong Jin , Xiangyu Yue , Yuxin Chen , Alberto Sangiovanni Vincentelli

The ability to detect Out-of-Distribution (OOD) data is important in safety-critical applications of deep learning. The aim is to separate In-Distribution (ID) data drawn from the training distribution from OOD data using a measure of…

Machine Learning · Computer Science 2022-09-21 Guoxuan Xia , Christos-Savvas Bouganis

Although deep learning models have achieved state-of-the-art performance on a number of vision tasks, generalization over high dimensional multi-modal data, and reliable predictive uncertainty estimation are still active areas of research.…

Machine Learning · Computer Science 2020-12-10 Samarth Sinha , Homanga Bharadhwaj , Anirudh Goyal , Hugo Larochelle , Animesh Garg , Florian Shkurti