English
Related papers

Related papers: DICE: Diversity in Deep Ensembles via Conditional …

200 papers

We uncover a surprising phenomenon in deep reinforcement learning: training a diverse ensemble of data-sharing agents -- a well-established exploration strategy -- can significantly impair the performance of the individual ensemble members…

Machine Learning · Computer Science 2024-05-08 Zhixuan Lin , Pierluca D'Oro , Evgenii Nikishin , Aaron Courville

The fact that deep neural networks are susceptible to crafted perturbations severely impacts the use of deep learning in certain domains of application. Among many developed defense models against such attacks, adversarial training emerges…

Machine Learning · Computer Science 2020-07-13 Anh Bui , Trung Le , He Zhao , Paul Montague , Olivier deVel , Tamas Abraham , Dinh Phung

Deep learning models have shown incredible performance on numerous image recognition, classification, and reconstruction tasks. Although very appealing and valuable due to their predictive capabilities, one common threat remains challenging…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Alex Bogun , Dimche Kostadinov , Damian Borth

We present deep significance clustering (DICE), a framework for jointly performing representation learning and clustering for "outcome-aware" stratification. DICE is intended to generate cluster membership that may be used to categorize a…

Machine Learning · Computer Science 2021-01-08 Yufang Huang , Kelly M. Axsom , John Lee , Lakshminarayanan Subramanian , Yiye Zhang

We introduce the Discrete Inverse Continuity Equation (DICE) method, a generative modeling approach that learns the evolution of a stochastic process from given sample populations at a finite number of time points. Models learned with DICE…

Machine Learning · Computer Science 2025-07-08 Tobias Blickhan , Jules Berman , Andrew Stuart , Benjamin Peherstorfer

Ensemble learning has proven effective in improving predictive performance and estimating uncertainty in neural networks. However, conventional ensemble methods often suffer from redundant parameter usage and computational inefficiencies…

Machine Learning · Computer Science 2024-12-23 Arnav Kharbanda , Advait Chandorkar

Ensemble discriminative tracking utilizes a committee of classifiers, to label data samples, which are in turn, used for retraining the tracker to localize the target using the collective knowledge of the committee. Committee members could…

Computer Vision and Pattern Recognition · Computer Science 2018-06-08 Kourosh Meshgi , Shigeyuki Oba , Shin Ishii

Deep learning has become the state of the art approach in many machine learning problems such as classification. It has recently been shown that deep learning is highly vulnerable to adversarial perturbations. Taking the camera systems of…

Machine Learning · Statistics 2018-02-09 Thilo Strauss , Markus Hanselmann , Andrej Junginger , Holger Ulmer

Modern deep neural networks can produce badly calibrated predictions, especially when train and test distributions are mismatched. Training an ensemble of models and averaging their predictions can help alleviate these issues. We propose a…

Machine Learning · Computer Science 2020-07-09 Asa Cooper Stickland , Iain Murray

Ensembles of machine learning models have been well established as a powerful method of improving performance over a single model. Traditionally, ensembling algorithms train their base learners independently or sequentially with the goal of…

Machine Learning · Computer Science 2023-11-01 Alan Jeffares , Tennison Liu , Jonathan Crabbé , Mihaela van der Schaar

Dynamic classifier selection systems aim to select a group of classifiers that is most adequate for a specific query pattern. This is done by defining a region around the query pattern and analyzing the competence of the classifiers in this…

Machine Learning · Computer Science 2018-11-05 Rafael M. O. Cruz , George D. C. Cavalcanti , Tsang Ing Ren

The strategy of ensemble has become popular in adversarial defense, which trains multiple base classifiers to defend against adversarial attacks in a cooperative manner. Despite the empirical success, theoretical explanations on why an…

Machine Learning · Computer Science 2023-11-03 Yian Deng , Tingting Mu

We propose DIVERSE, a framework for systematically exploring the Rashomon set of deep neural networks, the collection of models that match a reference model's accuracy while differing in their predictive behavior. DIVERSE augments a…

Machine Learning · Computer Science 2026-01-29 Gilles Eerlings , Brent Zoomers , Jori Liesenborgs , Gustavo Rovelo Ruiz , Kris Luyten

Deep neural networks (DNNs) have achieved state-of-the-art results in various pattern recognition tasks. However, they perform poorly on out-of-distribution adversarial examples i.e. inputs that are specifically crafted by an adversary to…

Cryptography and Security · Computer Science 2019-05-09 Chirag Agarwal , Anh Nguyen , Dan Schonfeld

Adaptive inference is a promising technique to improve the computational efficiency of deep models at test time. In contrast to static models which use the same computation graph for all instances, adaptive networks can dynamically adjust…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Hao Li , Hong Zhang , Xiaojuan Qi , Ruigang Yang , Gao Huang

Although deep neural networks have made remarkable achievements in the field of automatic modulation recognition (AMR), these models often require a large amount of labeled data for training. However, in many practical scenarios, the…

Machine Learning · Computer Science 2025-07-17 Yao Lu , Hongyu Gao , Zhuangzhi Chen , Dongwei Xu , Yun Lin , Qi Xuan , Guan Gui

This paper proposes an ensemble learning model that is resistant to adversarial attacks. To build resilience, we introduced a training process where each member learns a radically distinct latent space. Member models are added one at a time…

Image and Video Processing · Electrical Eng. & Systems 2021-01-08 Ali Mirzaeian , Jana Kosecka , Houman Homayoun , Tinoosh Mohsenin , Avesta Sasan

Medical image segmentation is an actively studied task in medical imaging, where the precision of the annotations is of utter importance towards accurate diagnosis and treatment. In recent years, the task has been approached with various…

Image and Video Processing · Electrical Eng. & Systems 2022-12-22 Mariana-Iuliana Georgescu , Radu Tudor Ionescu , Andreea-Iuliana Miron

Deep networks have been revolutionary in improving performance of machine learning and artificial intelligence systems. Their high prediction accuracy, however, comes at a price of \emph{model irreproducibility\/} in very high levels that…

Machine Learning · Computer Science 2020-10-21 Gil I. Shamir , Lorenzo Coviello

The ability to detect Out-of-Distribution (OOD) data is important in safety-critical applications of deep learning. The aim is to separate In-Distribution (ID) data drawn from the training distribution from OOD data using a measure of…

Machine Learning · Computer Science 2022-09-21 Guoxuan Xia , Christos-Savvas Bouganis