English
Related papers

Related papers: Robust Active Learning: Sample-Efficient Training …

200 papers

The Deep Learning revolution has enabled groundbreaking achievements in recent years. From breast cancer detection to protein folding, deep learning algorithms have been at the core of very important advancements. However, these modern…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Bonaventure F. P. Dossou

Deep Learning has revolutionized machine learning and artificial intelligence, achieving superhuman performance in several standard benchmarks. It is well-known that deep learning models are inefficient to train; they learn by processing…

Machine Learning · Computer Science 2021-12-03 Fartash Faghri

Active learning is a promising paradigm to reduce the labeling cost by strategically requesting labels to improve model performance. However, existing active learning methods often rely on expensive acquisition function to compute,…

Machine Learning · Computer Science 2023-10-27 Zixin Ding , Si Chen , Ruoxi Jia , Yuxin Chen

Anomalies are intuitively easy for human experts to understand, but they are hard to define mathematically. Therefore, in order to have performance guarantees in unsupervised anomaly detection, priors need to be assumed on what the…

Machine Learning · Statistics 2020-04-08 Tiago Pimentel , Marianne Monteiro , Adriano Veloso , Nivio Ziviani

Active learning is a machine learning method aiming at optimal design for model training. At variance with supervised learning, which labels all samples, active learning provides an improved model by labeling samples with maximal…

We propose a new active learning strategy designed for deep neural networks. The goal is to minimize the number of data annotation queried from an oracle during training. Previous active learning strategies scalable for deep networks were…

Machine Learning · Computer Science 2018-02-28 Melanie Ducoffe , Frederic Precioso

The real-world facial expression recognition (FER) datasets suffer from noisy annotations due to crowd-sourcing, ambiguity in expressions, the subjectivity of annotators and inter-class similarity. However, the recent deep networks have…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Darshan Gera , Naveen Siva Kumar Badveeti , Bobbili Veerendra Raj Kumar , S Balasubramanian

Despite significant advancements in active learning and adversarial attacks, the intersection of these two fields remains underexplored, particularly in developing robust active learning frameworks against dynamic adversarial threats. The…

Machine Learning · Computer Science 2024-08-16 Ricky Maulana Fajri , Yulong Pei , Lu Yin , Mykola Pechenizkiy

This tutorial aims to introduce the fundamentals of adversarial robustness of deep learning, presenting a well-structured review of up-to-date techniques to assess the vulnerability of various types of deep learning models to adversarial…

Machine Learning · Computer Science 2021-08-25 Wenjie Ruan , Xinping Yi , Xiaowei Huang

Active learning (AL) aims to enable training high performance classifiers with low annotation cost by predicting which subset of unlabelled instances would be most beneficial to label. The importance of AL has motivated extensive research,…

Machine Learning · Computer Science 2018-06-14 Kunkun Pang , Mingzhi Dong , Yang Wu , Timothy Hospedales

Neural operators have emerged as fast surrogate models for physics simulations, yet they remain acutely vulnerable to adversarial perturbations, a critical liability for safety-critical digital twin deployments. We present a synergistic…

Machine Learning · Computer Science 2026-04-16 Samrendra Roy , Souvik Chakraborty , Syed Bahauddin Alam

The exploding research interest for neural networks in modeling nonlinear dynamical systems is largely explained by the networks' capacity to model complex input-output relations directly from data. However, they typically need vast…

Artificial Intelligence · Computer Science 2023-02-27 Erlend Torje Berg Lundby , Adil Rasheed , Ivar Johan Halvorsen , Dirk Reinhardt , Sebastien Gros , Jan Tommy Gravdahl

We propose a novel active learning strategy for regression, which is model-agnostic, robust against model mismatch, and interpretable. Assuming that a small number of initial samples are available, we derive the optimal training density…

Machine Learning · Computer Science 2021-07-27 Danny Panknin , Klaus Robert Müller , Shinichi Nakajima

Active feature acquisition (AFA) agents, crucial in domains like healthcare where acquiring features is often costly or harmful, determine the optimal set of features for a subsequent classification task. As deploying an AFA agent…

Machine Learning · Statistics 2023-12-08 Henrik von Kleist , Alireza Zamanian , Ilya Shpitser , Narges Ahmidi

Deep neural networks have achieved substantial achievements in several computer vision areas, but have vulnerabilities that are often fooled by adversarial examples that are not recognized by humans. This is an important issue for security…

Computer Vision and Pattern Recognition · Computer Science 2021-01-29 Hakmin Lee , Hong Joo Lee , Seong Tae Kim , Yong Man Ro

Deep Active Learning (DAL) aims to reduce labeling costs in neural-network training by prioritizing the most informative unlabeled samples for annotation. Beyond selecting which samples to label, several DAL approaches further enhance data…

Machine Learning · Computer Science 2025-12-17 Jonathan Spiegelman , Guy Amir , Guy Katz

Convolutional neural networks (CNNs) have been successfully applied to many recognition and learning tasks using a universal recipe; training a deep model on a very large dataset of supervised examples. However, this approach is rather…

Machine Learning · Statistics 2018-06-04 Ozan Sener , Silvio Savarese

Active learning has been utilized as an efficient tool in building anomaly detection models by leveraging expert feedback. In an active learning framework, a model queries samples to be labeled by experts and re-trains the model with the…

Machine Learning · Computer Science 2023-09-19 Minkyung Kim , Junsik Kim , Jongmin Yu , Jun Kyun Choi

Adversarial attacks have received increasing attention and it has been widely recognized that classical DNNs have weak adversarial robustness. The most commonly used adversarial defense method, adversarial training, improves the adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Nuolin Sun , Linyuan Wang , Dongyang Li , Bin Yan , Lei Li

Deep neural networks have great representation power, but typically require large numbers of training examples. This motivates deep active learning methods that can significantly reduce the amount of labeled training data. Empirical…

Machine Learning · Computer Science 2026-01-01 Yinglun Zhu , Robert Nowak