English
Related papers

Related papers: Not all Failure Modes are Created Equal: Training …

200 papers

The intrinsic difficulty in adapting deep learning models to non-stationary environments limits the applicability of neural networks to real-world tasks. This issue is critical in practical supervised learning settings, such as the ones in…

Machine Learning · Computer Science 2023-06-09 Simone Marullo , Matteo Tiezzi , Marco Gori , Stefano Melacci , Tinne Tuytelaars

The problem of detecting whether a test sample is from in-distribution (i.e., training distribution by a classifier) or out-of-distribution sufficiently different from it arises in many real-world machine learning applications. However, the…

Machine Learning · Statistics 2018-02-27 Kimin Lee , Honglak Lee , Kibok Lee , Jinwoo Shin

In image classification tasks, deep learning models are vulnerable to image distortion. For successful deployment, it is important to identify distortion levels under which the model is usable i.e. its accuracy stays above a stipulated…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Dang Nguyen , Sunil Gupta

We introduce collaborative learning in which multiple classifier heads of the same network are simultaneously trained on the same training data to improve generalization and robustness to label noise with no extra inference cost. It…

Machine Learning · Statistics 2018-11-08 Guocong Song , Wei Chai

Deep learning is also known as hierarchical learning, where the learner _learns_ to represent a complicated target function by decomposing it into a sequence of simpler functions to reduce sample and time complexity. This paper formally…

Machine Learning · Computer Science 2023-07-10 Zeyuan Allen-Zhu , Yuanzhi Li

The causal explanation of image misclassifications is an understudied niche, which can potentially provide valuable insights in model interpretability and increase prediction accuracy. This study trains CIFAR-10 on six modern CNN…

Machine Learning · Computer Science 2020-06-30 Yan Min , Miles Bennett

Following the great success of various deep learning methods in image and object classification, the biomedical image processing society is also overwhelmed with their applications to various automatic diagnosis cases. Unfortunately, most…

The susceptibility of deep neural networks (DNNs) to adversarial attacks undermines their reliability across numerous applications, underscoring the necessity for an in-depth exploration of these vulnerabilities and the formulation of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 S. M. Fazle Rabby Labib , Joyanta Jyoti Mondal , Meem Arafat Manab , Xi Xiao , Sarfaraz Newaz

Although deep neural networks (DNNs) achieve high predictive accuracy, their confidence estimates are often unreliable, potentially compromising user trust in their decisions. This has motivated research on calibrated models, where…

Machine Learning · Computer Science 2026-05-25 Ramya Hebbalaguppe , Ajay Shastry , Soumya Suvra Ghosal , Chetan Arora

Language-conditioned robotic manipulation in open-world settings requires not only accurate task execution but also the ability to detect failures for robust deployment in real-world environments. Although recent advances in vision-language…

Robotics · Computer Science 2026-02-20 Clemence Grislain , Hamed Rahimi , Olivier Sigaud , Mohamed Chetouani

Most techniques for explainable machine learning focus on feature attribution, i.e., values are assigned to the features such that their sum equals the prediction. Example attribution is another form of explanation that assigns weights to…

Machine Learning · Computer Science 2025-02-28 Genghua Dong , Henrik Boström , Michalis Vazirgiannis , Roman Bresson

The forward-forward algorithm presents a new method of training neural networks by updating weights during an inference, performing parameter updates for each layer individually. This immediately reduces memory requirements during training…

Machine Learning · Computer Science 2023-06-28 Michael Hopwood

Human beings are able to master a variety of knowledge and skills with ongoing learning. By contrast, dramatic performance degradation is observed when new tasks are added to an existing neural network model. This phenomenon, termed as…

Machine Learning · Computer Science 2019-10-25 Xin Yao , Tianchi Huang , Chenglei Wu , Rui-Xiao Zhang , Lifeng Sun

Humans can robustly learn novel visual concepts even when images undergo various deformations and lose certain information. Mimicking the same behavior and synthesizing deformed instances of new concepts may help visual recognition systems…

Computer Vision and Pattern Recognition · Computer Science 2019-07-19 Zitian Chen , Yanwei Fu , Yu-Xiong Wang , Lin Ma , Wei Liu , Martial Hebert

Deep neural networks (DNNs) have been widely applied in various domains in artificial intelligence including computer vision and natural language processing. A DNN is typically trained for many epochs and then a validation dataset is used…

Machine Learning · Computer Science 2022-03-17 Xiang Deng , Yun Xiao , Bo Long , Zhongfei Zhang

Determining whether AI systems process information similarly to humans is central to cognitive science and trustworthy AI. While modern AI models can match human accuracy on standard tasks, such parity does not guarantee that their…

Artificial Intelligence · Computer Science 2026-04-14 Binxia Xu , Xiaoliang Luo , Luke Dickens , Robert M. Mok

We present an algorithm for computing class-specific universal adversarial perturbations for deep neural networks. Such perturbations can induce misclassification in a large fraction of images of a specific class. Unlike previous methods…

Machine Learning · Computer Science 2019-12-03 Tejus Gupta , Abhishek Sinha , Nupur Kumari , Mayank Singh , Balaji Krishnamurthy

We propose a novel perspective to understand deep neural networks in an interpretable disentanglement form. For each semantic class, we extract a class-specific functional subnetwork from the original full model, with compressed structure…

Machine Learning · Computer Science 2019-10-08 Yulong Wang , Xiaolin Hu , Hang Su

Classifying images with an interpretable decision-making process is a long-standing problem in computer vision. In recent years, Prototypical Part Networks has gained traction as an approach for self-explainable neural networks, due to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Zhijie Zhu , Lei Fan , Maurice Pagnucco , Yang Song

Over the past decade, deep neural networks have proven to be adept in image classification tasks, often surpassing humans in terms of accuracy. However, standard neural networks often fail to understand the concept of hierarchical…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Amitangshu Mukherjee , Isha Garg , Kaushik Roy