English
Related papers

Related papers: From Hope to Safety: Unlearning Biases of Deep Mod…

200 papers

Deep models trained on large amounts of data often incorporate implicit biases present during training time. If later such a bias is discovered during inference or deployment, it is often necessary to acquire new data and retrain the model.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Niklas Penzel , Gideon Stein , Joachim Denzler

Deep Neural Networks are prone to learning and relying on spurious correlations in the training data, which, for high-risk applications, can have fatal consequences. Various approaches to suppress model reliance on harmful features have…

Machine Learning · Computer Science 2024-04-16 Dilyara Bareeva , Maximilian Dreyer , Frederik Pahde , Wojciech Samek , Sebastian Lapuschkin

Deep neural networks often develop spurious bias, reliance on correlations between non-essential features and classes for predictions. For example, a model may identify objects based on frequently co-occurring backgrounds rather than…

Machine Learning · Computer Science 2025-06-02 Guangtao Zheng , Wenqian Ye , Aidong Zhang

Deep neural networks often rely on spurious correlations in training data, leading to biased or unfair predictions in safety-critical domains such as medicine and autonomous driving. While conventional bias mitigation typically requires…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Sai Siddhartha Chary Aylapuram , Veeraraju Elluru , Shivang Agarwal

Deep neural networks trained on biased data often inadvertently learn unintended inference rules, particularly when labels are strongly correlated with biased features. Existing bias mitigation methods typically involve either a)…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Rajeev Ranjan Dwivedi , Priyadarshini Kumari , Vinod K Kurmi

The performance of deep neural networks is strongly influenced by the training dataset setup. In particular, when attributes having a strong correlation with the target attribute are present, the trained model can provide unintended…

Machine Learning · Computer Science 2023-02-14 Sumyeong Ahn , Seongyoon Kim , Se-young Yun

In neural networks with binary activations and or binary weights the training by gradient descent is complicated as the model has piecewise constant response. We consider stochastic binary networks, obtained by adding noises in front of…

Machine Learning · Statistics 2020-11-05 Alexander Shekhovtsov , Viktor Yanush , Boris Flach

How to train deep neural networks (DNNs) to generalize well is a central concern in deep learning, especially for severely overparameterized networks nowadays. In this paper, we propose an effective method to improve the model…

Machine Learning · Computer Science 2022-06-28 Yang Zhao , Hao Zhang , Xiuyuan Hu

Interpreting the inner workings of deep learning models is crucial for establishing trust and ensuring model safety. Concept-based explanations have emerged as a superior approach that is more interpretable than feature attribution…

Machine Learning · Computer Science 2023-07-17 Mara Graziani , Laura O' Mahony , An-Phi Nguyen , Henning Müller , Vincent Andrearczyk

Deep Neural Networks are well known for efficiently fitting training data, yet experiencing poor generalization capabilities whenever some kind of bias dominates over the actual task labels, resulting in models learning "shortcuts". In…

Machine Learning · Computer Science 2024-08-12 Pietro Morerio , Ruggero Ragonesi , Vittorio Murino

Convolutional neural networks (CNNs) are commonly used for image classification. Saliency methods are examples of approaches that can be used to interpret CNNs post hoc, identifying the most relevant pixels for a prediction following the…

Machine Learning · Computer Science 2020-10-01 Nicholas Halliwell , Freddy Lecue

The intrinsic difficulty in adapting deep learning models to non-stationary environments limits the applicability of neural networks to real-world tasks. This issue is critical in practical supervised learning settings, such as the ones in…

Machine Learning · Computer Science 2023-06-09 Simone Marullo , Matteo Tiezzi , Marco Gori , Stefano Melacci , Tinne Tuytelaars

Despite their renowned predictive power on i.i.d. data, convolutional neural networks are known to rely more on high-frequency patterns that humans deem superficial than on low-frequency patterns that agree better with intuitions about what…

Computer Vision and Pattern Recognition · Computer Science 2019-11-06 Haohan Wang , Songwei Ge , Eric P. Xing , Zachary C. Lipton

Despite the power of deep neural networks for a wide range of tasks, an overconfident prediction issue has limited their practical use in many safety-critical applications. Many recent works have been proposed to mitigate this issue, but…

Machine Learning · Computer Science 2020-08-14 Jooyoung Moon , Jihyo Kim , Younghak Shin , Sangheum Hwang

We present a theoretically grounded approach to train deep neural networks, including recurrent networks, subject to class-dependent label noise. We propose two procedures for loss correction that are agnostic to both application domain and…

Machine Learning · Statistics 2017-03-23 Giorgio Patrini , Alessandro Rozza , Aditya Menon , Richard Nock , Lizhen Qu

Deep neural networks are increasingly employed in high-stakes medical applications, despite their tendency for shortcut learning in the presence of spurious correlations, which can have potentially fatal consequences in practice. Whereas a…

Artificial Intelligence · Computer Science 2025-07-30 Frederik Pahde , Thomas Wiegand , Sebastian Lapuschkin , Wojciech Samek

Despite significant research efforts, deep neural networks are still vulnerable to biases: this raises concerns about their fairness and limits their generalization. In this paper, we propose a bias-agnostic approach to mitigate the impact…

Machine Learning · Computer Science 2023-05-08 Rémi Nahon , Van-Tam Nguyen , Enzo Tartaglione

Deep learning models are prone to learning shortcut solutions to problems using spuriously correlated yet irrelevant features of their training data. In high-risk applications such as medical image analysis, this phenomenon may prevent…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Christopher Boland , Sotirios Tsaftaris , Sonia Dahdouh

Neural networks are among the most accurate supervised learning methods in use today, but their opacity makes them difficult to trust in critical applications, especially when conditions in training differ from those in test. Recent work on…

Machine Learning · Computer Science 2017-11-15 Andrew Slavin Ross , Michael C. Hughes , Finale Doshi-Velez

Many applications of deep learning for image generation use perceptual losses for either training or fine-tuning of the generator networks. The use of perceptual loss however incurs repeated forward-backward passes in a large image…

Machine Learning · Computer Science 2021-05-06 Dmitry Nikulin , Roman Suvorov , Aleksei Ivakhnenko , Victor Lempitsky
‹ Prev 1 2 3 10 Next ›