English
Related papers

Related papers: Saliency Guided Adversarial Training for Learning …

200 papers

Medical imaging AI systems such as disease classification and segmentation are increasingly inspired and transformed from computer vision based AI systems. Although an array of adversarial training and/or loss function based defense…

Machine Learning · Computer Science 2020-06-25 Xin Li , Deng Pan , Dongxiao Zhu

Deep Learning models perform unreliably when the data comes from a distribution different from the training one. In critical applications such as medical imaging, out-of-distribution (OOD) detection methods help to identify such data…

Image and Video Processing · Electrical Eng. & Systems 2023-06-26 Anton Vasiliuk , Daria Frolova , Mikhail Belyaev , Boris Shirokikh

Generalization to out-of-distribution (OOD) data is one of the central problems in modern machine learning. Recently, there is a surge of attempts to propose algorithms that mainly build upon the idea of extracting invariant features.…

Machine Learning · Computer Science 2021-11-09 Haotian Ye , Chuanlong Xie , Tianle Cai , Ruichen Li , Zhenguo Li , Liwei Wang

Unmasking the decision-making process of machine learning models is essential for implementing diagnostic support systems in clinical practice. Here, we demonstrate that adversarially trained models can significantly enhance the usability…

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

Neural networks trained with SGD were recently shown to rely preferentially on linearly-predictive features and can ignore complex, equally-predictive ones. This simplicity bias can explain their lack of robustness out of distribution…

Machine Learning · Computer Science 2022-09-13 Damien Teney , Ehsan Abbasnejad , Simon Lucey , Anton van den Hengel

In visual-based Reinforcement Learning (RL), agents often struggle to generalize well to environmental variations in the state space that were not observed during training. The variations can arise in both task-irrelevant features, such as…

Artificial Intelligence · Computer Science 2023-12-25 Sili Huang , Yanchao Sun , Jifeng Hu , Siyuan Guo , Hechang Chen , Yi Chang , Lichao Sun , Bo Yang

Current AIGC detectors often achieve near-perfect accuracy on images produced by the same generator used for training but struggle to generalize to outputs from unseen generators. We trace this failure in part to latent prior bias:…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yue Zhou , Xinan He , KaiQing Lin , Bin Fan , Feng Ding , Bin Li

Deep learning (DL) techniques have been extensively utilized for medical image classification. Most DL-based classification networks are generally structured hierarchically and optimized through the minimization of a single loss function…

Image and Video Processing · Electrical Eng. & Systems 2022-07-08 Zong Fan , Xiaohui Zhang , Jacob A. Gasienica , Jennifer Potts , Su Ruan , Wade Thorstad , Hiram Gay , Pengfei Song , Xiaowei Wang , Hua Li

We expect the generalization error to improve with more samples from a similar task, and to deteriorate with more samples from an out-of-distribution (OOD) task. In this work, we show a counter-intuitive phenomenon: the generalization error…

Machine Learning · Computer Science 2023-07-20 Ashwin De Silva , Rahul Ramesh , Carey E. Priebe , Pratik Chaudhari , Joshua T. Vogelstein

A common explanation for the failure of out-of-distribution (OOD) generalization is that the model trained with empirical risk minimization (ERM) learns spurious features instead of invariant features. However, several recent studies…

Machine Learning · Computer Science 2023-10-31 Yongqiang Chen , Wei Huang , Kaiwen Zhou , Yatao Bian , Bo Han , James Cheng

Deep Neural Networks (DNNs) are expected to provide explanation for users to understand their black-box predictions. Saliency map is a common form of explanation illustrating the heatmap of feature attributions, but it suffers from noise in…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Rui Xu , Wenkang Qin , Peixiang Huang , Hao Wang , Lin Luo

Image cartoonization is recently dominated by generative adversarial networks (GANs) from the perspective of unsupervised image-to-image translation, in which an inherent challenge is to precisely capture and sufficiently transfer…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Xiang Gao , Yuqi Zhang , Yingjie Tian

We consider the problem of OOD generalization, where the goal is to train a model that performs well on test distributions that are different from the training distribution. Deep learning models are known to be fragile to such shifts and…

Machine Learning · Computer Science 2022-08-22 Anshul Nasery , Sravanti Addepalli , Praneeth Netrapalli , Prateek Jain

Adversarial Training (AT) with Projected Gradient Descent (PGD) is an effective approach for improving the robustness of the deep neural networks. However, PGD AT has been shown to suffer from two main limitations: i) high computational…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Ahmadreza Jeddi , Mohammad Javad Shafiee , Alexander Wong

Image-to-image translation is an ill-posed problem as unique one-to-one mapping may not exist between the source and target images. Learning-based methods proposed in this context often evaluate the performance on test data that is similar…

Image and Video Processing · Electrical Eng. & Systems 2021-10-08 Uddeshya Upadhyay , Viswanath P. Sudarshan , Suyash P. Awate

In this work, we theoretically investigate the generalization properties of neural networks (NN) trained by stochastic gradient descent (SGD) algorithm with large learning rates. Under such a training regime, our finding is that, the…

Machine Learning · Computer Science 2023-10-27 Miao Lu , Beining Wu , Xiaodong Yang , Difan Zou

We propose a method for semi-supervised training of structured-output neural networks. Inspired by the framework of Generative Adversarial Networks (GAN), we train a discriminator network to capture the notion of a quality of network…

Computer Vision and Pattern Recognition · Computer Science 2017-02-09 Mateusz Koziński , Loïc Simon , Frédéric Jurie

Out-of-Distribution (OOD) detection is a crucial problem for the safe deployment of machine learning models identifying samples that fall outside of the training distribution, i.e. in-distribution data (ID). Most OOD works focus on the…

Machine Learning · Computer Science 2023-10-04 Soroush Seifi , Daniel Olmeda Reino , Nikolay Chumerin , Rahaf Aljundi

With too few samples or too many model parameters, overfitting can inhibit the ability to generalise predictions to new data. Within medical imaging, this can occur when features are incorrectly assigned importance such as distinct hospital…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Becks Simpson , Francis Dutil , Yoshua Bengio , Joseph Paul Cohen