English
Related papers

Related papers: A Fourier Perspective on Model Robustness in Compu…

200 papers

Data augmentation has been actively studied for robust neural networks. Most of the recent data augmentation methods focus on augmenting datasets during the training phase. At the testing phase, simple transformations are still widely used…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Ildoo Kim , Younghoon Kim , Sungwoong Kim

The field of learning-augmented algorithms has gained significant attention in recent years. These algorithms, using potentially inaccurate predictions, must exhibit three key properties: consistency, robustness, and smoothness. In…

Data Structures and Algorithms · Computer Science 2025-01-23 Ziyad Benomar , Vianney Perchet

Deep neural networks (DNNs) excel on clean images but struggle with corrupted ones. Incorporating specific corruptions into the data augmentation pipeline can improve robustness to those corruptions but may harm performance on clean images…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Trung Trinh , Markus Heinonen , Luigi Acerbi , Samuel Kaski

With the increasing use of deep learning on data collected by non-perfect sensors and in non-perfect environments, the robustness of deep learning systems has become an important issue. A common approach for obtaining robustness to noise…

Machine Learning · Computer Science 2023-11-21 Xueqiong Yuan , Jipeng Li , Ercan Engin Kuruoğlu

Adversarial training suffers from the issue of robust overfitting, which seriously impairs its generalization performance. Data augmentation, which is effective at preventing overfitting in standard training, has been observed by many…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Lin Li , Michael Spratling

Today's state-of-the-art machine vision models are vulnerable to image corruptions like blurring or compression artefacts, limiting their performance in many real-world applications. We here argue that popular benchmarks to measure model…

Machine Learning · Computer Science 2020-10-26 Steffen Schneider , Evgenia Rusak , Luisa Eck , Oliver Bringmann , Wieland Brendel , Matthias Bethge

Despite breakthrough performance, modern learning models are known to be highly vulnerable to small adversarial perturbations in their inputs. While a wide variety of recent \emph{adversarial training} methods have been effective at…

Machine Learning · Computer Science 2020-02-26 Adel Javanmard , Mahdi Soltanolkotabi , Hamed Hassani

Model robustness is vital for the reliable deployment of machine learning models in real-world applications. Recent studies have shown that data augmentation can result in model over-relying on features in the low-frequency domain,…

Machine Learning · Computer Science 2022-05-11 Alvin Chan , Yew-Soon Ong , Clement Tan

Generative data augmentation, which scales datasets by obtaining fake labeled examples from a trained conditional generative model, boosts classification performance in various learning tasks including (semi-)supervised learning, few-shot…

Machine Learning · Computer Science 2023-05-30 Chenyu Zheng , Guoqiang Wu , Chongxuan Li

We study the problem of improving the performance of online algorithms by incorporating machine-learned predictions. The goal is to design algorithms that are both consistent and robust, meaning that the algorithm performs well when…

Machine Learning · Computer Science 2020-10-23 Alexander Wei , Fred Zhang

In contrastive representation learning, data representation is trained so that it can classify the image instances even when the images are altered by augmentations. However, depending on the datasets, some augmentations can damage the…

Machine Learning · Statistics 2021-11-16 Masanori Koyama , Kentaro Minami , Takeru Miyato , Yarin Gal

Deep neural networks are increasingly being used to detect and diagnose medical conditions using medical imaging. Despite their utility, these models are highly vulnerable to adversarial attacks and distribution shifts, which can affect…

Image and Video Processing · Electrical Eng. & Systems 2025-06-23 Josué Martínez-Martínez , Olivia Brown , Mostafa Karami , Sheida Nabavi

Data augmentation has become a standard component of vision pre-trained models to capture the invariance between augmented views. In practice, augmentation techniques that mask regions of a sample with zero/mean values or patches from other…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Shentong Mo , Zhun Sun , Chao Li

Data augmentation is a technique to improve the generalization ability of machine learning methods by increasing the size of the dataset. However, since every augmentation method is not equally effective for every dataset, you need to…

Machine Learning · Computer Science 2022-05-31 Daisuke Oba , Shinnosuke Matsuo , Brian Kenji Iwana

Modern neural networks excel at image classification, yet they remain vulnerable to common image corruptions such as blur, speckle noise or fog. Recent methods that focus on this problem, such as AugMix and DeepAugment, introduce defenses…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Dan A. Calian , Florian Stimberg , Olivia Wiles , Sylvestre-Alvise Rebuffi , Andras Gyorgy , Timothy Mann , Sven Gowal

The existence of adversarial data examples has drawn significant attention in the deep-learning community; such data are seemingly minimally perturbed relative to the original data, but lead to very different outputs from a deep-learning…

Machine Learning · Computer Science 2019-11-12 Bai Li , Changyou Chen , Wenlin Wang , Lawrence Carin

Image augmentations applied during training are crucial for the generalization performance of image classifiers. Therefore, a large body of research has focused on finding the optimal augmentation policy for a given task. Yet, RandAugment…

Machine Learning · Computer Science 2021-12-06 Arno Blaas , Xavier Suau , Jason Ramapuram , Nicholas Apostoloff , Luca Zappella

Despite the high performance achieved by deep neural networks on various tasks, extensive studies have demonstrated that small tweaks in the input could fail the model predictions. This issue of deep neural networks has led to a number of…

Machine Learning · Computer Science 2022-02-22 Ming-Chang Chiu , Xuezhe Ma

Out-of-distribution generalization can be categorized into two types: common perturbations arising from natural variations in the real world and adversarial perturbations that are intentionally crafted to deceive neural networks. While deep…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Fatemeh Amerehi , Patrick Healy

Group distributionally robust optimization, which aims to improve robust accuracies -- worst-group and unbiased accuracies -- is a prominent algorithm used to mitigate spurious correlations and address dataset bias. Although existing…

Machine Learning · Computer Science 2024-12-23 Seonguk Seo , Bohyung Han