English
Related papers

Related papers: A Fourier Perspective on Model Robustness in Compu…

200 papers

Dynamic data selection aims to accelerate training with lossless performance. However, reducing training data inherently limits data diversity, potentially hindering generalization. While data augmentation is widely used to enhance…

Machine Learning · Computer Science 2025-05-13 Suorong Yang , Peng Ye , Furao Shen , Dongzhan Zhou

Computer vision research has long aimed to build systems that are robust to spatial transformations found in natural data. Traditionally, this is done using data augmentation or hard-coding invariances into the architecture. However, too…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Utkarsh Singhal , Carlos Esteves , Ameesh Makadia , Stella X. Yu

Robust machine learning formulations have emerged to address the prevalent vulnerability of deep neural networks to adversarial examples. Our work draws the connection between optimal robust learning and the privacy-utility tradeoff…

Machine Learning · Computer Science 2021-05-20 Ye Wang , Shuchin Aeron , Adnan Siraj Rakin , Toshiaki Koike-Akino , Pierre Moulin

Data augmentation is known to contribute significantly to the robustness of machine learning models. In most instances, data augmentation is utilized during the training phase. Test-Time Augmentation (TTA) is a technique that instead…

Machine Learning · Statistics 2024-09-20 Masanari Kimura , Howard Bondell

Automatic data augmentation (AutoAugment) strategies are indispensable in supervised data-efficient training protocols of vision transformers, and have led to state-of-the-art results in supervised learning. Despite the success, its…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Tao Tang , Changlin Li , Guangrun Wang , Kaicheng Yu , Xiaojun Chang , Xiaodan Liang

We identify a trade-off between robustness and accuracy that serves as a guiding principle in the design of defenses against adversarial examples. Although this problem has been widely studied empirically, much remains unknown concerning…

Machine Learning · Computer Science 2019-06-25 Hongyang Zhang , Yaodong Yu , Jiantao Jiao , Eric P. Xing , Laurent El Ghaoui , Michael I. Jordan

Although many fields have witnessed the superior performance brought about by deep learning, the robustness of neural networks remains an open issue. Specifically, a small adversarial perturbation on the input may cause the model to produce…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Binxiao Huang , Chaofan Tao , Rui Lin , Ngai Wong

Mixup is a procedure for data augmentation that trains networks to make smoothly interpolated predictions between datapoints. Adversarial training is a strong form of data augmentation that optimizes for worst-case predictions in a compact…

Machine Learning · Computer Science 2021-03-23 Jason Bunk , Srinjoy Chattopadhyay , B. S. Manjunath , Shivkumar Chandrasekaran

Discrete adversarial attacks are symbolic perturbations to a language input that preserve the output label but lead to a prediction error. While such attacks have been extensively explored for the purpose of evaluating model robustness,…

Machine Learning · Computer Science 2021-11-02 Maor Ivgi , Jonathan Berant

As the use of deep neural networks continues to grow, understanding their behaviour has become more crucial than ever. Post-hoc explainability methods are a potential solution, but their reliability is being called into question. Our…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Lenka Tětková , Lars Kai Hansen

Data quality plays a central role in the performance and robustness of convolutional neural networks (CNNs) for image classification. While high-quality data is often preferred for training, real-world inputs are frequently affected by…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Oscar H. Ramírez-Agudelo , Nicoleta Gorea , Aliza Reif , Lorenzo Bonasera , Michael Karl

Despite their impressive performance on image classification tasks, deep networks have a hard time generalizing to unforeseen corruptions of their data. To fix this vulnerability, prior works have built complex data augmentation strategies,…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Apostolos Modas , Rahul Rade , Guillermo Ortiz-Jiménez , Seyed-Mohsen Moosavi-Dezfooli , Pascal Frossard

Transfer learning across domains with distribution shift remains a fundamental challenge in building robust and adaptable machine learning systems. While adversarial perturbations are traditionally viewed as threats that expose model…

Machine Learning · Computer Science 2025-05-20 Hana Satou , Alan Mitkiy

Data augmentation (DA) enhances model generalization in computer vision but may introduce biases, impacting class accuracy unevenly. Our study extends this inquiry, examining DA's class-specific bias across various datasets, including those…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Athanasios Angelakis , Andrey Rass

Deep neural networks have become popular in many supervised learning tasks, but they may suffer from overfitting when the training dataset is limited. To mitigate this, many researchers use data augmentation, which is a widely used and…

Machine Learning · Computer Science 2022-05-27 Jianhan Wu , Shijing Si , Jianzong Wang , Jing Xiao

Federated Learning has emerged as a dominant computational paradigm for distributed machine learning. Its unique data privacy properties allow us to collaboratively train models while offering participating clients certain…

Machine Learning · Computer Science 2022-05-04 Dimitris Stripelis , Marcin Abram , Jose Luis Ambite

Self-supervised contrastive learning heavily relies on the view variance brought by data augmentation, so that it can learn a view-invariant pre-trained representation. Beyond increasing the view variance for contrast, this work focuses on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Yong Zhang , Rui Zhu , Shifeng Zhang , Xu Zhou , Shifeng Chen , Xiaofan Chen

By default neural networks are not robust to changes in data distribution. This has been demonstrated with simple image corruptions, such as blurring or adding noise, degrading image classification performance. Many methods have been…

Machine Learning · Computer Science 2023-06-16 Ian Mason , Anirban Sarkar , Tomotake Sasaki , Xavier Boix

Data augmentation methods have played an important role in the recent advance of deep learning models, and have become an indispensable component of state-of-the-art models in semi-supervised, self-supervised, and supervised training for…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Emirhan Kurtulus , Zichao Li , Yann Dauphin , Ekin Dogus Cubuk

Developing a reliable vision system is a fundamental challenge for robotic technologies (e.g., indoor service robots and outdoor autonomous robots) which can ensure reliable navigation even in challenging environments such as adverse…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Elena Camuffo , Umberto Michieli , Simone Milani , Jijoong Moon , Mete Ozay