English
Related papers

Related papers: Beyond Pretrained Features: Noisy Image Modeling P…

200 papers

We present a method for provably defending any pretrained image classifier against $\ell_p$ adversarial attacks. This method, for instance, allows public vision API providers and users to seamlessly convert pretrained non-robust…

Machine Learning · Computer Science 2020-09-22 Hadi Salman , Mingjie Sun , Greg Yang , Ashish Kapoor , J. Zico Kolter

Deep neural networks are vulnerable to adversarial attacks. The literature is rich with algorithms that can easily craft successful adversarial examples. In contrast, the performance of defense techniques still lags behind. This paper…

Machine Learning · Computer Science 2019-05-29 Yuzhe Yang , Guo Zhang , Dina Katabi , Zhi Xu

We propose ADIOS, a masked image model (MIM) framework for self-supervised learning, which simultaneously learns a masking function and an image encoder using an adversarial objective. The image encoder is trained to minimise the distance…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Yuge Shi , N. Siddharth , Philip H. S. Torr , Adam R. Kosiorek

Adversarial attacks hamper the functionality and accuracy of Deep Neural Networks (DNNs) by meddling with subtle perturbations to their inputs.In this work, we propose a new Mask-based Adversarial Defense scheme (MAD) for DNNs to mitigate…

Machine Learning · Computer Science 2022-04-27 Weizhen Xu , Chenyi Zhang , Fangzhen Zhao , Liangda Fang

Despite the fact that deep neural networks (DNNs) have achieved prominent performance in various applications, it is well known that DNNs are vulnerable to adversarial examples/samples (AEs) with imperceptible perturbations in…

Computer Vision and Pattern Recognition · Computer Science 2021-11-22 Yanni Li , Wenhui Zhang , Jiawei Liu , Xiaoli Kou , Hui Li , Jiangtao Cui

Deep neural networks, although shown to be a successful class of machine learning algorithms, are known to be extremely unstable to adversarial perturbations. Improving the robustness of neural networks against these attacks is important,…

Computer Vision and Pattern Recognition · Computer Science 2019-04-29 Seyed-Mohsen Moosavi-Dezfooli , Ashish Shrivastava , Oncel Tuzel

Image classification has significantly improved using deep learning. This is mainly due to convolutional neural networks (CNNs) that are capable of learning rich feature extractors from large datasets. However, most deep learning…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Xiaoyu Lin , Deblina Bhattacharjee , Majed El Helou , Sabine Süsstrunk

In practice, deep neural networks have been found to be vulnerable to various types of noise, such as adversarial examples and corruption. Various adversarial defense methods have accordingly been developed to improve adversarial robustness…

Machine Learning · Computer Science 2020-12-24 Aishan Liu , Xianglong Liu , Chongzhi Zhang , Hang Yu , Qiang Liu , Dacheng Tao

Deep Convolution Neural Networks (CNNs) can easily be fooled by subtle, imperceptible changes to the input images. To address this vulnerability, adversarial training creates perturbation patterns and includes them in the training set to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Muzammal Naseer , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Fatih Porikli

Deep Neural Networks are vulnerable to adversarial examples, i.e., carefully crafted input samples that can cause models to make incorrect predictions with high confidence. To mitigate these vulnerabilities, adversarial training and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Francesco Villani , Igor Maljkovic , Dario Lazzaro , Angelo Sotgiu , Antonio Emanuele Cinà , Fabio Roli

In this work, we survey recent studies on masked image modeling (MIM), an approach that emerged as a powerful self-supervised learning technique in computer vision. The MIM task involves masking some information, e.g. pixels, patches, or…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Vlad Hondru , Florinel Alin Croitoru , Shervin Minaee , Radu Tudor Ionescu , Nicu Sebe

Nowadays the deep learning technology is growing faster and shows dramatic performance in computer vision areas. However, it turns out a deep learning based model is highly vulnerable to some small perturbation called an adversarial attack.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-06 Seungju Cho , Tae Joon Jun , Mingu Kang , Daeyoung Kim

Many deep neural networks are susceptible to minute perturbations of images that have been carefully crafted to cause misclassification. Ideally, a robust classifier would be immune to small variations in input images, and a number of…

Computer Vision and Pattern Recognition · Computer Science 2022-02-08 Eashan Adhikarla , Dan Luo , Brian D. Davison

In recent times, deep neural networks (DNNs) have been successfully adopted for various applications. Despite their notable achievements, it has become evident that DNNs are vulnerable to sophisticated adversarial attacks, restricting their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Alik Pramanick , Mayank Bansal , Utkarsh Srivastava , Suklav Ghosh , Arijit Sur

Recent studies have shown that neural network (NN) based image classifiers are highly vulnerable to adversarial examples, which poses a threat to security-sensitive image recognition task. Prior work has shown that JPEG compression can…

Computer Vision and Pattern Recognition · Computer Science 2021-06-28 Cheng Zhang , Pan Gao

Vision Transformers (ViTs) have emerged as a fundamental architecture and serve as the backbone of modern vision-language models. Despite their impressive performance, ViTs exhibit notable vulnerability to evasion attacks, necessitating the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Xiaoyun Xu , Shujian Yu , Zhuoran Liu , Stjepan Picek

Masked image modeling (MIM) as pre-training is shown to be effective for numerous vision downstream tasks, but how and where MIM works remain unclear. In this paper, we compare MIM with the long-dominant supervised pre-trained models from…

Computer Vision and Pattern Recognition · Computer Science 2022-05-30 Zhenda Xie , Zigang Geng , Jingcheng Hu , Zheng Zhang , Han Hu , Yue Cao

Masked image modeling (MIM) learns representations with remarkably good fine-tuning performances, overshadowing previous prevalent pre-training approaches such as image classification, instance contrastive learning, and image-text…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Yixuan Wei , Han Hu , Zhenda Xie , Zheng Zhang , Yue Cao , Jianmin Bao , Dong Chen , Baining Guo

Adversarial training is a common strategy for enhancing model robustness against adversarial attacks. However, it is typically tailored to the specific attack types it is trained on, limiting its ability to generalize to unseen threat…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Fatemeh Amerehi , Patrick Healy

Despite providing high-performance solutions for computer vision tasks, the deep neural network (DNN) model has been proved to be extremely vulnerable to adversarial attacks. Current defense mainly focuses on the known attacks, but the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Lei Zhang , Yuhang Zhou , Yi Yang , Xinbo Gao