English
Related papers

Related papers: ViT-EnsembleAttack: Augmenting Ensemble Models for…

200 papers

Adding perturbations via utilizing auxiliary gradient information or discarding existing details of the benign images are two common approaches for generating adversarial examples. Though visual imperceptibility is the desired property of…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Zihan Chen , Ziyue Wang , Junjie Huang , Wentao Zhao , Xiao Liu , Dejian Guan

Although attention mechanisms have become fundamental components of deep learning models, they are vulnerable to perturbations, which may degrade the prediction performance and model interpretability. Adversarial training (AT) for attention…

Computation and Language · Computer Science 2022-12-27 Shunsuke Kitada , Hitoshi Iyatomi

The Vision Transformer (ViT) architecture has recently achieved competitive performance across a variety of computer vision tasks. One of the motivations behind ViTs is weaker inductive biases, when compared to convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Akash Umakantha , Joao D. Semedo , S. Alireza Golestaneh , Wan-Yi S. Lin

Tree ensembles are powerful models that are widely used. However, they are susceptible to adversarial examples, which are examples that purposely constructed to elicit a misprediction from the model. This can degrade performance and erode a…

Machine Learning · Computer Science 2022-06-28 Laurens Devos , Wannes Meert , Jesse Davis

This work studies black-box adversarial attacks against deep neural networks (DNNs), where the attacker can only access the query feedback returned by the attacked DNN model, while other information such as model parameters or the training…

Cryptography and Security · Computer Science 2021-03-19 Yan Feng , Baoyuan Wu , Yanbo Fan , Li Liu , Zhifeng Li , Shutao Xia

Adversarial training (AT) and its variants have spearheaded progress in improving neural network robustness to adversarial perturbations and common corruptions in the last few years. Algorithm design of AT and its variants are focused on…

Machine Learning · Computer Science 2022-06-15 Kaustubh Sridhar , Souradeep Dutta , Ramneet Kaur , James Weimer , Oleg Sokolsky , Insup Lee

Adversarial Transferability is an intriguing property - adversarial perturbation crafted against one model is also effective against another model, while these models are from different model families or training processes. To better…

Machine Learning · Computer Science 2021-11-09 Zhuolin Yang , Linyi Li , Xiaojun Xu , Shiliang Zuo , Qian Chen , Benjamin Rubinstein , Pan Zhou , Ce Zhang , Bo Li

Vision Transformers (ViTs) have emerged as a fundamental architecture and serve as the backbone of modern vision-language models. Despite their impressive performance, ViTs exhibit notable vulnerability to evasion attacks, necessitating the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Xiaoyun Xu , Shujian Yu , Zhuoran Liu , Stjepan Picek

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

In surrogate ensemble attacks, using more surrogate models yields higher transferability but lower resource efficiency. This practical trade-off between transferability and efficiency has largely limited existing attacks despite many…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Bo Yang , Hengwei Zhang , Jindong Wang , Yuchen Ren , Chenhao Lin , Chao Shen , Zhengyu Zhao

Vision Transformers (ViTs) have become popular in computer vision tasks. Backdoor attacks, which trigger undesirable behaviours in models during inference, threaten ViTs' performance, particularly in security-sensitive tasks. Although…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Zeyu Michael Li

Vision Transformers are increasingly embedded in industrial systems due to their superior performance, but their memory and power requirements make deploying them to edge devices a challenging task. Hence, model compression techniques are…

Machine Learning · Computer Science 2022-09-29 Swapnil Parekh , Devansh Shah , Pratyush Shukla

State-of-the-art deep neural networks are known to be vulnerable to adversarial examples, formed by applying small but malicious perturbations to the original inputs. Moreover, the perturbations can \textit{transfer across models}:…

Machine Learning · Statistics 2018-02-28 Lei Wu , Zhanxing Zhu , Cheng Tai , Weinan E

Model Merging (MM) has emerged as a promising alternative to multi-task learning, where multiple fine-tuned models are combined, without access to tasks' training data, into a single model that maintains performance across tasks. Recent…

Machine Learning · Computer Science 2025-09-30 Ankit Gangwal , Aaryan Ajay Sharma

Due to numerous breakthroughs in real-world applications brought by machine intelligence, deep neural networks (DNNs) are widely employed in critical applications. However, predictions of DNNs are easily manipulated with imperceptible…

Machine Learning · Computer Science 2022-05-04 Hongjun Wang , Yisen Wang

In recent years, despite significant advancements in adversarial attack research, the security challenges in cross-modal scenarios, such as the transferability of adversarial attacks between infrared, thermal, and RGB images, have been…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Yunpeng Gong , Qingyuan Zeng , Dejun Xu , Zhenzhong Wang , Min Jiang

Exploring the trustworthiness of deep learning models is crucial, especially in critical domains such as medical imaging decision support systems. Conformal prediction has emerged as a rigorous means of providing deep learning models with…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Mehran Zoravar , Shadi Alijani , Homayoun Najjaran

Vision-language pretraining (VLP) with transformers has demonstrated exceptional performance across numerous multimodal tasks. However, the adversarial robustness of these models has not been thoroughly investigated. Existing multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Jiwei Guan , Tianyu Ding , Longbing Cao , Lei Pan , Chen Wang , Xi Zheng

Recent advances in attention-based networks have shown that Vision Transformers can achieve state-of-the-art or near state-of-the-art results on many image classification tasks. This puts transformers in the unique position of being a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Kaleel Mahmood , Rigel Mahmood , Marten van Dijk

Adversarial training has shown promise in building robust models against adversarial examples. A major drawback of adversarial training is the computational overhead introduced by the generation of adversarial examples. To overcome this…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Xiaojun Jia , Jianshu Li , Jindong Gu , Yang Bai , Xiaochun Cao