English
Related papers

Related papers: ViT-EnsembleAttack: Augmenting Ensemble Models for…

200 papers

Recent advances on Vision Transformer (ViT) and its improved variants have shown that self-attention-based networks surpass traditional Convolutional Neural Networks (CNNs) in most vision tasks. However, existing ViTs focus on the standard…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Xiaofeng Mao , Gege Qi , Yuefeng Chen , Xiaodan Li , Ranjie Duan , Shaokai Ye , Yuan He , Hui Xue

Adversarial attacks are a central tool for probing the robustness of modern vision models, yet most methods optimize perturbations directly in pixel space under $\ell_\infty$ or $\ell_2$ constraints. While effective in white-box settings,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Eitan Shaar , Ariel Shaulov , Yalcin Tur , Gal Chechik , Ravid Shwartz-Ziv

Adversarial training, as one of the few certified defenses against adversarial attacks, can be quite complicated and time-consuming, while the results might not be robust enough. To address the issue of lack of robustness, ensemble methods…

Machine Learning · Computer Science 2021-10-08 Yihao Wang

Adversarial attacks can deceive neural networks by adding tiny perturbations to their input data. Ensemble defenses, which are trained to minimize attack transferability among sub-models, offer a promising research direction to improve…

Machine Learning · Computer Science 2022-11-16 Yunrui Yu , Xitong Gao , Cheng-Zhong Xu

The use of transformers for vision tasks has challenged the traditional dominant role of convolutional neural networks (CNN) in computer vision (CV). For image classification tasks, Vision Transformer (ViT) effectively establishes spatial…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Shihua Sun , Kenechukwu Nwodo , Shridatt Sugrim , Angelos Stavrou , Haining Wang

Malicious attackers can generate targeted adversarial examples by imposing tiny noises, forcing neural networks to produce specific incorrect outputs. With cross-model transferability, network models remain vulnerable even in black-box…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Hung-Jui Wang , Yu-Yu Wu , Shang-Tse Chen

Despite the substantial advancements in Vision-Language Pre-training (VLP) models, their susceptibility to adversarial attacks poses a significant challenge. Existing work rarely studies the transferability of attacks on VLP models,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Jiyuan Fu , Zhaoyu Chen , Kaixun Jiang , Haijing Guo , Jiafeng Wang , Shuyong Gao , Wenqiang Zhang

Though deep neural networks have achieved significant progress on various tasks, often enhanced by model ensemble, existing high-performance models can be vulnerable to adversarial attacks. Many efforts have been devoted to enhancing the…

Machine Learning · Computer Science 2019-05-30 Tianyu Pang , Kun Xu , Chao Du , Ning Chen , Jun Zhu

Deploying Vision Transformers on edge devices is challenging due to their high computational complexity, while full offloading to cloud resources presents significant latency overheads. We propose a novel collaborative inference framework,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Hao Liu , Suhaib A. Fahmy

Recently, there has been a lot of progress in reducing the computation of deep models at inference time. These methods can reduce both the computational needs and power usage of deep models. Some of these approaches adaptively scale the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 KL Navaneet , Soroush Abbasi Koohpayegani , Essam Sleiman , Hamed Pirsiavash

Deep neural networks have achieved substantial achievements in several computer vision areas, but have vulnerabilities that are often fooled by adversarial examples that are not recognized by humans. This is an important issue for security…

Computer Vision and Pattern Recognition · Computer Science 2021-01-29 Hakmin Lee , Hong Joo Lee , Seong Tae Kim , Yong Man Ro

Transfer-based adversarial example is one of the most important classes of black-box attacks. However, there is a trade-off between transferability and imperceptibility of the adversarial perturbation. Prior work in this direction often…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Fangcheng Liu , Chao Zhang , Hongyang Zhang

While current Vision Transformer (ViT) adapter methods have shown promising accuracy, their inference speed is implicitly hindered by inefficient memory access operations, e.g., standard normalization and frequent reshaping. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Dong Zhang , Rui Yan , Pingcheng Dong , Kwang-Ting Cheng

Deep neural networks are vulnerable to adversarial examples, which can mislead classifiers by adding imperceptible perturbations. An intriguing property of adversarial examples is their good transferability, making black-box attacks…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Yinpeng Dong , Tianyu Pang , Hang Su , Jun Zhu

The integration of an ensemble of deep learning models has been extensively explored to enhance defense against adversarial attacks. The diversity among sub-models increases the attack cost required to deceive the majority of the ensemble,…

Machine Learning · Computer Science 2024-03-26 Kaikang Zhao , Xi Chen , Wei Huang , Liuxin Ding , Xianglong Kong , Fan Zhang

Vision transformer (ViT) models, when coupled with interpretation models, are regarded as secure and challenging to deceive, making them well-suited for security-critical domains such as medical applications, autonomous vehicles, drones,…

Cryptography and Security · Computer Science 2025-07-22 Eldor Abdukhamidov , Mohammed Abuhamad , Simon S. Woo , Hyoungshick Kim , Tamer Abuhmed

Variational autoencoders (VAEs) have recently been shown to be vulnerable to adversarial attacks, wherein they are fooled into reconstructing a chosen target image. However, how to defend against such attacks remains an open problem. We…

Machine Learning · Statistics 2021-02-01 Matthew Willetts , Alexander Camuto , Tom Rainforth , Stephen Roberts , Chris Holmes

Recent work has shown that deep vision models tend to be overly dependent on low-level or "texture" features, leading to poor generalization. Various data augmentation strategies have been proposed to overcome this so-called texture bias in…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Aditay Tripathi , Rishubh Singh , Anirban Chakraborty , Pradeep Shenoy

The introduction of Transformer model has led to tremendous advancements in sequence modeling, especially in text domain. However, the use of attention-based models for video understanding is still relatively unexplored. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Saurabh Sahu , Palash Goyal

The strategy of ensemble has become popular in adversarial defense, which trains multiple base classifiers to defend against adversarial attacks in a cooperative manner. Despite the empirical success, theoretical explanations on why an…

Machine Learning · Computer Science 2023-11-03 Yian Deng , Tingting Mu