English
Related papers

Related papers: Backdoor Directions in Vision Transformers

200 papers

Deep neural networks have been demonstrated to be vulnerable to backdoor attacks. Specifically, by injecting a small number of maliciously constructed inputs into the training set, an adversary is able to plant a backdoor into the trained…

Machine Learning · Statistics 2019-12-10 Alexander Turner , Dimitris Tsipras , Aleksander Madry

Adversarial machine learning has exposed several security hazards of neural models and has become an important research topic in recent times. Thus far, the concept of an "adversarial perturbation" has exclusively been used with reference…

Machine Learning · Computer Science 2020-09-22 Siddhant Garg , Adarsh Kumar , Vibhor Goel , Yingyu Liang

Backdoors are hidden behaviors that are only triggered once an AI system has been deployed. Bad actors looking to create successful backdoors must design them to avoid activation during training and evaluation. Since data used in these…

Cryptography and Security · Computer Science 2024-12-25 Sara Price , Arjun Panickssery , Sam Bowman , Asa Cooper Stickland

We study a crucial yet often overlooked issue inherent to Vision Transformers (ViTs): feature maps of these models exhibit grid-like artifacts, which hurt the performance of ViTs in downstream dense prediction tasks such as semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Jiawei Yang , Katie Z Luo , Jiefeng Li , Congyue Deng , Leonidas Guibas , Dilip Krishnan , Kilian Q Weinberger , Yonglong Tian , Yue Wang

Backdoor attacks on reinforcement learning implant a backdoor in a victim agent's policy. Once the victim observes the trigger signal, it will switch to the abnormal mode and fail its task. Most of the attacks assume the adversary can…

Multiagent Systems · Computer Science 2022-11-22 Shuo Chen , Yue Qiu , Jie Zhang

Backdoor attacks have been considered a severe security threat to deep learning. Such attacks can make models perform abnormally on inputs with predefined triggers and still retain state-of-the-art performance on clean data. While backdoor…

Machine Learning · Computer Science 2022-01-27 Yi Zeng , Won Park , Z. Morley Mao , Ruoxi Jia

Backdoor attacks pose a significant threat to neural networks, enabling adversaries to manipulate model outputs on specific inputs, often with devastating consequences, especially in critical applications. While backdoor attacks have been…

Machine Learning · Computer Science 2025-07-30 Zhen Guo , Abhinav Kumar , Reza Tourani

This study examines the capabilities of the Vision Transformer (ViT) model in generating visual embeddings for images of auto parts sourced from online marketplaces, such as Craigslist and OfferUp. By focusing exclusively on single-modality…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Cameron Armijo , Pablo Rivas

Recent escalation in the field of computer vision underpins a huddle of algorithms with the magnificent potential to unravel the information contained within images. These computer vision algorithms are being practised in medical image…

Image and Video Processing · Electrical Eng. & Systems 2022-03-30 Arshi Parvaiz , Muhammad Anwaar Khalid , Rukhsana Zafar , Huma Ameer , Muhammad Ali , Muhammad Moazam Fraz

Vision Transformers (ViTs) achieve strong performance in visual recognition, yet their decision-making remains difficult to interpret. We propose BiCAM, a bidirectional class activation mapping method that captures both supportive…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Qin Su , Tie Luo

As deep learning models increasingly find applications in critical domains such as medical imaging, the need for transparent and trustworthy decision-making becomes paramount. Many explainability methods provide insights into how these…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Piotr Komorowski , Hubert Baniecki , Przemysław Biecek

Backdoor attacks allow an attacker to embed a specific vulnerability in a machine learning algorithm, activated when an attacker-chosen pattern is presented, causing a specific misprediction. The need to identify backdoors in biometric…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Alexander Unnervik , Hatef Otroshi Shahreza , Anjith George , Sébastien Marcel

Vision-Language Models (VLMs) are increasingly deployed in consumer applications where users seek recommendations about products, dining, and services. We introduce Hidden Ads, a new class of backdoor attacks that exploit this…

Computation and Language · Computer Science 2026-03-31 Duanyi Yao , Changyue Li , Zhicong Huang , Cheng Hong , Songze Li

The rapid growth of natural language processing (NLP) and pre-trained language models have enabled accurate text classification in a variety of settings. However, text classification models are susceptible to backdoor attacks, where an…

Cryptography and Security · Computer Science 2024-12-30 A. Dilara Yavuz , M. Emre Gursoy

Visual prompting (VP) is a new technique that adapts well-trained frozen models for source domain tasks to target domain tasks. This study examines VP's benefits for black-box model-level backdoor detection. The visual prompt in VP maps…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Zi-Xuan Huang , Jia-Wei Chen , Zhi-Peng Zhang , Chia-Mu Yu

Backdoor attacks pose a significant security threat to natural language processing (NLP) systems, but existing methods lack explainable trigger mechanisms and fail to quantitatively model vulnerability patterns. This work pioneers the…

Cryptography and Security · Computer Science 2025-09-24 Gejian Zhao , Hanzhou Wu , Xinpeng Zhang

Recently, Vision Transformers (ViTs) have attracted a lot of attention in the field of computer vision. Generally, the powerful representative capacity of ViTs mainly benefits from the self-attention mechanism, which has a high computation…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Deli Yu , Teng Xi , Jianwei Li , Baopu Li , Gang Zhang , Haocheng Feng , Junyu Han , Jingtuo Liu , Errui Ding , Jingdong Wang

Although deep neural networks (DNNs) have achieved a great success in various computer vision tasks, it is recently found that they are vulnerable to adversarial attacks. In this paper, we focus on the so-called \textit{backdoor attack},…

Cryptography and Security · Computer Science 2025-03-27 Hao Cheng , Kaidi Xu , Sijia Liu , Pin-Yu Chen , Pu Zhao , Xue Lin

Transformer, first applied to the field of natural language processing, is a type of deep neural network mainly based on the self-attention mechanism. Thanks to its strong representation capabilities, researchers are looking at ways to…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Kai Han , Yunhe Wang , Hanting Chen , Xinghao Chen , Jianyuan Guo , Zhenhua Liu , Yehui Tang , An Xiao , Chunjing Xu , Yixing Xu , Zhaohui Yang , Yiman Zhang , Dacheng Tao

Deep neural networks (DNNs) have achieved tremendous success in various applications including video action recognition, yet remain vulnerable to backdoor attacks (Trojans). The backdoor-compromised model will mis-classify to the target…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Xi Li , Songhe Wang , Ruiquan Huang , Mahanth Gowda , George Kesidis