中文
相关论文

相关论文: TrojViT: Trojan Insertion in Vision Transformers

200 篇论文

Vision transformers (ViT) have demonstrated impressive performance across various machine vision problems. These models are based on multi-head self-attention mechanisms that can flexibly attend to a sequence of image patches to encode…

计算机视觉与模式识别 · 计算机科学 2021-11-29 Muzammal Naseer , Kanchana Ranasinghe , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Ming-Hsuan Yang

Adversarial attacks on deep learning-based models pose a significant threat to the current AI infrastructure. Among them, Trojan attacks are the hardest to defend against. In this paper, we first introduce a variation of the Badnet kind of…

计算机视觉与模式识别 · 计算机科学 2022-07-11 Haripriya Harikumar , Santu Rana , Kien Do , Sunil Gupta , Wei Zong , Willy Susilo , Svetha Venkastesh

Vision Transformer (ViT), as a powerful alternative to Convolutional Neural Network (CNN), has received much attention. Recent work showed that ViTs are also vulnerable to adversarial examples like CNNs. To build robust ViTs, an intuitive…

计算机视觉与模式识别 · 计算机科学 2022-07-22 Boxi Wu , Jindong Gu , Zhifeng Li , Deng Cai , Xiaofei He , Wei Liu

Recently, vision Transformers (ViTs) are developing rapidly and starting to challenge the domination of convolutional neural networks (CNNs) in the realm of computer vision (CV). With the general-purpose Transformer architecture replacing…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Haofei Zhang , Jiarui Duan , Mengqi Xue , Jie Song , Li Sun , Mingli Song

Change detection in remote sensing images is essential for tracking environmental changes on the Earth's surface. Despite the success of vision transformers (ViTs) as backbones in numerous computer vision applications, they remain…

计算机视觉与模式识别 · 计算机科学 2024-06-19 Duowang Zhu , Xiaohu Huang , Haiyan Huang , Zhenfeng Shao , Qimin Cheng

The use of transformers for vision tasks has challenged the traditional dominant role of convolutional neural networks (CNN) in computer vision (CV). For image classification tasks, Vision Transformer (ViT) effectively establishes spatial…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Shihua Sun , Kenechukwu Nwodo , Shridatt Sugrim , Angelos Stavrou , Haining Wang

Vision transformers (ViTs) have demonstrated impressive performance on a series of computer vision tasks, yet they still suffer from adversarial examples. % crafted in a similar fashion as CNNs. In this paper, we posit that adversarial…

计算机视觉与模式识别 · 计算机科学 2022-01-04 Zhipeng Wei , Jingjing Chen , Micah Goldblum , Zuxuan Wu , Tom Goldstein , Yu-Gang Jiang

Backdoor (trojan) attacks embed hidden, controllable behaviors into machine-learning models so that models behave normally on benign inputs but produce attacker-chosen outputs when a trigger is present. This survey reviews the rapidly…

密码学与安全 · 计算机科学 2025-09-10 Bilal Hussain Abbasi , Yanjun Zhang , Leo Zhang , Shang Gao

The major part of the vanilla vision transformer (ViT) is the attention block that brings the power of mimicking the global context of the input image. For better performance, ViT needs large-scale training data. To overcome this data…

计算机视觉与模式识别 · 计算机科学 2021-09-21 Ahmed Aldahdooh , Wassim Hamidouche , Olivier Deforges

Trojan backdoor is a poisoning attack against Neural Network (NN) classifiers in which adversaries try to exploit the (highly desirable) model reuse property to implant Trojans into model parameters for backdoor breaches through a poisoned…

密码学与安全 · 计算机科学 2022-09-07 Guanxiong Liu , Abdallah Khreishah , Fatima Sharadgah , Issa Khalil

Deep neural networks (DNNs) have achieved tremendous success in various applications including video action recognition, yet remain vulnerable to backdoor attacks (Trojans). The backdoor-compromised model will mis-classify to the target…

计算机视觉与模式识别 · 计算机科学 2023-12-12 Xi Li , Songhe Wang , Ruiquan Huang , Mahanth Gowda , George Kesidis

Transformers are popular neural network models that use layers of self-attention and fully-connected nodes with embedded tokens. Vision Transformers (ViT) adapt transformers for image recognition tasks. In order to do this, the images are…

计算机视觉与模式识别 · 计算机科学 2023-04-28 Brian Kenji Iwana , Akihiro Kusuda

Deep learning technology can be used as an assistive technology to help doctors quickly and accurately identify COVID-19 infections. Recently, Vision Transformer (ViT) has shown great potential towards image classification due to its global…

图像与视频处理 · 电气工程与系统科学 2022-07-06 Hongyan Xu , Xiu Su , Dadong Wang

Dense computer vision tasks such as object detection and segmentation require effective multi-scale feature representation for detecting or classifying objects or regions with varying sizes. While Convolutional Neural Networks (CNNs) have…

计算机视觉与模式识别 · 计算机科学 2021-12-28 Youngwan Lee , Jonghee Kim , Jeff Willette , Sung Ju Hwang

Trojan attacks pose a severe threat to AI systems. Recent works on Transformer models received explosive popularity and the self-attentions are now indisputable. This raises a central question: Can we reveal the Trojans through attention…

机器学习 · 计算机科学 2022-08-11 Weimin Lyu , Songzhu Zheng , Tengfei Ma , Haibin Ling , Chao Chen

Transformers, which are popular for language modeling, have been explored for solving vision tasks recently, e.g., the Vision Transformer (ViT) for image classification. The ViT model splits each image into a sequence of tokens with fixed…

计算机视觉与模式识别 · 计算机科学 2021-12-01 Li Yuan , Yunpeng Chen , Tao Wang , Weihao Yu , Yujun Shi , Zihang Jiang , Francis EH Tay , Jiashi Feng , Shuicheng Yan

Light-weight convolutional neural networks (CNNs) are the de-facto for mobile vision tasks. Their spatial inductive biases allow them to learn representations with fewer parameters across different vision tasks. However, these networks are…

计算机视觉与模式识别 · 计算机科学 2022-03-07 Sachin Mehta , Mohammad Rastegari

Recently, Vision Transformers (ViTs) have achieved unprecedented effectiveness in the general domain of image classification. Nonetheless, these models remain underexplored in the field of deepfake detection, given their lower performance…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Dat Nguyen , Marcella Astrid , Enjie Ghorbel , Djamila Aouada

Vision transformers (ViTs) have been successfully deployed in a variety of computer vision tasks, but they are still vulnerable to adversarial samples. Transfer-based attacks use a local model to generate adversarial samples and directly…

计算机视觉与模式识别 · 计算机科学 2023-06-06 Jianping Zhang , Yizhan Huang , Weibin Wu , Michael R. Lyu

Adversarial attacks pose a significant threat to deep learning models, particularly in safety-critical applications like healthcare and autonomous driving. Recently, patch based attacks have demonstrated effectiveness in real-time inference…

计算机视觉与模式识别 · 计算机科学 2025-02-25 Prashant Shekhar , Bidur Devkota , Dumindu Samaraweera , Laxima Niure Kandel , Manoj Babu