English
Related papers

Related papers: Prompt-driven Transferable Adversarial Attack on P…

200 papers

Adversarial attacks against deep learning models represent a major threat to the security and reliability of natural language processing (NLP) systems. In this paper, we propose a modification to the BERT-Attack framework, integrating…

Machine Learning · Computer Science 2024-08-01 Hetvi Waghela , Jaydip Sen , Sneha Rakshit

Natural language processing (NLP) tasks, ranging from text classification to text generation, have been revolutionised by the pre-trained language models, such as BERT. This allows corporations to easily build powerful APIs by encapsulating…

Computation and Language · Computer Science 2021-03-19 Xuanli He , Lingjuan Lyu , Qiongkai Xu , Lichao Sun

Visible-infrared pedestrian Re-identification (VI-ReID) aims to match pedestrian images captured by infrared cameras and visible cameras. However, VI-ReID, like other traditional cross-modal image matching tasks, poses significant…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Yue Su , Hao Li , Maoguo Gong

The rapid evolution of Text-to-Video (T2V) diffusion models has driven remarkable advancements in generating high-quality, temporally coherent videos from natural language descriptions. Despite these achievements, their vulnerability to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Changzhen Li , Yuecong Min , Jie Zhang , Zheng Yuan , Shiguang Shan , Xilin Chen

In recent years, Vision-Language-Action (VLA) models in embodied intelligence have developed rapidly. However, existing adversarial attack methods require costly end-to-end training and often generate noticeable perturbation patches. To…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Naifu Zhang , Wei Tao , Xi Xiao , Qianpu Sun , Yuxin Zheng , Wentao Mo , Peiqiang Wang , Nan Zhang

Powerful autonomous systems, which reason, plan, and converse using and between numerous tools and agents, are made possible by Large Language Models (LLMs), Vision-Language Models (VLMs), and new agentic AI systems, like LangChain and…

Cryptography and Security · Computer Science 2025-12-30 Toqeer Ali Syed , Mishal Ateeq Almutairi , Mahmoud Abdel Moaty

Adversarial attacks have shown the vulnerability of machine learning models, however, it is non-trivial to conduct textual adversarial attacks on natural language processing tasks due to the discreteness of data. Most previous approaches…

Computation and Language · Computer Science 2021-04-19 Junliang Guo , Zhirui Zhang , Linlin Zhang , Linli Xu , Boxing Chen , Enhong Chen , Weihua Luo

Understanding the vulnerability of large-scale pre-trained vision-language models like CLIP against adversarial attacks is key to ensuring zero-shot generalization capacity on various downstream tasks. State-of-the-art defense mechanisms…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Fan Yang , Mingxuan Xia , Sangzhou Xia , Chicheng Ma , Hui Hui

Today's text-to-image generative models are trained on millions of images sourced from the Internet, each paired with a detailed caption produced by Vision-Language Models (VLMs). This part of the training pipeline is critical for supplying…

Cryptography and Security · Computer Science 2025-06-30 Stanley Wu , Ronik Bhaskar , Anna Yoo Jeong Ha , Shawn Shan , Haitao Zheng , Ben Y. Zhao

Recent years have witnessed remarkable progress in developing Vision-Language Models (VLMs) capable of processing both textual and visual inputs. These models have demonstrated impressive performance, leading to their widespread adoption in…

Image and Video Processing · Electrical Eng. & Systems 2025-07-15 Hanene F. Z. Brachemi Meftah , Wassim Hamidouche , Sid Ahmed Fezza , Olivier Déforges

Addressing the escalating security vulnerabilities in Vision-Language-Action (VLA) models, this study investigates backdoor attacks targeting the visual pathway. We identify a core obstacle causing the failure of traditional attack…

Robotics · Computer Science 2026-05-12 Kewei Chen , Yayu Long , Shuai Li , Mingsheng Shang

Recent advances in image editing have shifted from manual pixel manipulation to employing deep learning methods like stable diffusion models, which now leverage cross-attention mechanisms for text-driven control. This transition has…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Linn Bieske , Carla Lorente

Pedestrian Attribute Recognition (PAR) involves predicting fine-grained attributes such as clothing color, gender, and accessories from pedestrian imagery, yet is hindered by severe class imbalance, intricate attribute co-dependencies, and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Abdellah Zakaria Sellam , Salah Eddine Bekhouche , Fadi Dornaika , Cosimo Distante , Abdenour Hadid

The prompt-based learning paradigm, which bridges the gap between pre-training and fine-tuning, achieves state-of-the-art performance on several NLP tasks, particularly in few-shot settings. Despite being widely applied, prompt-based…

Computation and Language · Computer Science 2024-02-05 Shuai Zhao , Jinming Wen , Luu Anh Tuan , Junbo Zhao , Jie Fu

This paper presents the first adversarial example based method for attacking human instance segmentation networks, namely person segmentation networks in short, which are harder to fool than classification networks. We propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Marc Treu , Trung-Nghia Le , Huy H. Nguyen , Junichi Yamagishi , Isao Echizen

Adversarial attacks are carried out to reveal the vulnerability of deep neural networks. Textual adversarial attacking is challenging because text is discrete and a small perturbation can bring significant change to the original input.…

Computation and Language · Computer Science 2020-12-10 Yuan Zang , Fanchao Qi , Chenghao Yang , Zhiyuan Liu , Meng Zhang , Qun Liu , Maosong Sun

Large pre-trained Vision Language Models (VLMs) demonstrate excellent generalization capabilities but remain highly susceptible to adversarial examples, posing potential security risks. To improve the robustness of VLMs against adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Shiji Zhao , Qihui Zhu , Shukun Xiong , Shouwei Ruan , Maoxun Yuan , Jialing Tao , Jiexi Liu , Ranjie Duan , Jie Zhang , Jie Zhang , Xingxing Wei

As a general-purpose vision-language pretraining model, CLIP demonstrates strong generalization ability in image-text alignment tasks and has been widely adopted in downstream applications such as image classification and image-text…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Kuanrong Liu , Siyuan Liang , Cheng Qian , Ming Zhang , Xiaochun Cao

Adversarial transferability refers to the capacity of adversarial examples generated on the surrogate model to deceive alternate, unexposed victim models. This property eliminates the need for direct access to the victim model during an…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Xiaosen Wang , Zhijin Ge , Bohan Liu , Zheng Fang , Fengfan Zhou , Ruixuan Zhang , Shaokang Wang , Yuyang Luo

While machine learning approaches to visual recognition offer great promise, most of the existing methods rely heavily on the availability of large quantities of labeled training data. However, in the vast majority of real-world settings,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Akash Gupta , Rameswar Panda , Sujoy Paul , Jianming Zhang , Amit K. Roy-Chowdhury