English
Related papers

Related papers: V-Attack: Targeting Disentangled Value Features fo…

200 papers

With the rapid development of deep learning, object detectors have demonstrated impressive performance; however, vulnerabilities still exist in certain scenarios. Current research exploring the vulnerabilities using adversarial patches…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Boming Miao , Chunxiao Li , Yao Zhu , Weixiang Sun , Zizhe Wang , Xiaoyi Wang , Chuanlong Xie

While Vision-Language-Action (VLA) models have emerged as powerful generalist policies, their severe vulnerability to adversarial patches significantly hinders their deployment in safety-critical domains. Moreover, existing patch attacks…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Jiyuan Fu , Kaixun Jiang , Jingkai Jia , Zhaoyu Chen , Xueyao Chen , Lingyi Hong , Shuyong Gao , Chenzhi Tan , Dingkang Yang , Wenqiang Zhang

With the remarkable success of Vision-Language Models (VLMs) on multimodal tasks, concerns regarding their deployment efficiency have become increasingly prominent. In particular, the number of tokens consumed during the generation process…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Zhi Luo , Zenghui Yuan , Wenqi Wei , Daizong Liu , Pan Zhou

Generative large vision-language models (LVLMs) have recently achieved impressive performance gains, and their user base is growing rapidly. However, the security of LVLMs, in particular in a long-context multi-turn setting, is largely…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Christian Schlarmann , Matthias Hein

Addressing the escalating security vulnerabilities in Vision-Language-Action (VLA) models, this study investigates backdoor attacks targeting the visual pathway. We identify a core obstacle causing the failure of traditional attack…

Robotics · Computer Science 2026-05-12 Kewei Chen , Yayu Long , Shuai Li , Mingsheng Shang

Recently, deep networks have achieved impressive semantic segmentation performance, in particular thanks to their use of larger contextual information. In this paper, we show that the resulting networks are sensitive not only to global…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Krishna Kanth Nakka , Mathieu Salzmann

Vision-language models (VLMs), such as CLIP, have gained significant popularity as foundation models, with numerous fine-tuning methods developed to enhance performance on downstream tasks. However, due to their inherent vulnerability and…

Machine Learning · Computer Science 2025-08-28 Lijun Sheng , Jian Liang , Zilei Wang , Ran He

With Vision-Language Pre-training (VLP) models demonstrating powerful multimodal interaction capabilities, the application scenarios of neural networks are no longer confined to unimodal domains but have expanded to more complex multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Haonan Zheng , Xinyang Deng , Wen Jiang , Wenrui Li

The rapid evolution of Text-to-Video (T2V) diffusion models has driven remarkable advancements in generating high-quality, temporally coherent videos from natural language descriptions. Despite these achievements, their vulnerability to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Changzhen Li , Yuecong Min , Jie Zhang , Zheng Yuan , Shiguang Shan , Xilin Chen

Recently in robotics, Vision-Language-Action (VLA) models have emerged as a transformative approach, enabling robots to execute complex tasks by integrating visual and linguistic inputs within an end-to-end learning framework. Despite their…

Deep neural networks have proven to be vulnerable to adversarial attacks in the form of adding specific perturbations on images to make wrong outputs. Designing stronger adversarial attack methods can help more reliably evaluate the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Jialiang Sun , Wen Yao , Tingsong Jiang , Xiaoqian Chen

The conventional targeted adversarial attacks add a small perturbation to an image to make neural network models estimate the image as a predefined target class, even if it is not the correct target class. Recently, for visual-language…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Jonggyu Jang , Hyeonsu Lyu , Jungyeon Koh , Hyun Jong Yang

Vision Language Models (VLMs) have advanced perception in autonomous driving (AD), but they remain vulnerable to adversarial threats. These risks range from localized physical patches to imperceptible global perturbations. Existing defense…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Xiaoxu Peng , Dong Zhou , Jianwen Zhang , Guanghui Sun , Anh Tu Ngo , Anupam Chattopadhyay

Recent research suggests that Vision Language Models (VLMs) often rely on inherent biases learned during training when responding to queries about visual properties of images. These biases are exacerbated when VLMs are asked highly specific…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Saurav Sengupta , Nazanin Moradinasab , Jiebei Liu , Donald E. Brown

Recent advances in vision-language models (VLMs) have significantly enhanced the visual grounding task, which involves locating objects in an image based on natural language queries. Despite these advancements, the security of VLM-based…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Junxian Li , Beining Xu , Simin Chen , Jiatong Li , Jingdi Lei , Haodong Zhao , Di Zhang

Vision-Language Models (VLMs) with multimodal reasoning capabilities are high-value attack targets, given their potential for handling complex multimodal harmful tasks. Mainstream black-box jailbreak attacks on VLMs work by distributing…

Cryptography and Security · Computer Science 2026-02-12 Yu Yan , Sheng Sun , Shengjia Cheng , Teli Liu , Mingfeng Li , Min Liu

The Large Vision-Language Model (LVLM) integrates computer vision and natural language processing techniques, offering substantial application potential. However, these models demand extensive resources during inference. Adaptive attention…

Artificial Intelligence · Computer Science 2025-02-10 Junyang Zhang , Mu Yuan , Ruiguang Zhong , Puhan Luo , Huiyou Zhan , Ningkang Zhang , Chengchen Hu , Xiangyang Li

Visual language models (VLMs) have made significant progress in image captioning tasks, yet recent studies have found they are vulnerable to backdoor attacks. Attackers can inject undetectable perturbations into the data during inference,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Shuhan Xu , Siyuan Liang , Hongling Zheng , Aishan Liu , Xinbiao Wang , Yong Luo , Fu Lin , Leszek Rutkowski , Dacheng Tao

Vision-Language Models (VLMs) have achieved impressive progress in multimodal text generation, yet their rapid adoption raises increasing concerns about security vulnerabilities. Existing backdoor attacks against VLMs primarily rely on…

Cryptography and Security · Computer Science 2025-12-08 Haoyu Shen , Weimin Lyu , Haotian Xu , Tengfei Ma

Vision-Language Models (VLMs) leverage aligned visual encoders to transform images into visual tokens, allowing them to be processed similarly to text by the backbone large language model (LLM). This unified input paradigm enables VLMs to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Bangzheng Li , Fei Wang , Wenxuan Zhou , Nan Xu , Ben Zhou , Sheng Zhang , Hoifung Poon , Muhao Chen