English
Related papers

Related papers: Visual Adversarial Attack on Vision-Language Model…

200 papers

Large Language Model (LLM) agents are increasingly used to automate complex workflows, but integrating untrusted external data with privileged execution exposes them to severe security risks, particularly direct and indirect prompt…

Cryptography and Security · Computer Science 2026-04-28 Zonghao Ying , Haozheng Wang , Jiangfan Liu , Quanchen Zou , Aishan Liu , Jian Yang , Yaodong Yang , Xianglong Liu

In recent years, Vision-Language-Action (VLA) models in embodied intelligence have developed rapidly. However, existing adversarial attack methods require costly end-to-end training and often generate noticeable perturbation patches. To…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Naifu Zhang , Wei Tao , Xi Xiao , Qianpu Sun , Yuxin Zheng , Wentao Mo , Peiqiang Wang , Nan Zhang

With recent advances in multi-modal foundation models, the previously text-only large language models (LLM) have evolved to incorporate visual input, opening up unprecedented opportunities for various applications in visualization. Our work…

Human-Computer Interaction · Computer Science 2023-12-08 Shusen Liu , Haichao Miao , Zhimin Li , Matthew Olson , Valerio Pascucci , Peer-Timo Bremer

Recently, driven by advancements in Multimodal Large Language Models (MLLMs), Vision Language Action Models (VLAMs) are being proposed to achieve better performance in open-vocabulary scenarios for robotic manipulation tasks. Since…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Hao Cheng , Erjia Xiao , Yichi Wang , Chengyuan Yu , Mengshu Sun , Qiang Zhang , Jiahang Cao , Yijie Guo , Ning Liu , Kaidi Xu , Jize Zhang , Chao Shen , Philip Torr , Jindong Gu , Renjing Xu

Vision-language artificial intelligence models (VLMs) possess medical knowledge and can be employed in healthcare in numerous ways, including as image interpreters, virtual scribes, and general decision support systems. However, here, we…

Cryptography and Security · Computer Science 2025-03-20 Jan Clusmann , Dyke Ferber , Isabella C. Wiest , Carolin V. Schneider , Titus J. Brinker , Sebastian Foersch , Daniel Truhn , Jakob N. Kather

In the rapidly evolving field of machine learning, adversarial attacks present a significant challenge to model robustness and security. Decision-based attacks, which only require feedback on the decision of a model rather than detailed…

Cryptography and Security · Computer Science 2024-05-24 Ping Guo , Fei Liu , Xi Lin , Qingchuan Zhao , Qingfu Zhang

In autonomous driving (AD), accurate perception is indispensable to achieving safe and secure driving. Due to its safety-criticality, the security of AD perception has been widely studied. Among different attacks on AD perception, the…

Cryptography and Security · Computer Science 2023-08-24 Ningfei Wang , Yunpeng Luo , Takami Sato , Kaidi Xu , Qi Alfred Chen

Personalized driving refers to an autonomous vehicle's ability to adapt its driving behavior or control strategies to match individual users' preferences and driving styles while maintaining safety and comfort standards. However, existing…

Adversarial attacks are a type of attack on machine learning models where an attacker deliberately modifies the inputs to cause the model to make incorrect predictions. Adversarial attacks can have serious consequences, particularly in…

Machine Learning · Computer Science 2025-09-15 Prathyusha Devabhakthini , Sasmita Parida , Raj Mani Shukla , Suvendu Chandan Nayak , Tapadhir Das

Vision-Language-Action (VLA) models enable robots to interpret natural-language instructions and perform diverse tasks, yet their integration of perception, language, and control introduces new safety vulnerabilities. Despite growing…

Cryptography and Security · Computer Science 2025-11-18 Jiayu Li , Yunhan Zhao , Xiang Zheng , Zonghuan Xu , Yige Li , Xingjun Ma , Yu-Gang Jiang

We introduce the Adversarial Confusion Attack, a new class of threats against multimodal large language models (MLLMs). Unlike jailbreaks or targeted misclassification, the goal is to induce systematic disruption that makes the model…

Computation and Language · Computer Science 2025-12-02 Jakub Hoscilowicz , Artur Janicki

Research in ML4VIS investigates how to use machine learning (ML) techniques to generate visualizations, and the field is rapidly growing with high societal impact. However, as with any computational pipeline that employs ML processes,…

Cryptography and Security · Computer Science 2024-09-25 Takanori Fujiwara , Kostiantyn Kucher , Junpeng Wang , Rafael M. Martins , Andreas Kerren , Anders Ynnerman

Autonomous agentic AI systems powered by vision-language models (VLMs) are rapidly advancing toward real-world deployment, yet their cross-modal reasoning capabilities introduce new attack surfaces for adversarial manipulation that exploit…

Artificial Intelligence · Computer Science 2025-11-25 Hangoo Kang , Jehyeok Yeon , Gagandeep Singh

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in multimodal understanding and generation, yet their vulnerability to adversarial attacks raises significant robustness concerns. While existing effective…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Hefei Mei , Zirui Wang , Shen You , Minjing Dong , Chang Xu

Modern autonomous driving (AD) systems leverage 3D object detection to perceive foreground objects in 3D environments for subsequent prediction and planning. Visual 3D detection based on RGB cameras provides a cost-effective solution…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Jian Wang , Lijun He , Yixing Yong , Haixia Bi , Fan Li

Autonomous vehicles (AVs) rely on complex perception and communication systems, making them vulnerable to adversarial attacks that can compromise safety. While simulation offers a scalable and safe environment for robustness testing,…

Cryptography and Security · Computer Science 2025-09-09 Christos Anagnostopoulos , Ioulia Kapsali , Alexandros Gkillas , Nikos Piperigkos , Aris S. Lalos

As the AI systems become deeply embedded in social media platforms, we've uncovered a concerning security vulnerability that goes beyond traditional adversarial attacks. It becomes important to assess the risks of LLMs before the general…

Computation and Language · Computer Science 2025-05-30 Nilanjana Das , Edward Raff , Aman Chadha , Manas Gaur

Vision-Language-Action (VLA) models with integrated reasoning have been proposed for end-to-end autonomous driving, assuming a tight coupling between reasoning and trajectory generation. However, the robustness of such systems under…

Cryptography and Security · Computer Science 2026-05-29 Mohammadreza Teymoorianfard , Jean-Philippe Monteuuis , Jonathan Petit , Amir Houmansadr

As Vision-Language Models (VLMs) demonstrate increasing capabilities across real-world applications such as code generation and chatbot assistance, ensuring their safety has become paramount. Unlike traditional Large Language Models (LLMs),…

Artificial Intelligence · Computer Science 2025-06-23 Peiyuan Tang , Haojie Xin , Xiaodong Zhang , Jun Sun , Qin Xia , Zijiang Yang

With the rapid advancement and widespread application of vision-language pre-training (VLP) models, their vulnerability to adversarial attacks has become a critical concern. In general, the adversarial examples can typically be designed to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yuanbo Li , Tianyang Xu , Cong Hu , Tao Zhou , Xiao-Jun Wu , Josef Kittler