English
Related papers

Related papers: SlowBA: An efficiency backdoor attack towards VLM-…

200 papers

Mobile agents powered by vision-language models (VLMs) are increasingly adopted for tasks such as UI automation and camera-based assistance. These agents are typically fine-tuned using small-scale, user-collected data, making them…

Cryptography and Security · Computer Science 2025-09-08 Xuan Wang , Siyuan Liang , Zhe Liu , Yi Yu , Aishan Liu , Yuliang Lu , Xitong Gao , Ee-Chien Chang

Graphical User Interface (GUI) agents powered by Large Vision-Language Models (LVLMs) have emerged as a revolutionary approach to automating human-machine interactions, capable of autonomously operating personal devices (e.g., mobile…

Computation and Language · Computer Science 2025-09-25 Ziang Ye , Yang Zhang , Wentao Shi , Xiaoyu You , Fuli Feng , Tat-Seng Chua

Deep speech classification tasks, including keyword spotting and speaker verification, are vital in speech-based human-computer interaction. Recently, the security of these technologies has been revealed to be susceptible to backdoor…

Sound · Computer Science 2025-06-11 Wenhan Yao , Fen Xiao , Xiarun Chen , Jia Liu , YongQiang He , Weiping Wen

Recent advances in vision-language-action (VLA) models have greatly improved embodied AI, enabling robots to follow natural language instructions and perform diverse tasks. However, their reliance on uncurated training datasets raises…

Cryptography and Security · Computer Science 2025-10-13 Zirun Zhou , Zhengyang Xiao , Haochuan Xu , Jing Sun , Di Wang , Jingfeng Zhang

Graphical user interface (GUI) agents powered by multimodal large language models (MLLMs) have shown greater promise for human-interaction. However, due to the high fine-tuning cost, users often rely on open-source GUI agents or APIs…

Computation and Language · Computer Science 2025-05-26 Pengzhou Cheng , Haowen Hu , Zheng Wu , Zongru Wu , Tianjie Ju , Zhuosheng Zhang , Gongshen Liu

Backdoor attacks can cause reinforcement learning (RL) policies to behave normally under clean inputs while executing malicious behaviors when triggers are present. Existing RL backdoor attacks are primarily studied in simulation and often…

Robotics · Computer Science 2026-05-14 Tairan Huang , Qingqing Ye , Yulin Jin , Jiawei Lian , Yaxin Xiao , Yi Wang , Haibo Hu

Visual language model (VLM) is rapidly being integrated into safety-critical systems such as autonomous driving, making it an important attack surface for potential backdoor attacks. Existing backdoor attacks mainly rely on unimodal,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Jiancheng Wang , Lidan Liang , Yong Wang , Zengzhen Su , Haifeng Xia , Yuanting Yan , Wei Wang

Vision-Language Models (VLMs) have been integrated into autonomous driving systems to enhance reasoning capabilities through tasks such as Visual Question Answering (VQA). However, the robustness of these systems against backdoor attacks…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Ming Liu , Siyuan Liang , Koushik Howlader , Liwen Wang , Dacheng Tao , Wensheng Zhang

Despite their growing adoption across domains, large language model (LLM)-powered agents face significant security risks from backdoor attacks during training and fine-tuning. These compromised agents can subsequently be manipulated to…

Cryptography and Security · Computer Science 2025-06-12 Li Changjiang , Liang Jiacheng , Cao Bochuan , Chen Jinghui , Wang Ting

Vision-Language-Action (VLA) models are widely deployed in safety-critical embodied AI applications such as robotics. However, their complex multimodal interactions also expose new security vulnerabilities. In this paper, we investigate a…

Cryptography and Security · Computer Science 2026-01-09 Ji Guo , Wenbo Jiang , Yansong Lin , Yijing Liu , Ruichen Zhang , Guomin Lu , Aiguo Chen , Xinshuo Han , Hongwei Li , Dusit Niyato

Recent advances in Vision-Language Models (VLMs) have propelled embodied agents by enabling direct perception, reasoning, and planning task-oriented actions from visual inputs. However, such vision-driven embodied agents open a new attack…

Artificial Intelligence · Computer Science 2026-02-24 Qiusi Zhan , Hyeonjeong Ha , Rui Yang , Sirui Xu , Hanyang Chen , Liang-Yan Gui , Yu-Xiong Wang , Huan Zhang , Heng Ji , Daniel Kang

A Large Language Model (LLM) powered GUI agent is a specialized autonomous system that performs tasks on the user's behalf according to high-level instructions. It does so by perceiving and interpreting the graphical user interfaces (GUIs)…

Backdoor attacks pose a serious threat to the secure deployment of large language models (LLMs), enabling adversaries to implant hidden behaviors triggered by specific inputs. However, existing methods often rely on manually crafted…

Cryptography and Security · Computer Science 2025-11-24 Yige Li , Zhe Li , Wei Zhao , Nay Myat Min , Hanxun Huang , Xingjun Ma , Jun Sun

Large Vision-Language Models (LVLMs) empower autonomous mobile agents, yet their security under realistic mobile deployment constraints remains underexplored. While agents are vulnerable to visual prompt injections, stealthily executing…

Cryptography and Security · Computer Science 2026-04-10 Renhua Ding , Xiao Yang , Zhengwei Fang , Jun Luo , Kun He , Jun Zhu

The proliferation of open-weight Large Language Models (LLMs) has democratized agentic AI, yet fine-tuned weights are frequently shared and adopted with limited scrutiny beyond leaderboard performance. This creates a risk where third-party…

Cryptography and Security · Computer Science 2026-03-05 Bhanu Pallakonda , Mikkel Hindsbo , Sina Ehsani , Prag Mishra

Instruction tuning enhances large vision-language models (LVLMs) but increases their vulnerability to backdoor attacks due to their open design. Unlike prior studies in static settings, this paper explores backdoor attacks in LVLM…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Siyuan Liang , Jiawei Liang , Tianyu Pang , Chao Du , Aishan Liu , Mingli Zhu , Xiaochun Cao , Dacheng Tao

The rapid adoption of mobile graphical user interface (GUI) agents, which autonomously control applications and operating systems (OS), exposes new system-level attack surfaces. Existing backdoors against web GUI agents and general GenAI…

Cryptography and Security · Computer Science 2026-03-25 Yutao Luo , Haotian Zhu , Shuchao Pang , Zhigang Lu , Tian Dong , Yongbin Zhou , Minhui Xue

Vision-Language-Action (VLA) models have advanced robotic control by enabling end-to-end decision-making directly from multimodal inputs. However, their tightly coupled architectures expose novel security vulnerabilities. Unlike traditional…

Cryptography and Security · Computer Science 2025-05-23 Xueyang Zhou , Guiyao Tie , Guowen Zhang , Hechang Wang , Pan Zhou , Lichao Sun

Driven by the rapid development of Large Language Models (LLMs), LLM-based agents have been developed to handle various real-world applications, including finance, healthcare, and shopping, etc. It is crucial to ensure the reliability and…

Cryptography and Security · Computer Science 2024-10-30 Wenkai Yang , Xiaohan Bi , Yankai Lin , Sishuo Chen , Jie Zhou , Xu Sun

Large language models (LLMs) have demonstrated superior performance compared to previous methods on various tasks, and often serve as the foundation models for many researches and services. However, the untrustworthy third-party LLMs may…

Cryptography and Security · Computer Science 2024-04-02 Hai Huang , Zhengyu Zhao , Michael Backes , Yun Shen , Yang Zhang
‹ Prev 1 2 3 10 Next ›