English
Related papers

Related papers: SlowBA: An efficiency backdoor attack towards VLM-…

200 papers

Vision-Language-Action (VLA) models are increasingly deployed in safety-critical robotic applications, yet their security vulnerabilities remain underexplored. We identify a fundamental security flaw in modern VLA systems: the combination…

Cryptography and Security · Computer Science 2026-01-22 Bingxin Xu , Yuzhang Shang , Binghui Wang , Emilio Ferrara

Large language models (LLMs) are increasingly deployed as educational agents for automatic short answer grading (ASAG) in real-world educational environments, significantly boosting assessment efficiency and scalability. However, when these…

Cryptography and Security · Computer Science 2026-05-25 Xueyi Li , Zhuoneng Zhou , Zitao Liu , Yongdong Wu

Web-use agents are rapidly being deployed to automate complex web tasks with extensive browser capabilities. However, these capabilities create a critical and previously unexplored attack surface. This paper demonstrates how attackers can…

Cryptography and Security · Computer Science 2025-10-22 Avishag Shapira , Parth Atulbhai Gandhi , Edan Habler , Asaf Shabtai

Large Vision-Language Models (VLMs) have achieved remarkable success in understanding complex real-world scenarios and supporting data-driven decision-making processes. However, VLMs exhibit significant vulnerability against adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Xiaosen Wang , Shaokang Wang , Zhijin Ge , Yuyang Luo , Shudong Zhang

Web agents, powered by large language models (LLMs), are increasingly deployed to automate complex web interactions. The rise of open-source frameworks (e.g., Browser Use, Skyvern-AI) has accelerated adoption, but also broadened the attack…

Cryptography and Security · Computer Science 2026-01-13 Xinyi Wu , Geng Hong , Yueyue Chen , MingXuan Liu , Feier Jin , Xudong Pan , Jiarun Dai , Baojun Liu

Autonomous graphical user interface (GUI) agents aim to facilitate task automation by interacting with the user interface without manual intervention. Recent studies have investigated eliciting the capabilities of large language models…

Computation and Language · Computer Science 2024-06-10 Zhuosheng Zhang , Aston Zhang

Self-evolving LLM agents update their internal state across sessions, often by writing and reusing long-term memory. This design improves performance on long-horizon tasks but creates a security risk: untrusted external content observed…

Cryptography and Security · Computer Science 2026-03-06 Xianglin Yang , Yufei He , Shuo Ji , Bryan Hooi , Jin Song Dong

When large language model (LLM) systems interact with external data to perform complex tasks, a new attack, namely prompt injection, becomes a significant threat. By injecting instructions into the data accessed by the system, the attacker…

Cryptography and Security · Computer Science 2025-08-26 Sizhe Chen , Yizhu Wang , Nicholas Carlini , Chawin Sitawarin , David Wagner

Large Language Models (LLMs) are increasingly used as code assistants, yet their behavior when explicitly asked to generate insecure code remains poorly understood. While prior research has focused on unintended vulnerabilities, this study…

Software Engineering · Computer Science 2025-07-24 Emir Bosnak , Sahand Moslemi , Mayasah Lami , Anil Koyuncu

Graphical User Interface (GUI) agents have demonstrated remarkable progress in automating complex user interface interactions through reinforcement learning. However, current approaches face a fundamental dilemma: offline RL enables stable…

Machine Learning · Computer Science 2025-09-25 Zhengxi Lu , Jiabo Ye , Fei Tang , Yongliang Shen , Haiyang Xu , Ziwei Zheng , Weiming Lu , Ming Yan , Fei Huang , Jun Xiao , Yueting Zhuang

Generative large vision-language models (LVLMs) have recently achieved impressive performance gains, and their user base is growing rapidly. However, the security of LVLMs, in particular in a long-context multi-turn setting, is largely…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Christian Schlarmann , Matthias Hein

Large Language Model (LLM) agents can leverage tools such as Google Search to complete complex tasks. However, this tool usage introduces the risk of indirect prompt injections, where malicious instructions hidden in tool outputs can…

Machine Learning · Computer Science 2025-10-08 Zizhao Wang , Dingcheng Li , Vaishakh Keshava , Phillip Wallis , Ananth Balashankar , Peter Stone , Lukas Rutishauser

Graphical user interface (GUI) agents powered by vision language models (VLMs) are rapidly moving from passive assistance to autonomous operation. However, this unrestricted action space exposes users to severe and irreversible financial,…

Machine Learning · Computer Science 2026-04-13 Yushi Feng , Junye Du , Qifan Wang , Zizhan Ma , Qian Niu , Yutaka Matsuo , Long Feng , Lequan Yu

Recent advances in transformer-based Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks. However, their quadratic computational complexity concerning sequence length remains a significant bottleneck…

Computation and Language · Computer Science 2025-06-05 Zichuan Fu , Wentao Song , Yejing Wang , Xian Wu , Yefeng Zheng , Yingying Zhang , Derong Xu , Xuetao Wei , Tong Xu , Xiangyu Zhao

Graph Prompt Learning (GPL) bridges significant disparities between pretraining and downstream applications to alleviate the knowledge transfer bottleneck in real-world graph learning. While GPL offers superior effectiveness in graph…

Machine Learning · Computer Science 2024-05-29 Xiaoting Lyu , Yufei Han , Wei Wang , Hangwei Qian , Ivor Tsang , Xiangliang Zhang

Vision-Language Navigation (VLN) aims to enable agents to navigate to a target location based on language instructions. Traditional VLN often follows a close-set assumption, i.e., training and test data share the same style of the input…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Yang Li , Aming Wu , Zihao Zhang , Yahong Han

Recent studies have shown that cooperative multi-agent deep reinforcement learning (c-MADRL) is under the threat of backdoor attacks. Once a backdoor trigger is observed, it will perform malicious actions leading to failures or malicious…

Artificial Intelligence · Computer Science 2025-07-21 Jing Fang , Saihao Yan , Xueyu Yin , Yinbo Yu , Chunwei Tian , Jiajia Liu

As AI agents powered by Large Language Models (LLMs) become increasingly versatile and capable of addressing a broad spectrum of tasks, ensuring their security has become a critical challenge. Among the most pressing threats are prompt…

Federated learning, while being a promising approach for collaborative model training, is susceptible to backdoor attacks due to its decentralized nature. Backdoor attacks have shown remarkable stealthiness, as they compromise model…

Machine Learning · Computer Science 2026-04-10 Zhengyuan Jiang , Xingyu Lyu , Shanghao Shi , Yang Xiao , Yimin Chen , Y. Thomas Hou , Wenjing Lou , Ning Wanga

The remarkable performance of large language models (LLMs) in generation tasks has enabled practitioners to leverage publicly available models to power custom applications, such as chatbots and virtual assistants. However, the data used to…

Artificial Intelligence · Computer Science 2025-03-28 Yuetai Li , Zhangchen Xu , Fengqing Jiang , Luyao Niu , Dinuka Sahabandu , Bhaskar Ramasubramanian , Radha Poovendran