English
Related papers

Related papers: Too Helpful to Be Safe: User-Mediated Attacks on P…

200 papers

The rapid adoption of Large Language Model (LLM) agents and multi-agent systems enables remarkable capabilities in natural language processing and generation. However, these systems introduce security vulnerabilities that extend beyond…

Cryptography and Security · Computer Science 2026-05-12 Matteo Lupinacci , Francesco Aurelio Pironti , Francesco Blefari , Francesco Romeo , Luigi Arena , Angelo Furfaro

Coding agents, which are LLM-driven agents specialized in software development, have become increasingly prevalent in modern programming environments. Unlike traditional AI coding assistants, which offer simple code completion and…

Cryptography and Security · Computer Science 2025-09-30 Eunkyu Lee , Donghyeon Kim , Wonyoung Kim , Insu Yun

Policymakers must often act under conditions of deep uncertainty, such as emergency response, where predicting the specific impacts of a policy apriori is implausible. Large Language Model (LLM) agent simulations have been proposed as tools…

Human-Computer Interaction · Computer Science 2026-02-10 Yuxuan Li , Sauvik Das , Hirokazu Shirado

Tool-use large language model (LLM) agents are increasingly deployed to support sensitive workflows, relying on tool calls for retrieval, external API access, and session memory management. While prior research has examined various threats,…

Cryptography and Security · Computer Science 2026-04-08 Wuyang Zhang , Shichao Pei

The robustness of LLMs to jailbreak attacks, where users design prompts to circumvent safety measures and misuse model capabilities, has been studied primarily for LLMs acting as simple chatbots. Meanwhile, LLM agents -- which use external…

Large Language Model (LLM) Agents are an emerging computing paradigm that blends generative machine learning with tools such as code interpreters, web browsing, email, and more generally, external resources. These agent-based systems…

Cryptography and Security · Computer Science 2024-10-23 Xiaohan Fu , Shuheng Li , Zihan Wang , Yihao Liu , Rajesh K. Gupta , Taylor Berg-Kirkpatrick , Earlence Fernandes

As Large Language Model (LLM) agents increasingly operate in complex environments with real-world consequences, their safety becomes critical. While uncertainty quantification is well-studied for single-turn tasks, multi-turn agentic…

Computation and Language · Computer Science 2026-02-03 Vamshi Krishna Bonagiri , Ponnurangam Kumaragurum , Khanh Nguyen , Benjamin Plaut

Large language models (LLMs) are increasingly deployed as agents with access to executable tools, enabling direct interaction with external systems. However, most safety evaluations remain text-centric and assume that compliant language…

Software Engineering · Computer Science 2026-03-24 Shasha Yu , Fiona Carroll , Barry L. Bentley

Large Language Models (LLMs) are increasingly deployed as agents that orchestrate tasks and integrate external tools to execute complex workflows. We demonstrate that these interactive behaviors leave distinctive fingerprints in encrypted…

Cryptography and Security · Computer Science 2025-10-09 Yixiang Zhang , Xinhao Deng , Zhongyi Gu , Yihao Chen , Ke Xu , Qi Li , Jianping Wu

Large Language Model (LLM)-based agents are increasingly used as autonomous subordinates that carry out tasks for users. This raises the question of whether they may also engage in deception, similar to how individuals in human…

Large language models (LLMs) are now deployed at unprecedented scale, assisting millions of users in daily tasks. However, the risk of these models assisting unlawful activities remains underexplored. In this study, we define this high-risk…

Computers and Society · Computer Science 2025-11-27 Xing Wang , Huiyuan Xie , Yiyan Wang , Chaojun Xiao , Huimin Chen , Holli Sargeant , Felix Steffek , Jie Shao , Zhiyuan Liu , Maosong Sun

Autonomous agents based on large language models (LLMs) are rapidly emerging as a general-purpose technology, with recent systems such as OpenClaw extending their capabilities through broad tool use, third-party skills, and deeper…

Cryptography and Security · Computer Science 2026-05-15 Lukas Pirch , Micha Horlboge , Patrick Großmann , Syeda Mahnur Asif , Klim Kireev , Thorsten Holz , Konrad Rieck

Autonomous agents powered by large vision and language models (VLM) have demonstrated significant potential in completing daily computer tasks, such as browsing the web to book travel and operating desktop software, which requires agents to…

Computation and Language · Computer Science 2025-05-27 Yanzhe Zhang , Tao Yu , Diyi Yang

As the use of large language model (LLM) agents continues to grow, their safety vulnerabilities have become increasingly evident. Extensive benchmarks evaluate various aspects of LLM safety by defining the safety relying heavily on general…

Computation and Language · Computer Science 2025-10-24 Yeonjun In , Wonjoong Kim , Kanghoon Yoon , Sungchul Kim , Mehrab Tanjim , Sangwu Park , Kibum Kim , Chanyoung Park

Recent advances in AI agents capable of solving complex, everyday tasks, from scheduling to customer service, have enabled deployment in real-world settings, but their possibilities for unsafe behavior demands rigorous evaluation. While…

Artificial Intelligence · Computer Science 2026-02-18 Sanidhya Vijayvargiya , Aditya Bharat Soni , Xuhui Zhou , Zora Zhiruo Wang , Nouha Dziri , Graham Neubig , Maarten Sap

The growing adoption of large language models (LLMs) has led to a new paradigm in mobile computing--LLM-powered mobile AI agents--capable of decomposing and automating complex tasks directly on smartphones. However, the security…

Cryptography and Security · Computer Science 2025-05-21 Liangxuan Wu , Chao Wang , Tianming Liu , Yanjie Zhao , Haoyu Wang

Current evaluations of tool-integrated LLM agents typically focus on end-to-end tool-usage evaluation while neglecting their stability. This limits their real-world applicability, as various internal or external factors can cause agents to…

Computation and Language · Computer Science 2025-06-30 Weimin Xiong , Ke Wang , Yifan Song , Hanchao Liu , Sai Zhou , Wei Peng , Sujian Li

The widespread use of Large Language Model (LLM)-based conversational agents (CAs), especially in high-stakes domains, raises many privacy concerns. Building ethical LLM-based CAs that respect user privacy requires an in-depth understanding…

Human-Computer Interaction · Computer Science 2024-04-03 Zhiping Zhang , Michelle Jia , Hao-Ping Lee , Bingsheng Yao , Sauvik Das , Ada Lerner , Dakuo Wang , Tianshi Li

Recent improvement gains in large language models (LLMs) have lead to everyday usage of AI-based Conversational Agents (CAs). At the same time, LLMs are vulnerable to an array of threats, including jailbreaks and, for example, causing…

Cryptography and Security · Computer Science 2025-11-03 Kathrin Grosse , Nico Ebert

The acquisition of agentic capabilities has transformed LLMs from "knowledge providers" to "action executors", a trend that while expanding LLMs' capability boundaries, significantly increases their susceptibility to malicious use. Previous…

Cryptography and Security · Computer Science 2025-05-30 Jinchuan Zhang , Lu Yin , Yan Zhou , Songlin Hu