English
Related papers

Related papers: Too Helpful to Be Safe: User-Mediated Attacks on P…

200 papers

Large language model (LLM) based search agents iteratively generate queries, retrieve external information, and reason to answer open-domain questions. While researchers have primarily focused on improving their utility, their safety…

Computation and Language · Computer Science 2026-03-24 Qiusi Zhan , Angeline Budiman-Chan , Abdelrahman Zayed , Xingzhi Guo , Daniel Kang , Joo-Kyung Kim

Large language models (LLMs)-powered AI agents exhibit a high level of autonomy in addressing medical and healthcare challenges. With the ability to access various tools, they can operate within an open-ended action space. However, with the…

Cryptography and Security · Computer Science 2025-04-08 Jianing Qiu , Lin Li , Jiankai Sun , Hao Wei , Zhe Xu , Kyle Lam , Wu Yuan

Autonomous agents powered by large language models (LLMs) show promising potential in assistive tasks across various domains, including mobile device control. As these agents interact directly with personal information and device settings,…

Machine Learning · Computer Science 2026-01-28 Juyong Lee , Dongyoon Hahm , June Suk Choi , W. Bradley Knox , Kimin Lee

Recently, the powerful large language models (LLMs) have been instrumental in propelling the progress of recommender systems (RS). However, while these systems have flourished, their susceptibility to security threats has been largely…

Computation and Language · Computer Science 2024-06-06 Jinghao Zhang , Yuting Liu , Qiang Liu , Shu Wu , Guibing Guo , Liang Wang

Large language models (LLMs) are increasingly deployed as tool-using agents, shifting safety concerns from harmful text generation to harmful task completion. Deployed systems often condition on user profiles or persistent memory, yet agent…

Artificial Intelligence · Computer Science 2026-03-18 Caglar Yildirim

The integration of Large Language Model (LLM)-based conversational agents into vehicles creates novel security challenges at the intersection of agentic AI, automotive safety, and inter-agent communication. As these intelligent assistants…

Artificial Intelligence · Computer Science 2026-02-06 Lukas Stappen , Ahmet Erkan Turan , Johann Hagerer , Georg Groh

Agents based on Large Language Models (LLMs) are increasingly being deployed as interfaces to information on online platforms. These agents filter, prioritize, and synthesize information retrieved from the platforms' back-end databases or…

Computation and Language · Computer Science 2026-02-18 Mohammad Aflah Khan , Mahsa Amani , Soumi Das , Bishwamittra Ghosh , Qinyuan Wu , Krishna P. Gummadi , Manish Gupta , Abhilasha Ravichander

Safety evaluations of large language models (LLMs) typically focus on universal risks like dangerous capabilities or undesirable propensities. However, millions use LLMs for personal advice on high-stakes topics like finance and health,…

Artificial Intelligence · Computer Science 2026-04-21 Manon Kempermann , Sai Suresh Macharla Vasu , Mahalakshmi Raveenthiran , Theo Farrell , Ingmar Weber

Given the growing influence of language model-based agents on high-stakes societal decisions, from public policy to healthcare, ensuring their beneficial impact requires understanding the far-reaching implications of their suggestions. We…

Artificial Intelligence · Computer Science 2025-06-27 Chenkai Sun , Denghui Zhang , ChengXiang Zhai , Heng Ji

With the fast development of large language models (LLMs), LLM-driven Web Agents (Web Agents for short) have obtained tons of attention due to their superior capability where LLMs serve as the core part of making decisions like the human…

Cryptography and Security · Computer Science 2024-02-28 Fangzhou Wu , Shutong Wu , Yulong Cao , Chaowei Xiao

Large language model (LLM) agents are increasingly deployed to automate productivity tasks (e.g., email, scheduling, document management), but evaluating them on live services is risky due to potentially irreversible changes. Existing…

Large Language Models (LLMs) have demonstrated strong capabilities as autonomous agents through tool use, planning, and decision-making abilities, leading to their widespread adoption across diverse tasks. As task complexity grows,…

Multiagent Systems · Computer Science 2025-11-10 Ishan Kavathekar , Hemang Jain , Ameya Rathod , Ponnurangam Kumaraguru , Tanuja Ganu

Language model (LM) agents that act on users' behalf for personal tasks (e.g., replying emails) can boost productivity, but are also susceptible to unintended privacy leakage risks. We present the first study on people's capacity to oversee…

Human-Computer Interaction · Computer Science 2025-10-07 Zhiping Zhang , Bingcan Guo , Tianshi Li

While large language models (LLMs) exhibit remarkable capabilities across a wide range of tasks, they pose potential safety concerns, such as the ``jailbreak'' problem, wherein malicious instructions can manipulate LLMs to exhibit…

Computation and Language · Computer Science 2024-03-05 Yue Deng , Wenxuan Zhang , Sinno Jialin Pan , Lidong Bing

Current Large Language Models (LLMs) are gradually exploited in practically valuable agentic workflows such as Deep Research, E-commerce recommendation, and job recruitment. In these applications, LLMs need to select some optimal solutions…

Computers and Society · Computer Science 2026-03-23 Zichen Tang , Zirui Zhang , Qian Wang , Zhenheng Tang , Bo Li , Xiaowen Chu

Most discussions about Large Language Model (LLM) safety have focused on single-agent settings but multi-agent LLM systems now create novel adversarial risks because their behavior depends on communication between agents and decentralized…

Multiagent Systems · Computer Science 2025-10-10 Rana Muhammad Shahroz Khan , Zhen Tan , Sukwon Yun , Charles Fleming , Tianlong Chen

Web-use agents are rapidly being deployed to automate complex web tasks with extensive browser capabilities. However, these capabilities create a critical and previously unexplored attack surface. This paper demonstrates how attackers can…

Cryptography and Security · Computer Science 2025-10-22 Avishag Shapira , Parth Atulbhai Gandhi , Edan Habler , Asaf Shabtai

Large Language Model (LLM) agents are increasingly being deployed as conversational assistants capable of performing complex real-world tasks through tool integration. This enhanced ability to interact with external systems and process…

Cryptography and Security · Computer Science 2024-12-24 Feiran Jia , Tong Wu , Xin Qin , Anna Squicciarini

Personal AI agents like OpenClaw run with elevated privileges on users' local machines, where a single successful prompt injection can leak credentials, redirect financial transactions, or destroy files. This threat goes well beyond…

Artificial Intelligence · Computer Science 2026-04-07 Bowen Wei , Yunbei Zhang , Jinhao Pan , Kai Mei , Xiao Wang , Jihun Hamm , Ziwei Zhu , Yingqiang Ge

Large Language Model (LLM)-enabled agents are rapidly emerging across a wide range of applications, but their deployment introduces vulnerabilities with security implications. While prior work has examined prompt-based attacks (e.g., prompt…

Cryptography and Security · Computer Science 2025-08-26 Derek Lilienthal , Sanghyun Hong