English
Related papers

Related papers: A Systematic Security Evaluation of OpenClaw and I…

200 papers

In recent years, Large-Language-Model-driven AI agents have exhibited unprecedented intelligence and adaptability. Nowadays, agents are undergoing a new round of evolution. They no longer act as an isolated island like LLMs. Instead, they…

Autonomous agents powered by large language models introduce a class of execution-layer vulnerabilities -- prompt injection, retrieval poisoning, and uncontrolled tool invocation -- that existing guardrails fail to address systematically.…

Cryptography and Security · Computer Science 2026-03-11 Yuxu Ge

Large Language Model (LLM) agents can leverage tools such as Google Search to complete complex tasks. However, this tool usage introduces the risk of indirect prompt injections, where malicious instructions hidden in tool outputs can…

Machine Learning · Computer Science 2025-10-08 Zizhao Wang , Dingcheng Li , Vaishakh Keshava , Phillip Wallis , Ananth Balashankar , Peter Stone , Lukas Rutishauser

Agentic AI systems introduce a security surface that is qualitatively different from that of stateless LLMs. They persist memory, invoke external tools, coordinate with peer agents, and operate across sessions, allowing attacks to emerge…

Cryptography and Security · Computer Science 2026-05-07 Kexin Chu

Tool-enabled AI agents are increasingly deployed in cloud-hosted environments and offered as services, where they perform side-effecting operations through privileged tools within execution environments. While such agents enable powerful…

Cryptography and Security · Computer Science 2026-05-12 Hardik Goel

Artificial intelligence (AI) systems are increasingly adopted as tool-using agents that can plan, observe their environment, and take actions over extended time periods. This evolution challenges current evaluation practices where the AI…

Cryptography and Security · Computer Science 2026-03-17 Simone Aonzo , Merve Sahin , Aurélien Francillon , Daniele Perito

The integration of Large Language Model (LLM)-based conversational agents into vehicles creates novel security challenges at the intersection of agentic AI, automotive safety, and inter-agent communication. As these intelligent assistants…

Artificial Intelligence · Computer Science 2026-02-06 Lukas Stappen , Ahmet Erkan Turan , Johann Hagerer , Georg Groh

Large language model (LLM) agents are increasingly used for complex tasks, yet deployed agents often remain static, failing to adapt as user needs evolve. This creates a tension between the need for continuous service and the necessity of…

Machine Learning · Computer Science 2026-03-19 Peng Xia , Jianwen Chen , Xinyu Yang , Haoqin Tu , Jiaqi Liu , Kaiwen Xiong , Siwei Han , Shi Qiu , Haonian Ji , Yuyin Zhou , Zeyu Zheng , Cihang Xie , Huaxiu Yao

The rapid rise of autonomous AI systems and advancements in agent capabilities are introducing new risks due to reduced oversight of real-world interactions. Yet agent testing remains nascent and is still a developing science. As AI agents…

AI scientists powered by large language models have demonstrated substantial promise in autonomously conducting experiments and facilitating scientific discoveries across various disciplines. While their capabilities are promising, these…

The rapid advancements in Large Language Models (LLMs) have enabled their deployment as autonomous agents for handling complex tasks in dynamic environments. These LLMs demonstrate strong problem-solving capabilities and adaptability to…

Artificial Intelligence · Computer Science 2025-02-19 Weidi Luo , Shenghong Dai , Xiaogeng Liu , Suman Banerjee , Huan Sun , Muhao Chen , Chaowei Xiao

Generative Artificial Intelligence (GenAI) presents significant advancements but also introduces novel security challenges, particularly within agentic workflows where AI agents operate autonomously. These risks escalate in multi-agent…

Cryptography and Security · Computer Science 2025-06-24 Sunil Kumar Jang Bahadur , Gopala Dhar

Large language model (LLM) agents are vulnerable to prompt-injection attacks that propagate through multi-step workflows, tool interactions, and persistent context, making input-output filtering alone insufficient for reliable protection.…

Artificial Intelligence · Computer Science 2026-04-21 Hailin Liu , Eugene Ilyushin , Jie Ni , Min Zhu

Securing Agentic Artificial Intelligence (AI) systems requires addressing the complex cyber risks introduced by autonomous, decision-making, and adaptive behaviors. Agentic AI systems are increasingly deployed across industries,…

Cryptography and Security · Computer Science 2025-12-23 Sunil Arora , John Hastings

Artificial intelligence (AI) systems are revolutionizing fields such as medicine, drug discovery, and materials science; however, many technologists and policymakers are also concerned about the technology's risks. To date, most concrete…

Computers and Society · Computer Science 2026-01-30 Prateek Puri

The autonomous AI agents using large language models can create undeniable values in all span of the society but they face security threats from adversaries that warrants immediate protective solutions because trust and safety issues arise.…

Cryptography and Security · Computer Science 2025-06-13 Saikat Barua , Mostafizur Rahman , Md Jafor Sadek , Rafiul Islam , Shehenaz Khaled , Ahmedul Kabir

With the rise of large language and vision-language models, AI agents have evolved into autonomous, interactive systems capable of perception, reasoning, and decision-making. As they proliferate across virtual and physical domains, the…

Cryptography and Security · Computer Science 2025-05-15 Yuntao Wang , Yanghe Pan , Shaolong Guo , Zhou Su

LLM-based agents are increasingly deployed in multi-agent systems (MAS). As these systems move toward real-world applications, their security becomes paramount. Existing research largely evaluates single-agent security, leaving a critical…

Multiagent Systems · Computer Science 2025-11-17 Nirmit Arora , Sathvik Joel , Ishan Kavathekar , Palak , Rohan Gandhi , Yash Pandya , Tanuja Ganu , Aditya Kanade , Akshay Nambi

Recent works have identified a gap between research and practice in artificial intelligence security: threats studied in academia do not always reflect the practical use and security risks of AI. For example, while models are often studied…

Cryptography and Security · Computer Science 2024-03-27 Kathrin Grosse , Lukas Bieringer , Tarek Richard Besold , Alexandre Alahi

Large language and vision-language models increasingly power agents that act on a user's behalf through command-line interface (CLI) harnesses. However, most agent benchmarks still rely on synthetic sandboxes, short-horizon tasks,…