English
Related papers

Related papers: AgentGuard: Runtime Verification of AI Agents

200 papers

Securing Agentic Artificial Intelligence (AI) systems requires addressing the complex cyber risks introduced by autonomous, decision-making, and adaptive behaviors. Agentic AI systems are increasingly deployed across industries,…

Cryptography and Security · Computer Science 2025-12-23 Sunil Arora , John Hastings

Prior work on trustworthy AI emphasizes model-internal properties such as bias mitigation, adversarial robustness, and interpretability. As AI systems evolve into autonomous agents deployed in open environments and increasingly connected to…

Artificial Intelligence · Computer Science 2026-05-06 Wenyue Hua , Tianyi Peng , Chi Wang , Jiaxin Pei , Ian Kaufman , Bryan Lim , Chandler Fang

Agentic AI systems are emerging as powerful tools for automating complex, multi-step tasks across various industries. One such industry is telecommunications, where the growing complexity of next-generation radio access networks (RANs)…

Networking and Internet Architecture · Computer Science 2026-04-16 Sotiris Chatzimiltis , Mahdi Boloursaz Mashhadi , Mohammad Shojafar , Merouane Debbah , Rahim Tafazolli

AI agents dynamically acquire tools, orchestrate sub-agents, and transact across organizational boundaries, yet no existing security layer verifies what an agent can do, whether it executed what it claims, or what happened in a multi-agent…

Cryptography and Security · Computer Science 2026-03-23 Ziling Zhou

Traditional static cybersecurity models often struggle with scalability, real-time detection, and contextual responsiveness in the current digital product ecosystems which include cloud services, application programming interfaces (APIs),…

Artificial Intelligence · Computer Science 2025-10-03 Oluwakemi T. Olayinka , Sumeet Jeswani , Divine Iloh

Agentic AI systems present both significant opportunities and novel risks due to their capacity for autonomous action, encompassing tasks such as code execution, internet interaction, and file modification. This poses considerable…

Artificial Intelligence · Computer Science 2025-12-30 Shaun Khoo , Jessica Foo , Roy Ka-Wei Lee

Artificial intelligence (AI) systems are increasingly adopted as tool-using agents that can plan, observe their environment, and take actions over extended time periods. This evolution challenges current evaluation practices where the AI…

Cryptography and Security · Computer Science 2026-03-17 Simone Aonzo , Merve Sahin , Aurélien Francillon , Daniele Perito

The emergence of Agentic AI systems has outpaced the architectural thinking required to operate them effectively. These agents differ fundamentally from traditional software: their behavior is not fixed at deployment but continuously shaped…

Software Engineering · Computer Science 2026-01-13 Shaunak Biswas , Hiya Bhatt , Karthik Vaidhyanathan

Probabilistic model checking is a technique for formal automated reasoning about software or hardware systems that operate in the context of uncertainty or stochasticity. It builds upon ideas and techniques from a diverse range of fields,…

Logic in Computer Science · Computer Science 2023-08-08 David Parker

Autonomous AI agents extend large language models into full runtime systems that load skills, ingest external content, maintain memory, plan multi-step actions, and invoke privileged tools. In such systems, security failures rarely remain…

Cryptography and Security · Computer Science 2026-04-28 Yixiang Zhang , Xinhao Deng , Jiaqing Wu , Yue Xiao , Ke Xu , Qi Li

AI agents are AI systems that can achieve complex goals autonomously. Assessing the level of agent autonomy is crucial for understanding both their potential benefits and risks. Current assessments of autonomy often focus on specific risks…

Artificial Intelligence · Computer Science 2025-02-24 Peter Cihon , Merlin Stein , Gagan Bansal , Sam Manning , Kevin Xu

Agentic AI systems plan, use tools, maintain state, and produce multi-step trajectories with external effects. Those properties create a governance problem that differs materially from single-turn generative AI: important risks emerge dur-…

Artificial Intelligence · Computer Science 2026-04-08 Christopher Koch

AI agents, specifically powered by large language models, have demonstrated exceptional capabilities in various applications where precision and efficacy are necessary. However, these agents come with inherent risks, including the potential…

Cryptography and Security · Computer Science 2025-03-04 Ishaan Domkundwar , Mukunda N S , Ishaan Bhola , Riddhik Kochhar

The endowment of AI with reasoning capabilities and some degree of agency is widely viewed as a path toward more capable and generalizable systems. Our position is that the current development of agentic AI requires a more holistic,…

Contemporary benchmarks for agentic artificial intelligence (AI) frequently evaluate safety through isolated task-level accuracy thresholds, implicitly treating autonomous systems as single points of failure. This single-channel paradigm…

Computers and Society · Computer Science 2026-02-24 Nelu D. Radpour

Agentic AI systems - capable of goal interpretation, world modeling, planning, tool use, long-horizon operation, and autonomous coordination - introduce distinct control failures not addressed by existing safety frameworks. We identify six…

Computers and Society · Computer Science 2026-03-05 Subramanyam Sahoo

AI agents have been boosted by large language models. AI agents can function as intelligent assistants and complete tasks on behalf of their users with access to tools and the ability to execute commands in their environments. Through…

Cryptography and Security · Computer Science 2024-12-19 Yifeng He , Ethan Wang , Yuyang Rong , Zifei Cheng , Hao Chen

Artificial Intelligence (AI) agents have rapidly evolved from specialized, rule-based programs to versatile, learning-driven autonomous systems capable of perception, reasoning, and action in complex environments. The explosion of data,…

AI agents are increasingly used to solve complex, multi-step tasks, but existing multi-agent frameworks remain brittle as workflows grow in scale and depth. Small errors at intermediate stages can propagate through agent interactions, while…

Artificial Intelligence · Computer Science 2026-05-26 Andy Xu , Yu-Wing Tai

We take the position that agent security must be approached as a systems problem: the AI model powering the agent must be treated as an untrusted component, and security invariants must be enforced at the system level. Through this lens,…