English
Related papers

Related papers: Trustworthy Agentic AI Requires Deterministic Arch…

200 papers

For over a decade, cybersecurity has relied on human labor scarcity to limit attackers to high-value targets manually or generic automated attacks at scale. Building sophisticated exploits requires deep expertise and manual effort, leading…

Cryptography and Security · Computer Science 2026-02-04 Terry Yue Zhuo , Yangruibo Ding , Wenbo Guo , Ruijie Meng

Agentic AI systems -- Large Language Models (LLMs) augmented with planning, tool use, memory, and long-horizon interactions -- can execute complex tasks autonomously, but their multi-step trajectories introduce new failure modes that…

Artificial Intelligence · Computer Science 2026-05-26 Jinhu Qi , Muzhi Li , Jiahong Liu , Yuqin Shu , Dianzhi Yu , Shicheng Ma , Wenqian Cui , Yiyang Zhao , Yiyi Chen , Ruoxi Jiang , Irwin King , Zenglin Xu

The April 2026 disclosure that a frontier large language model escaped its security sandbox, executed unauthorized actions, and concealed its modifications to version control history demonstrates that agentic AI systems with autonomous tool…

Cryptography and Security · Computer Science 2026-04-28 Richard Joseph Mitchell

Deploying agentic AI in regulated contexts requires principled reasoning about two design dimensions: agency (what the system can do) and autonomy (how much it acts without human involvement). Though often treated independently, they are…

Artificial Intelligence · Computer Science 2026-05-13 Damir Safin , Dian Balta

The field of Artificial Intelligence is undergoing a transition from Generative AI -- probabilistic generation of text and images -- to Agentic AI, in which autonomous systems execute actions within external environments on behalf of users.…

Artificial Intelligence · Computer Science 2026-03-02 Sheng Cao , Zhao Chang , Chang Li , Hannan Li , Liyao Fu , Ji Tang

As large language models are increasingly deployed as interacting agents in high-stakes decisions, the AI safety community assumes that safety properties of individual models will compose into safe multi-agent behavior. This position paper…

Artificial Intelligence · Computer Science 2026-05-05 Tanav Singh Bajaj , Nikhil Singh , Karan Anand , Eishkaran Singh

This article, a lightly adapted version of Perplexity's response to NIST/CAISI Request for Information 2025-0035, details our observations and recommendations concerning the security of frontier AI agents. These insights are informed by…

Machine Learning · Computer Science 2026-04-07 Ninghui Li , Kaiyuan Zhang , Kyle Polley , Jerry Ma

This position paper argues that enforcing LLM agent safety within a single abstraction layer is not merely suboptimal but categorically insufficient for deployed LLM agents -- a structural consequence of how agent execution works, not a…

Artificial Intelligence · Computer Science 2026-05-19 S. Bensalem , Y. Dong , M. Franzle , X. Huang , J. Kroger , D. Nickovic , A. Nouri , R. Roy , C. Wu

Cybersecurity is being fundamentally reshaped by foundation-model-based artificial intelligence. Large language models now enable autonomous planning, tool orchestration, and strategic adaptation at scale, challenging security architectures…

Cryptography and Security · Computer Science 2025-12-30 Tao Li , Quanyan Zhu

As LLM-based systems increasingly operate as agents embedded within human social and technical systems, alignment can no longer be treated as a property of an isolated model, but must be understood in relation to the environments in which…

Large language models (LLMs) can now translate a researcher's plain-language goal into executable computation, yet scientific workflows demand determinism, provenance, and governance that are difficult to guarantee when an LLM decides what…

The security discussion around agentic AI focuses heavily on prompt injection. This paper argues that multi-agent systems also create a distinct authorization problem: maintaining authorization invariants as non-human principals retrieve…

Artificial Intelligence · Computer Science 2026-05-08 Krti Tallam

Modern cloud and enterprise systems rely on identity-centric authorization, assuming that callers possessing valid credentials are safe to execute commands. The emergence of autonomous AI agents invalidates this assumption: agents can…

Artificial Intelligence · Computer Science 2026-05-18 Jun He , Deying Yu

Agentic AI systems automate enterprise workflows but existing defenses--guardrails, semantic filters--are probabilistic and routinely bypassed. We introduce authenticated workflows, the first complete trust layer for enterprise agentic AI.…

Cryptography and Security · Computer Science 2026-02-12 Mohan Rajagopalan , Vinay Rao

Agentic AIs $-$ AIs that are capable and permitted to undertake complex actions with little supervision $-$ mark a new frontier in AI capabilities and raise new questions about how to safely create and align such systems with users,…

Computers and Society · Computer Science 2024-10-04 Hayley Clatterbuck , Clinton Castro , Arvo Muñoz Morán

As Artificial Intelligence (AI) systems increasingly assume consequential decision-making roles, a widening gap has emerged between technical capabilities and institutional accountability. Ethical guidance alone is insufficient to counter…

Artificial Intelligence · Computer Science 2025-12-12 Byeong Ho Kang , Wenli Yang , Muhammad Bilal Amin

We outline the principles of classical assurance for computer-based systems that pose significant risks. We then consider application of these principles to systems that employ Artificial Intelligence (AI) and Machine Learning (ML). A key…

Artificial Intelligence · Computer Science 2025-06-04 Robin Bloomfield , John Rushby

Autonomous agentic systems are increasingly deployed in regulated, high-stakes domains where decisions may be irreversible and institutionally constrained. Existing safety approaches emphasize alignment, interpretability, or action-level…

Multiagent Systems · Computer Science 2026-02-17 Jose Manuel de la Chica Rodriguez , Juan Manuel Vera Díaz

AI agents dynamically acquire tools, orchestrate sub-agents, and transact across organizational boundaries, yet no existing security layer verifies what an agent can do, whether it executed what it claims, or what happened in a multi-agent…

Cryptography and Security · Computer Science 2026-03-23 Ziling Zhou

Agentic AI systems powered by large language models (LLMs) and endowed with planning, tool use, memory, and autonomy, are emerging as powerful, flexible platforms for automation. Their ability to autonomously execute tasks across web,…

Artificial Intelligence · Computer Science 2026-04-07 Anshuman Chhabra , Shrestha Datta , Shahriar Kabir Nahin , Prasant Mohapatra
‹ Prev 1 2 3 10 Next ›