English
Related papers

Related papers: SentinelAgent: Intent-Verified Delegation Chains f…

200 papers

As agentic AI systems increasingly operate autonomously, establishing trust through verifiable evaluation becomes critical. Yet existing benchmarks lack the transparency and auditability needed to assess whether agents behave reliably. We…

Computation and Language · Computer Science 2025-12-02 Hyunjun Kim , Sooyoung Ryu

Decentralized, agentic AI marketplaces are rapidly emerging to support software engineering tasks such as debugging, patch generation, and security auditing, often operating without centralized oversight. However, existing reputation…

Artificial Intelligence · Computer Science 2026-05-04 Mohd Sameen Chishti , Damilare Peter Oyinloye , Jingyue Li

Tool-using LLM agents must act on untrusted webpages, emails, files, and API outputs while issuing privileged tool calls. Existing defenses often mediate trust at the granularity of an entire tool invocation, forcing a brittle choice in…

Cryptography and Security · Computer Science 2026-05-13 Linfeng Fan , Ziwei Li , Yuan Tian , Yichen Wang , Rongsheng Li , Xiong Wang

Safety risks arise as large language model-based agents solve complex tasks with tools, multi-step plans, and inter-agent messages. However, deployer-written policies in natural language are ambiguous and context dependent, so they map…

Artificial Intelligence · Computer Science 2025-12-19 Yiliu Yang , Yilei Jiang , Qunzhong Wang , Yingshui Tan , Xiaoyong Zhu , Sherman S. M. Chow , Bo Zheng , Xiangyu Yue

Multi-agent systems increasingly expose explicit workflow structure: agents, tools, tool-access rules, restrictions, and delegation paths. Existing evaluations rely largely on end-to-end task success, benchmark scores, final-response…

Software Engineering · Computer Science 2026-05-27 Nafiseh Kahani , Mojtaba Bagherzadeh

Evolving AI systems increasingly deploy multi-agent architectures where autonomous agents collaborate, share information, and delegate tasks through developing protocols. This connectivity, while powerful, introduces novel security risks.…

Cryptography and Security · Computer Science 2025-07-30 Gauri Sharma , Vidhi Kulkarni , Miles King , Ken Huang

Topology optimization can generate efficient structures, but designers often must manually translate qualitative intent, such as desired visual style, product experience, or manufacturability into solver settings that are not directly tied…

Artificial Intelligence · Computer Science 2026-05-22 Isabella A. Stewart , Hongrui Chen , Faez Ahmed

Agentic AI systems increasingly act through tool-augmented, multi-step workflows whose failures (unsafe tool use, unauthorised actions, social harm) carry deployment-level consequences. Evaluation practice remains fragmented across isolated…

Computation and Language · Computer Science 2026-05-22 Jinhu Qi , Yifan Li , Minghao Zhao , Wentao Zhang , Zijian Zhang , Yaoman Li , Irwin King

Agentic AI systems automate enterprise workflows but existing defenses--guardrails, semantic filters--are probabilistic and routinely bypassed. We introduce authenticated workflows, the first complete trust layer for enterprise agentic AI.…

Cryptography and Security · Computer Science 2026-02-12 Mohan Rajagopalan , Vinay Rao

The Semantic Router DSL is a non-Turing-complete policy language deployed in production for per-request LLM inference routing: content signals (embedding similarity, PII detection, jailbreak scoring) feed into weighted projections and…

Machine Learning · Computer Science 2026-03-31 Huamin Chen , Xunzhuo Liu , Bowei He , Xue Liu

Modern AI agents execute real-world side effects through tool calls such as file operations, shell commands, HTTP requests, and database queries. A single unsafe action, including accidental deletion, credential exposure, or data…

Artificial Intelligence · Computer Science 2026-05-07 Chenglin Yang

AI agent protocols -- including MCP, A2A, ANP, and ACP -- enable autonomous agents to discover capabilities, delegate tasks, and compose services across trust boundaries. Despite massive deployment (MCP alone has 97M+ monthly SDK…

Cryptography and Security · Computer Science 2026-03-26 Shenghan Zheng , Qifan Zhang

Powerful autonomous systems, which reason, plan, and converse using and between numerous tools and agents, are made possible by Large Language Models (LLMs), Vision-Language Models (VLMs), and new agentic AI systems, like LangChain and…

Cryptography and Security · Computer Science 2025-12-30 Toqeer Ali Syed , Mishal Ateeq Almutairi , Mahmoud Abdel Moaty

We report a safety incident in a deployed multi-agent research system in which a primary AI agent installed 107 unauthorized software components, overwrote a system registry, overrode a prior negative decision from an oversight agent, and…

Cryptography and Security · Computer Science 2026-05-04 Diego F. Cuadros , Abdoul-Aziz Maiga

Penetration testing is critical for identifying and mitigating security vulnerabilities, yet traditional approaches remain expensive, time-consuming, and dependent on expert human labor. Recent work has explored AI-driven pentesting agents,…

Cryptography and Security · Computer Science 2025-09-16 Wuyuao Mai , Geng Hong , Qi Liu , Jinsong Chen , Jiarun Dai , Xudong Pan , Yuan Zhang , Min Yang

This position paper argues that securing LLM agents requires first defining an end-to-end correctness property that specifies when an agent's execution faithfully reflects the user's intent. Modern LLM agents operate over an…

Cryptography and Security · Computer Science 2026-05-19 Wenjie Qu , Ming Xu , Peiran Wang , Shengfang Zhai , Jiaheng Zhang , Dawn Song

The proliferation of autonomous AI agents capable of executing real-world actions - filesystem operations, API calls, database modifications, financial transactions - introduces a class of safety risk not addressed by existing…

Artificial Intelligence · Computer Science 2026-03-17 Florin Adrian Chitan

Metaverse allows users to delegate their AI models to an AI engine, which builds corresponding AI-driven avatars to provide immersive experience for other users. Since current authentication methods mainly focus on human-driven avatars and…

Cryptography and Security · Computer Science 2024-09-02 Kedi Yang , Zhenyong Zhang , Youliang Tian

AI agent frameworks connecting large language model (LLM) reasoning to host execution surfaces -- shell, filesystem, containers, and messaging -- introduce security challenges structurally distinct from conventional software. We present a…

Cryptography and Security · Computer Science 2026-05-15 Surada Suwansathit , Yuxuan Zhang , Guofei Gu

We introduce MemLineage, a defense for LLM agent memory that attaches both cryptographic provenance and LLM-mediated derivation lineage to every entry. Recent and concurrent work shows that untrusted content can be written into persistent…

Cryptography and Security · Computer Science 2026-05-15 Ciyan Ouyang , Rui Hou