English
Related papers

Related papers: Near-Miss: Latent Policy Failure Detection in Agen…

200 papers

LLM-based agents have recently attracted significant attention due to their ability to autonomously invoke relevant tools to accomplish complex tasks. However, recent studies have shown that these agents face severe security risks, which…

Cryptography and Security · Computer Science 2026-05-28 Jiaqi Luo , Songyang Peng , Jiarun Dai , Zhile Chen , Zhuoxiang Shen , Geng Hong , Xudong Pan , Yuan Zhang , Min Yang

Large Language Model (LLM)-based agents are increasingly adopted in high-stakes settings, but current benchmarks evaluate mainly whether a task was completed, not how. We introduce Procedure-Aware Evaluation (PAE), a framework that…

Artificial Intelligence · Computer Science 2026-03-04 Hongliu Cao , Ilias Driouich , Eoin Thomas

The rapid evolution to autonomous, agentic AI systems introduces significant risks due to their inherent unpredictability and emergent behaviors; this also renders traditional verification methods inadequate and necessitates a shift towards…

Artificial Intelligence · Computer Science 2025-09-30 Roham Koohestani

LLM-based multi-agent systems can fail even when planned actions are executed correctly because agents may misjudge their knowledge when evaluating plan feasibility, a phenomenon we term epistemic miscalibration in planning. Unlike…

Artificial Intelligence · Computer Science 2026-05-25 Zehao Wang , Shilong Jin , Zhao Cao , Lanjun Wang

We introduce a comprehensive validation framework for LLM-based agentic systems that provides systematic diagnosis and improvement of reliability failures. The framework includes fifteen failure-detection tools and two root-cause analysis…

Artificial Intelligence · Computer Science 2026-04-01 Hadar Mulian , Sergey Zeltyn , Ido Levy , Liane Galanti , Avi Yaeli , Segev Shlomov

LLM agents are expected to complete end-to-end units of work across software tools, business services, and local workspaces. Yet many agent benchmarks freeze a curated task set at release time and grade mainly the final response, making it…

Software Engineering · Computer Science 2026-05-04 Chenxin Li , Zhengyang Tang , Mingxin Huang , Yunlong Lin , Shijue Huang , Shengyuan Liu , Bowen Ye , Rang Li , Lei Li , Benyou Wang , Yixuan Yuan

Large language model (LLM) agents are increasingly used to interact with and execute tasks in dynamic environments. However, a critical yet overlooked limitation of these agents is that they, by default, assume a stationary context, failing…

Computation and Language · Computer Science 2026-04-17 Yize Cheng , Arshia Soltani Moakhar , Chenrui Fan , Parsa Hosseini , Kazem Faghih , Zahra Sodagar , Wenxiao Wang , Soheil Feizi

Web agents enable users to perform tasks on web browsers through natural language interaction. Evaluating web agents trajectories is an important problem, since it helps us determine whether the agent successfully completed the tasks.…

LLM agents rely heavily on high-quality trajectory data to guide their problem-solving behaviors, yet producing such data requires substantial task design, high-capacity model generation, and manual filtering. Despite the high cost of…

Cryptography and Security · Computer Science 2026-05-05 Wenlong Meng , Chen Gong , Terry Yue Zhuo , Fan Zhang , Kecen Li , Zheng Liu , Zhou Yang , Chengkun Wei , Wenzhi Chen

Agentic systems have transformed how Large Language Models (LLMs) can be leveraged to create autonomous systems with goal-directed behaviors, consisting of multi-step planning and the ability to interact with different environments. These…

Artificial Intelligence · Computer Science 2026-01-27 Judy Zhu , Dhari Gandhi , Himanshu Joshi , Ahmad Rezaie Mianroodi , Sedef Akinli Kocak , Dhanesh Ramachandran

As LLMs are increasingly deployed as agents, agentic reasoning - the ability to combine tool use, especially search, and reasoning - becomes a critical skill. However, it is hard to disentangle agentic reasoning when evaluated in complex…

Artificial Intelligence · Computer Science 2025-10-03 Hanlin Zhu , Tianyu Guo , Song Mei , Stuart Russell , Nikhil Ghosh , Alberto Bietti , Jiantao Jiao

Multi-agent LLM systems have become the dominant production workload, but the serving stack was not built for them. The agent framework above knows agent identities, role, schemas, and dispatch structure but never sees an engine-level…

Artificial Intelligence · Computer Science 2026-05-28 Rui Zhang , Chaeeun Kim , Liting Hu

Why do language agents fail on tasks they are capable of solving? We argue that many such failures are reliability failures caused by stochastic drift from a task's latent solution structure, not capability failures. Every well-defined…

Computation and Language · Computer Science 2026-02-24 Wilson Y. Lee

Safe deployment of Large Language Model (LLM) agents in autonomous settings requires reliable oversight mechanisms. A central challenge is detecting scheming, where agents covertly pursue misaligned goals. One approach to mitigating such…

Computation and Language · Computer Science 2026-03-03 Simon Storf , Rich Barton-Cooper , James Peters-Gill , Marius Hobbhahn

Large language model-based multi-agent systems have shown great abilities across various tasks due to the collaboration of expert agents, each focusing on a specific domain. However, the impact of clumsy or even malicious agents--those who…

Artificial Intelligence · Computer Science 2025-05-30 Jen-tse Huang , Jiaxu Zhou , Tailin Jin , Xuhui Zhou , Zixi Chen , Wenxuan Wang , Youliang Yuan , Michael R. Lyu , Maarten Sap

Evaluating Large Language Models (LLMs) as general-purpose agents is essential for understanding their capabilities and facilitating their integration into practical applications. However, the evaluation process presents substantial…

Computation and Language · Computer Science 2024-12-25 Chang Ma , Junlei Zhang , Zhihao Zhu , Cheng Yang , Yujiu Yang , Yaohui Jin , Zhenzhong Lan , Lingpeng Kong , Junxian He

Web agents powered by large language models (LLMs) can autonomously perform complex, multistep tasks in dynamic web environments. However, current evaluations mostly focus on the overall success while overlooking intermediate errors. This…

Artificial Intelligence · Computer Science 2025-09-19 Daniel Röder , Akhil Juneja , Roland Roller , Sven Schmeier

Multi-agent systems (MAS) extend large language models (LLMs) from independent single-model reasoning to coordinative system-level intelligence. While existing LLM agents depend on text-based mediation for reasoning and communication, we…

Computation and Language · Computer Science 2025-12-09 Jiaru Zou , Xiyuan Yang , Ruizhong Qiu , Gaotang Li , Katherine Tieu , Pan Lu , Ke Shen , Hanghang Tong , Yejin Choi , Jingrui He , James Zou , Mengdi Wang , Ling Yang

AI agents are increasingly embedded in real software systems, where they execute multi-step workflows through multi-turn dialogue, tool invocations, and intermediate decisions. These long execution histories, called agentic traces, make…

Software Engineering · Computer Science 2026-05-12 Reshabh K Sharma , Shraddha Barke , Benjamin Zorn

LLM agents are rapidly evolving from coding assistants into autonomous software engineering systems. However, existing evaluation methodologies remain largely centered on static, isolated, and short-horizon benchmarks that fail to capture…

Software Engineering · Computer Science 2026-05-28 Yipeng Ouyang , Xin Huang , Bingjie Liu , Zhongchun Zheng , Yuhao Gu , Xianwei Zhang