English
Related papers

Related papers: Willful Disobedience: Automatically Detecting Fail…

200 papers

As multi-agent AI systems are increasingly deployed in real-world settings - from automated customer support to DevOps remediation - failures become harder to diagnose due to cascading effects, hidden dependencies, and long execution…

Machine Learning · Computer Science 2026-03-30 Zhaohui Geoffrey Wang

Modern AI agents execute real-world side effects through tool calls such as file operations, shell commands, HTTP requests, and database queries. A single unsafe action, including accidental deletion, credential exposure, or data…

Artificial Intelligence · Computer Science 2026-05-07 Chenglin Yang

To enable human oversight, agentic AI systems often provide a trace of reasoning and action steps. Designing traces to have an informative, but not overwhelming, level of detail remains a critical challenge. In three user studies on a…

Human-Computer Interaction · Computer Science 2026-02-20 Madeleine Grunde-McLaughlin , Hussein Mozannar , Maya Murad , Jingya Chen , Saleema Amershi , Adam Fourney

AI agents often fail in ways that are difficult to localize because executions are probabilistic, long-horizon, multi-agent, and mediated by noisy tool outputs. We address this gap by manually annotating failed agent runs and release a…

Artificial Intelligence · Computer Science 2026-02-03 Shraddha Barke , Arnav Goyal , Alind Khare , Avaljot Singh , Suman Nath , Chetan Bansal

Language-model agent systems commonly rely on reactive prompting, in which a single instruction guides the model through an open-ended sequence of reasoning and tool-use steps, leaving control flow and intermediate state implicit and making…

Computation and Language · Computer Science 2026-04-16 Pengcheng Wang , Jerry Huang , Jiarui Yao , Rui Pan , Peizhi Niu , Yaowenqi Liu , Ruida Wang , Renhao Lu , Yuwei Guo , Tong Zhang

Agentic systems are becoming more capable: agents define strategies, take actions, and interact with different environments. This autonomy poses serious challenges for overseeing and assessing agent behavior. Most current tools are limited,…

Computation and Language · Computer Science 2026-05-22 Asaf Yehudai , Lilach Eden , Michal Shmueli-Scheuer

Agentic systems augment large language models with external tools and iterative decision making, enabling complex tasks such as deep research, function calling, and coding. However, their long and intricate execution traces make failure…

As autonomous agents become increasingly sophisticated, validating their sequential behavior presents a significant challenge. Traditional testing approaches require manual specification, exact sequence matching, or thousands of training…

Artificial Intelligence · Computer Science 2026-05-06 Reshabh K Sharma , Gaurav Mittal , Yu Hu

Agentic AI systems act through tools and evolve their behavior over long, stochastic interaction traces. This setting complicates assurance, because behavior depends on nondeterministic environments and probabilistic model outputs. Prior…

Artificial Intelligence · Computer Science 2026-02-02 Roham Koohestani , Ateş Görpelioğlu , Egor Klimov , Burcu Kulahcioglu Ozkan , Maliheh Izadi

Agent frameworks increasingly encode tool-using behavior as explicit workflow graphs, yet safety enforcement remains a runtime concern. These frameworks expose analyzable graph structure through their APIs, enabling pre-deployment static…

Logic in Computer Science · Computer Science 2026-03-24 Melwin Xavier , Vaisakh M A , Melveena Jolly , Midhun Xavier

In Agentic AI, Large Language Models (LLMs) are increasingly used in the orchestration layer to coordinate multiple agents and to interact with external services, retrieval components, and shared memory. In this setting, failures are not…

Multiagent Systems · Computer Science 2026-03-20 Ciprian Paduraru , Petru-Liviu Bouruc , Alin Stefanescu

While Large Language Models (LLMs) have evolved into tool-using agents, they remain brittle in long-horizon interactions. Unlike mathematical reasoning where errors are often rectifiable via backtracking, tool-use failures frequently induce…

Artificial Intelligence · Computer Science 2026-03-17 Shengda Fan , Xuyan Ye , Yupeng Huo , Zhi-Yuan Chen , Yiju Guo , Shenzhi Yang , Wenkai Yang , Shuqi Ye , Jingwen Chen , Haotian Chen , Xin Cong , Yankai Lin

Training trustworthy agentic LLMs requires data that shows the grounded reasoning process, not just the final answer. Existing datasets fall short: question-answering data is outcome-only, chain-of-thought data is not tied to specific…

Information Retrieval · Computer Science 2026-04-30 Saber Zerhoudi , Michael Granitzer , Jelena Mitrovic

Large language model agents now act on codebases, browsers, operating systems, calendars, files, and tool ecosystems, but their evaluations often collapse behavior into final task success. AgentAtlas reframes agent evaluation as a…

Artificial Intelligence · Computer Science 2026-05-27 Parsa Mazaheri , Kasra Mazaheri

We present an openly documented methodology for fine-tuning language models to detect temporal attack patterns in multi-agent AI workflows using OpenTelemetry trace analysis. We curate a dataset of 80,851 examples from 18 public…

Artificial Intelligence · Computer Science 2026-01-06 Ron F. Del Rosario

Third-party skills are becoming the package ecosystem for LLM agents. They package natural-language instructions, helper scripts, templates, documents, and service configuration into reusable workflows. This makes skills useful, but it also…

Cryptography and Security · Computer Science 2026-05-15 Haomin Zhuang , Hanwen Xing , Yujun Zhou , Yuchen Ma , Yue Huang , Yili Shen , Yufei Han , Xiangliang Zhang

The rapid growth of AI agent ecosystems is transforming how complex tasks are delegated and executed, creating a new challenge of identifying suitable agents for a given task. Unlike traditional tools, agent capabilities are often…

Artificial Intelligence · Computer Science 2026-04-27 Bin Wu , Arastun Mammadli , Xiaoyu Zhang , Emine Yilmaz

Recent autonomous AI agents such as Codex, and Claude Code have made it increasingly practical for users to delegate complex tasks, including writing emails, executing code, issuing shell commands, and carrying out multi-step plans.…

Human-Computer Interaction · Computer Science 2026-04-21 Haomin Zhuang , Hanwen Xing , Xiangliang Zhang

The increasing adoption of agentic workflows across diverse domains brings a critical need to scalably and systematically evaluate the complex traces these systems generate. Current evaluation methods depend on manual, domain-specific human…

Artificial Intelligence · Computer Science 2025-06-25 Darshan Deshpande , Varun Gangal , Hersh Mehta , Jitin Krishnan , Anand Kannappan , Rebecca Qian

Multi-agent systems achieve state-of-the-art outcomes through peer collaboration. However, when an agent in the pipeline silently drops a constraint, the system's final output may look correct even though the reasoning chain was quietly…

‹ Prev 1 2 3 10 Next ›