English
Related papers

Related papers: AgentEval: DAG-Structured Step-Level Evaluation fo…

200 papers

Fault Localization (FL) is an essential step during the debugging process. With the strong capabilities of code comprehension, the recent Large Language Models (LLMs) have demonstrated promising performance in diagnosing bugs in the code.…

Software Engineering · Computer Science 2025-02-25 Yihao Qin , Shangwen Wang , Yiling Lou , Jinhao Dong , Kaixin Wang , Xiaoling Li , Xiaoguang Mao

Large language model agents increasingly operate through environment-facing scaffolds that expose files, web pages, APIs, and logs. These observations influence tool use, state tracking, and action sequencing, yet their reliability and…

Artificial Intelligence · Computer Science 2026-05-13 Strick Sheng , Ziyue Wang , Liyi Zhou

We study networked binary classification on a directed acyclic graph (DAG) where each agent observes only a subset of the feature columns of a shared dataset. Agents act sequentially along the DAG: each receives prediction columns from its…

Existing tool-use benchmarks for LLM agents are overwhelmingly linear: our analysis of six benchmarks shows 55 to 100% of instances are simple chains of 2 to 5 steps. We introduce The Amazing Agent Race (AAR), a benchmark featuring directed…

Artificial Intelligence · Computer Science 2026-04-20 Zae Myung Kim , Dongseok Lee , Jaehyung Kim , Vipul Raheja , Dongyeop Kang

Drug discovery frequently loses momentum when data, expertise, and tools are scattered, slowing design cycles. To shorten this loop we built a hierarchical, tool using agent framework that automates molecular optimisation. A Principal…

Machine Learning · Computer Science 2025-08-06 Atabey Ünlü , Phil Rohr , Ahmet Celebi

While AI agents demonstrate remarkable capabilities in reasoning and tool use, they remain fundamentally reactive: they compute responses only after explicit user prompts. This paradigm ignores a critical opportunity: the idle time between…

Computation and Language · Computer Science 2026-05-27 Haoyi Hu , Qirong Lyu , Xianghan Kong , Weiwen Liu , Jianghao Lin , Zixuan Guo , Yan Xu , Yasheng Wang , Weinan Zhang , Yong Yu

Dialogue policy plays an important role in task-oriented spoken dialogue systems. It determines how to respond to users. The recently proposed deep reinforcement learning (DRL) approaches have been used for policy optimization. However,…

Computation and Language · Computer Science 2019-05-28 Lu Chen , Zhi Chen , Bowen Tan , Sishan Long , Milica Gasic , Kai Yu

With the advancement of Agentic AI, researchers are increasingly leveraging autonomous agents to address challenges in software engineering (SE). However, the large language models (LLMs) that underpin these agents often function as black…

Software Engineering · Computer Science 2026-04-03 Jingyue Li , André Storhaug

We introduce TDFlow, a novel test-driven agentic workflow that frames repository-scale software engineering as a test-resolution task, specifically designed to solve human-written tests. Given a set of tests, TDFlow repeatedly proposes,…

Software Engineering · Computer Science 2026-01-23 Kevin Han , Siddharth Maddikayala , Tim Knappe , Om Patel , Austen Liao , Amir Barati Farimani

Large Language Models (LLMs) increasingly rely on agentic capabilities-iterative retrieval, tool use, and decision-making-to overcome the limits of static, parametric knowledge. Yet existing agentic frameworks treat external information as…

Computation and Language · Computer Science 2026-04-24 Yuanfu Sun , Kang Li , Dongzhe Fan , Jiajin Liu , Qiaoyu Tan

As the industry increasingly adopts agentic AI systems, understanding their unique vulnerabilities becomes critical. Prior research suggests that security flaws at the model level do not fully capture the risks present in agentic…

Artificial Intelligence · Computer Science 2025-09-23 Ilham Wicaksono , Zekun Wu , Rahul Patel , Theo King , Adriano Koshiyama , Philip Treleaven

While individual components of agentic architectures have been studied in isolation, there remains limited empirical understanding of how different design dimensions interact within complex multi-agent systems. This study aims to address…

Artificial Intelligence · Computer Science 2026-01-07 Tara Bogavelli , Roshnee Sharma , Hari Subramani

User comments on online programming platforms such as Stack Overflow play a vital role in maintaining the correctness and relevance of shared code examples. However, the majority of comments express gratitude or clarification, while only a…

Software Engineering · Computer Science 2026-04-27 Mehedi Hasan Shanto , Muhammad Asaduzzaman , Alioune Ngom

The application of Large Language Models (LLMs) in healthcare is expanding rapidly, with one potential use case being the translation of formal medical reports into patient-legible equivalents. Currently, LLM outputs often need to be edited…

Multiagent Systems · Computer Science 2024-08-06 Malavikha Sudarshan , Sophie Shih , Estella Yee , Alina Yang , John Zou , Cathy Chen , Quan Zhou , Leon Chen , Chinmay Singhal , George Shih

Large Language Models have evolved from single-round generators into long-horizon agents, capable of complex text synthesis scenarios. However, current evaluation frameworks lack the ability to assess the actual synthesis operations, such…

Computation and Language · Computer Science 2026-03-03 Andrew Zhuoer Feng , Cunxiang Wang , Yu Luo , Bosi Wen , Yidong Wang , Lin Fan , Yilin Zhou , Zikang Wang , Wenbo Yu , Lindong Wu , Hongning Wang , Minlie Huang

The rapid proliferation of Claude agent skills has raised the central question of how to effectively leverage, manage, and scale the agent skill ecosystem. In this paper, we propose AgentSkillOS, the first principled framework for skill…

Computation and Language · Computer Science 2026-03-03 Hao Li , Chunjiang Mu , Jianhao Chen , Siyue Ren , Zhiyao Cui , Yiqun Zhang , Lei Bai , Shuyue Hu

Leveraging multiple Large Language Models(LLMs) has proven effective for addressing complex, high-dimensional tasks, but current approaches often rely on static, manually engineered multi-agent configurations. To overcome these constraints,…

Machine Learning · Computer Science 2025-07-21 Xiaowen Ma , Chenyang Lin , Yao Zhang , Volker Tresp , Yunpu Ma

Enterprise agents increasingly operate inside scoped retrieval systems, delegated workflows, and policy-constrained evidence environments. In these settings, access control can be enforced correctly while the system still produces an answer…

Artificial Intelligence · Computer Science 2026-05-08 Krti Tallam

Despite remarkable advances in Large Language Model capabilities, tool retrieval for agent-based systems remains fundamentally limited by reliance on semantic similarity, which fails to capture functional viability. Current methods often…

Machine Learning · Computer Science 2025-10-22 Zongze Wu , Yani Guo , Churong Liang , Runnan Li

Modern AI agents execute real-world side effects through tool calls such as file operations, shell commands, HTTP requests, and database queries. A single unsafe action, including accidental deletion, credential exposure, or data…

Artificial Intelligence · Computer Science 2026-05-07 Chenglin Yang