English
Related papers

Related papers: What Do Agents Learn from Trajectory-SFT: Semantic…

200 papers

Recent advances in large language models (LLMs) and agent system designs have empowered agents with unprecedented levels of capability. However, existing agent benchmarks are showing a trend of rapid ceiling-hitting by newly developed…

Artificial Intelligence · Computer Science 2026-03-25 Dadi Guo , Tianyi Zhou , Dongrui Liu , Chen Qian , Qihan Ren , Shuai Shao , Zhiyuan Fan , Yi R. Fung , Kun Wang , Linfeng Zhang , Jing Shao

Large language models (LLMs) are increasingly leveraged to empower autonomous agents to simulate human beings in various fields of behavioral research. However, evaluating their capacity to navigate complex social interactions remains a…

Computation and Language · Computer Science 2024-11-26 Xinyi Mou , Jingcong Liang , Jiayu Lin , Xinnong Zhang , Xiawei Liu , Shiyue Yang , Rong Ye , Lei Chen , Haoyu Kuang , Xuanjing Huang , Zhongyu Wei

Existing benchmarks do not test language agents on their interaction with human users or ability to follow domain-specific rules, both of which are vital for deploying them in real world applications. We propose $\tau$-bench, a benchmark…

Artificial Intelligence · Computer Science 2024-06-19 Shunyu Yao , Noah Shinn , Pedram Razavi , Karthik Narasimhan

When deployed, AI agents will encounter problems that are beyond their autonomous problem-solving capabilities. Leveraging human assistance can help agents overcome their inherent limitations and robustly cope with unfamiliar situations. We…

Machine Learning · Computer Science 2022-06-24 Khanh Nguyen , Yonatan Bisk , Hal Daumé

AI agent research spans a wide spectrum: from RL agents that learn from scratch to foundation model agents that leverage pre-trained knowledge, yet no unified benchmark enables fair comparison across these approaches. We present Agentick, a…

Artificial Intelligence · Computer Science 2026-05-14 Roger Creus Castanyer , Pablo Samuel Castro , Glen Berseth

LLM agents excel in compact environments requiring deep reasoning but remain brittle when operating in broader, more complex contexts that demand robustness across diverse tools and schemas. Building bespoke environments for training is…

Artificial Intelligence · Computer Science 2025-11-04 Yuetai Li , Huseyin A Inan , Xiang Yue , Wei-Ning Chen , Lukas Wutschitz , Janardhan Kulkarni , Radha Poovendran , Robert Sim , Saravan Rajmohan

Computer-use agents provide a promising path toward general software automation because they can interact directly with arbitrary graphical user interfaces instead of relying on brittle, application-specific integrations. Despite recent…

Artificial Intelligence · Computer Science 2026-05-01 Jinbiao Wei , Kangqi Ni , Yilun Zhao , Guo Gan , Arman Cohan

AI agents are increasingly deployed to execute important tasks. While rising accuracy scores on standard benchmarks suggest rapid progress, many agents still continue to fail in practice. This discrepancy highlights a fundamental limitation…

Artificial Intelligence · Computer Science 2026-02-24 Stephan Rabanser , Sayash Kapoor , Peter Kirgis , Kangheng Liu , Saiteja Utpala , Arvind Narayanan

Graphical User Interface (GUI) agents can automate complex tasks across digital environments, but their development is hindered by the scarcity of high-quality trajectory data for training. Existing approaches rely on expensive human…

Computation and Language · Computer Science 2025-03-04 Yiheng Xu , Dunjie Lu , Zhennan Shen , Junli Wang , Zekun Wang , Yuchen Mao , Caiming Xiong , Tao Yu

Interactive Machine Learning is concerned with creating systems that operate in environments alongside humans to achieve a task. A typical use is to extend or amplify the capabilities of a human in cognitive or physical ways, requiring the…

Machine Learning · Computer Science 2019-02-05 Miguel Alonso

Large Language Model agents are increasingly augmented with agent skills. Current evaluation methods for skills remain limited. Most deployed benchmarks report only pass rate before and after a skill is attached, treating the skill as a…

Artificial Intelligence · Computer Science 2026-05-13 Xiaolin Zhou , Jinbo Liu , Li Li , Ryan A. Rossi , Xiyang Hu

Large Language Model agents increasingly operate external systems through programmatic interfaces, yet practitioners lack empirical guidance on how to structure the context these agents consume. Using SQL generation as a proxy for…

Computation and Language · Computer Science 2026-02-13 Damon McMillan

AI evaluation is undergoing a structural change. Large language models (LLMs) are increasingly deployed as systems that act over time through tools, environments, users, and other agents, while many evaluation practices still inherit…

Artificial Intelligence · Computer Science 2026-05-19 Keyang Xuan , Peiyang Song , Pan Lu , Pengrui Han , Wenkai Li , Zhenyu Zhang , Zexue He , Wenyue Hua , Manling Li , Jiaxuan You , Adrian Weller , Yizhong Wang , Jiaxin Pei

In model-based learning, an agent's model is commonly defined over transitions between consecutive states of an environment even though planning often requires reasoning over multi-step timescales, with intermediate states either…

Machine Learning · Computer Science 2020-10-06 Alexey Zakharov , Matthew Crosby , Zafeirios Fountas

Modern agents built on frontier language models often cannot adapt their weights. What, then, remains trainable? We argue it is the agent's \emph{workspace}, the structured external substrate it reads, writes, and tests; we call its…

Artificial Intelligence · Computer Science 2026-05-12 Elad Sarafian , Gal Kaplun , Ron Banner , Daniel Soudry , Boris Ginsburg

The rapid progress of large foundation models has accelerated the development of task-specialized agents across diverse domains. However, the effectiveness of agents remains tightly coupled with the quality of training data, while curating…

Artificial Intelligence · Computer Science 2026-02-04 Yeonsung Jung , Trilok Padhi , Sina Shaham , Dipika Khullar , Joonhyun Jeong , Ninareh Mehrabi , Eunho Yang

Behavioral studies of LLM-based software engineering agents extract operational rules about which trajectory shapes correlate with higher resolution rates: that a test step follows a code modification, that error cascades are short, or that…

Software Engineering · Computer Science 2026-05-19 Wei Ma , Zhi Chen , Jingxu Gu , Tianling Li , Shangqing Liu , Lingxiao Jiang

Large language model (LLM) agents accumulate rich episodic trajectories while solving real-world tasks, but it remains unclear whether such experience can be distilled into reusable procedural skills. We introduce SkillEvolBench, a…

The rapid development of large language and multimodal models has sparked significant interest in using proprietary models, such as GPT-4o, to develop autonomous agents capable of handling real-world scenarios like web navigation. Although…

Computation and Language · Computer Science 2024-10-28 Hongliang He , Wenlin Yao , Kaixin Ma , Wenhao Yu , Hongming Zhang , Tianqing Fang , Zhenzhong Lan , Dong Yu

Agentic systems are evaluated on benchmarks where agents interact with environments to solve tasks. Most papers report a pass@1 score computed from a single run per task, assuming this gives a reliable performance estimate. We test this…

Machine Learning · Computer Science 2026-03-26 Bjarni Haukur Bjarnason , André Silva , Martin Monperrus