English
Related papers

Related papers: Hybrid-Gym: Training Coding Agents to Generalize A…

200 papers

Artificial intelligence is increasingly used to simplify complex tasks. In engineering applications of structural health monitoring (SHM), existing specialized algorithms, while effective, often face high implementation barriers, limited…

Multiagent Systems · Computer Science 2026-05-14 Yuequan Bao , Xing Li , Huabin Sun , Dawei Liu , Yuxuan Tian , Haiyang Hu

We introduce AgentSynth, a scalable and cost-efficient pipeline for automatically synthesizing high-quality tasks and trajectory datasets for generalist computer-use agents. Leveraging information asymmetry, AgentSynth constructs subtasks…

Computation and Language · Computer Science 2026-03-03 Jingxu Xie , Dylan Xu , Xuandong Zhao , Dawn Song

Being engaging, knowledgeable, and empathetic are all desirable general qualities in a conversational agent. Previous work has introduced tasks and datasets that aim to help agents to learn those qualities in isolation and gauge how well…

Computation and Language · Computer Science 2020-04-21 Eric Michael Smith , Mary Williamson , Kurt Shuster , Jason Weston , Y-Lan Boureau

LLM agents are increasingly expected to function as general-purpose systems capable of resolving open-ended user requests. While existing benchmarks focus on domain-aware environments for developing specialized agents, evaluating…

Artificial Intelligence · Computer Science 2026-02-24 Xiaochuan Li , Ryan Ming , Pranav Setlur , Abhijay Paladugu , Andy Tang , Hao Kang , Shuai Shao , Rong Jin , Chenyan Xiong

Recent advances in vision-language models have enabled mobile GUI agents to perceive visual interfaces and execute user instructions, but reliable prediction of action consequences remains critical for long-horizon and high-risk…

Artificial Intelligence · Computer Science 2026-05-25 Weikai Xu , Kun Huang , Yunren Feng , Jiaxing Li , Yuhan Chen , Yuxuan Liu , Zhizheng Jiang , Heng Qu , Pengzhi Gao , Wei Liu , Jian Luan , Xiaolin Hu , Bo An

As artificial intelligence engineering paradigms shift from single-agent Prompt and Context Engineering toward multi-agent \textbf{Coordination Engineering}, the ability to codify and systematically improve how multiple agents collaborate…

Computation and Language · Computer Science 2026-05-18 Xinyu Zhang , Zhicheng Dou , Deyang Li , Jianjun Tao , Shuo Cheng , Ruifeng Shi , Fangchao Liu , Enrui Hu , Yangkai Ding , Hongbo Wang , Qi Ye , Xuefeng Jin , Zhangchun Zhao

Large language model (LLM) agents need to perform multi-turn interactions in real-world tasks. However, existing multi-turn RL algorithms for optimizing LLM agents fail to perform effective credit assignment over multiple turns while…

Machine Learning · Computer Science 2025-03-20 Yifei Zhou , Song Jiang , Yuandong Tian , Jason Weston , Sergey Levine , Sainbayar Sukhbaatar , Xian Li

Recent studies show that LLMs possess different skills and specialize in different tasks. In fact, we observe that their varied performance occur in several levels of granularity. For example, in the code optimization task, code LLMs excel…

Artificial Intelligence · Computer Science 2025-10-24 Yuanzhe Liu , Ryan Deng , Tim Kaler , Xuhao Chen , Charles E. Leiserson , Yao Ma , Jie Chen

Skills are a promising way to improve LLM agent capabilities without retraining, while keeping the added procedure reusable and controllable. However, high-quality skills are still largely written by hand. We introduce SkillGen, a…

Machine Learning · Computer Science 2026-05-13 Yuchen Ma , Yue Huang , Han Bao , Haomin Zhuang , Swadheen Shukla , Michel Galley , Xiangliang Zhang , Stefan Feuerriegel

Developing high-performance software is a complex task that requires specialized expertise. We introduce GSO, a benchmark for evaluating language models' capabilities in developing high-performance software. We develop an automated pipeline…

Software Engineering · Computer Science 2025-10-28 Manish Shetty , Naman Jain , Jinjian Liu , Vijay Kethanaboyina , Koushik Sen , Ion Stoica

Deep reinforcement learning has the potential to train robots to perform complex tasks in the real world without requiring accurate models of the robot or its environment. A practical approach is to train agents in simulation, and then…

Machine Learning · Computer Science 2022-10-26 Tianhong Dai , Kai Arulkumaran , Tamara Gerbert , Samyakh Tukra , Feryal Behbahani , Anil Anthony Bharath

Computer-use agents hold the promise of assisting in a wide range of digital economic activities. However, current research has largely focused on short-horizon tasks over a limited set of software with limited economic value, such as basic…

Machine Learning · Computer Science 2026-04-08 Pranjal Aggarwal , Graham Neubig , Sean Welleck

Recent advancements in software engineering agents have demonstrated promising capabilities in automating program improvements. However, their reliance on closed-source or resource-intensive models introduces significant deployment…

Software Engineering · Computer Science 2025-04-09 Yingwei Ma , Yongbin Li , Yihong Dong , Xue Jiang , Rongyu Cao , Jue Chen , Fei Huang , Binhua Li

Training generalist agents capable of adapting to diverse scenarios requires interactive environments for self-exploration. However, interactive environments remain critically scarce, and existing synthesis methods suffer from significant…

Artificial Intelligence · Computer Science 2026-02-09 Dunwei Tu , Hongyan Hao , Hansi Yang , Yihao Chen , Yi-Kai Zhang , Zhikang Xia , Yu Yang , Yueqing Sun , Xingchen Liu , Furao Shen , Qi Gu , Hui Su , Xunliang Cai

GUI agents that interact with graphical interfaces on behalf of users represent a promising direction for practical AI assistants. However, training such agents is hindered by the scarcity of suitable environments. We present InfiniteWeb, a…

Computation and Language · Computer Science 2026-01-09 Ziyun Zhang , Zezhou Wang , Xiaoyi Zhang , Zongyu Guo , Jiahao Li , Bin Li , Yan Lu

Even though demonstrating extraordinary capabilities in code generation and software issue resolving, AI agents' capabilities in the full software DevOps cycle are still unknown. Different from pure code generation, handling the DevOps…

For agentic systems to use external tools to solve complex, long-horizon tasks, we need a large set of diverse and controllable tool-use environments. We introduce SynthTools, a fully LLM-based pipeline spanning the entire lifecycle:…

Artificial Intelligence · Computer Science 2026-05-28 Tommaso Castellani , Naimeng Ye , Daksh Mittal , Thomson Yen , Emmanouil Koukoumidis , William Zeng , Hongseok Namkoong

Large real-world robot datasets hold great potential to train generalist robot models, but scaling real-world human data collection is time-consuming and resource-intensive. Simulation has great potential in supplementing large-scale data,…

We propose a new multi-agent task grammar to encode collaborative tasks for a team of heterogeneous agents that can have overlapping capabilities. The grammar allows users to specify the relationship between agents and parts of the task…

Robotics · Computer Science 2024-02-02 Amy Fang , Hadas Kress-Gazit

As autonomous coding agents become capable of handling increasingly long-horizon tasks, they have gradually demonstrated the potential to complete end-to-end software development. Although existing benchmarks have recently evolved from…

Software Engineering · Computer Science 2026-05-19 Qingnan Ren , Shun Zou , Shiting Huang , Ziao Zhang , Kou Shi , Zhen Fang , Yiming Zhao , Yu Zeng , Qisheng Su , Lin Chen , Yong Wang , Zehui Chen , Xiangxiang Chu , Feng Zhao