English
Related papers

Related papers: Training Versatile Coding Agents in Synthetic Envi…

200 papers

LLM-powered coding agents are redefining how real-world software is developed. To drive the research towards better coding agents, we require challenging benchmarks that can rigorously evaluate the ability of such agents to perform various…

Significant progress has been made in scene understanding which seeks to build 3D, metric and object-oriented representations of the world. Concurrently, reinforcement learning has made impressive strides largely enabled by advances in…

Robotics · Computer Science 2020-11-23 Zachary Ravichandran , J. Daniel Griffith , Benjamin Smith , Costas Frost

Agentic Software Engineering (SE 3.0) represents a new era where intelligent agents are tasked not with simple code generation, but with achieving complex, goal-oriented SE objectives. To harness these new capabilities while ensuring…

Software Engineering · Computer Science 2025-09-24 Ahmed E. Hassan , Hao Li , Dayi Lin , Bram Adams , Tse-Hsun Chen , Yutaro Kashiwa , Dong Qiu

The development of Multimodal Virtual Agents has made significant progress through the integration of Multimodal Large Language Models. However, mainstream training paradigms face key challenges: Behavior Cloning is simple and effective…

Machine Learning · Computer Science 2026-01-06 Keyu Wang , Bingchen Miao , Wendong Bu , Yu Wu , Juncheng Li , Shengyu Zhang , Wenqiao Zhang , Siliang Tang , Jun Xiao , Yueting Zhuang

Terminal agents have demonstrated strong potential for autonomous command-line execution, yet their training remains constrained by the scarcity of high-quality and diverse execution trajectories. Existing approaches mitigate this…

Artificial Intelligence · Computer Science 2026-04-29 Zhiyuan Fan , Tinghao Yu , Yuanjun Cai , Jiangtao Guan , Yun Yang , Dingxin Hu , Jiang Zhou , Xing Wu , Zhuo Han , Feng Zhang , Lilin Wang

Web-based 'deep research' agents aim to solve complex question - answering tasks through long-horizon interactions with online tools. These tasks remain challenging, as the underlying language models are often not optimized for long-horizon…

Computation and Language · Computer Science 2025-10-17 Shrey Pandit , Xuan-Phi Nguyen , Yifei Ming , Austin Xu , Jiayu Wang , Caiming Xiong , Shafiq Joty

The vision of an inclusive World Wide Web is impeded by a severe linguistic divide, particularly for communities in low-resource regions of Southeast Asia. While large language models (LLMs) offer a potential solution for translation, their…

Computation and Language · Computer Science 2026-03-23 Zhixiang Lu , Chong Zhang , Yulong Li , Angelos Stefanidis , Anh Nguyen , Imran Razzak , Jionglong Su , Zhengyong Jiang

Goal-directed Reinforcement Learning (RL) traditionally considers an agent interacting with an environment, prescribing a real-valued reward to an agent proportional to the completion of some goal. Goal-directed RL has seen large gains in…

Machine Learning · Computer Science 2020-10-28 Sharath Chandra Raparthy , Bhairav Mehta , Florian Golemo , Liam Paull

Long-horizon code generation requires sustained context and adaptive expertise across domains. Current multi-agent systems use static workflows that cannot adapt when runtime analysis reveals unanticipated complexity. We propose AgentSpawn,…

Software Engineering · Computer Science 2026-02-10 Igor Costa

Visual grounding is the task of localising image regions from natural language queries and is critical for reasoning capable Graphical User Interface agents. Many existing methods rely on massive, noisy synthetic datasets. This work…

Artificial Intelligence · Computer Science 2025-11-17 Georgios Pantazopoulos , Eda B. Özyiğit

Gamification has been applied in software engineering to improve quality and results by increasing people's motivation and engagement. A systematic mapping has identified research gaps in the field, one of them being the difficulty of…

Software Engineering · Computer Science 2024-02-02 Óscar Pedreira , Félix García , Mario Piattini , Alejandro Cortiñas , Ana Cerdeira-Pena

Today's software engineering (SE) complexities require a more diverse tool set going beyond technical expertise to be able to successfully tackle all challenges. Previous studies have indicated that creativity is a prime indicator for…

Software Engineering · Computer Science 2025-02-06 Wouter Groeneveld

Reinforcement learning (RL) has demonstrated notable success in post-training large language models (LLMs) as agents for tasks such as computer use, tool calling, and coding. However, exploration remains a central challenge in RL for LLM…

Machine Learning · Computer Science 2026-03-03 Andrew Szot , Michael Kirchhof , Omar Attia , Alexander Toshev

Behaviors of the synthetic characters in current military simulations are limited since they are generally generated by rule-based and reactive computational models with minimal intelligence. Such computational models cannot adapt to…

Artificial Intelligence · Computer Science 2021-01-07 Volkan Ustun , Rajay Kumar , Adam Reilly , Seyed Sajjadi , Andrew Miller

Self-adaptive robotic systems operate autonomously in dynamic and uncertain environments, requiring robust real-time monitoring and adaptive behaviour. Unlike traditional robotic software with predefined logic, self-adaptive robots exploit…

Large Language Models (LLMs) are reshaping almost all industries, including software engineering. In recent years, a number of LLM agents have been proposed to solve real-world software problems. Such software agents are typically equipped…

Software Engineering · Computer Science 2025-11-25 Chunqiu Steven Xia , Zhe Wang , Yan Yang , Yuxiang Wei , Lingming Zhang

Reinforcement learning (RL) has emerged as a powerful paradigm for improving large language models beyond supervised fine-tuning, yet sustaining performance gains at scale remains an open challenge, as data diversity and structure, rather…

Machine Learning · Computer Science 2026-03-26 Cansu Sancaktar , David Zhang , Gabriel Synnaeve , Taco Cohen

Recent research builds various patching agents that combine large language models (LLMs) with non-ML tools and achieve promising results on the state-of-the-art (SOTA) software patching benchmark, SWE-bench. Based on how to determine the…

Robotics · Computer Science 2025-06-12 Hongwei Li , Yuheng Tang , Shiqi Wang , Wenbo Guo

Large language models are increasingly expected to serve as general-purpose agents that interact with external, stateful tool environments. The Model Context Protocol (MCP) and broader agent skills offer a unified interface for connecting…

Recent work on designing an appropriate distribution of environments has shown promise for training effective generally capable agents. Its success is partly because of a form of adaptive curriculum learning that generates environment…

Artificial Intelligence · Computer Science 2023-07-26 Dexun Li , Wenjun Li , Pradeep Varakantham