English
Related papers

Related papers: Training Versatile Coding Agents in Synthetic Envi…

200 papers

LLM agents have demonstrated remarkable capabilities in software development, but their performance is hampered by long interaction contexts, which incur high API costs and latency. While various context compression approaches such as…

Software Engineering · Computer Science 2026-05-08 Yuhang Wang , Yuling Shi , Mo Yang , Rongrui Zhang , Shilin He , Heng Lian , Yuting Chen , Siyu Ye , Kai Cai , Xiaodong Gu

With the advent of AI agents, automatic scientific discovery has become a tenable goal. Many recent works scaffold agentic systems that can perform machine learning research, but don't offer a principled way to train such agents -- and…

Artificial Intelligence · Computer Science 2026-03-19 Ziyang Cai , Harkirat Behl

Developing multi-turn interactive tool-use agents is challenging because real-world user needs are often complex and ambiguous, yet agents must execute deterministic actions to satisfy them. To address this gap, we introduce \textbf{CoVe}…

Artificial Intelligence · Computer Science 2026-03-03 Jinpeng Chen , Cheng Gong , Hanbo Li , Ziru Liu , Zichen Tian , Xinyu Fu , Shi Wu , Chenyang Zhang , Wu Zhang , Suiyun Zhang , Dandan Tu , Rui Liu

Automating real-world software engineering tasks remains challenging for large language model (LLM)-based agents due to the need for long-horizon reasoning over large, evolving codebases and making consistent decisions across interdependent…

Software Engineering · Computer Science 2026-04-14 Mahir Labib Dihan , Md Ashrafur Rahman Khan

We introduce SWE-Bench Pro, a substantially more challenging benchmark that builds upon the best practices of SWE-BENCH [25], but is explicitly designed to capture realistic, complex, enterprise-level problems beyond the scope of SWE-BENCH.…

Many real-world problems are compositional - solving them requires completing interdependent sub-tasks, either in series or in parallel, that can be represented as a dependency graph. Deep reinforcement learning (RL) agents often struggle…

Machine Learning · Computer Science 2022-01-25 Izzeddin Gur , Natasha Jaques , Yingjie Miao , Jongwook Choi , Manoj Tiwari , Honglak Lee , Aleksandra Faust

In recent years, AI-based software engineering has progressed from pre-trained models to advanced agentic workflows, with Software Development Agents representing the next major leap. These agents, capable of reasoning, planning, and…

Software Engineering · Computer Science 2024-12-30 Zhi Chen , Lingxiao Jiang

While autonomous software engineering (SWE) agents are reshaping programming paradigms, they currently suffer from a "closed-world" limitation: they attempt to fix bugs from scratch or solely using local context, ignoring the immense…

Large language models have demonstrated strong capabilities in individual software engineering tasks, yet most autonomous systems still treat issue resolution as a monolithic or pipeline-based process. In contrast, real-world software…

Artificial Intelligence · Computer Science 2026-02-10 Nikita Benkovich , Vitalii Valkov

Developing high-performance software is a complex task that requires specialized expertise. We introduce GSO, a benchmark for evaluating language models' capabilities in developing high-performance software. We develop an automated pipeline…

Software Engineering · Computer Science 2025-10-28 Manish Shetty , Naman Jain , Jinjian Liu , Vijay Kethanaboyina , Koushik Sen , Ion Stoica

Large language models (LLMs) exhibit strong performance on self-contained programming tasks. However, they still struggle with repository-level software engineering (SWE), which demands (1) deep codebase navigation with effective context…

Software Engineering · Computer Science 2026-05-27 Kang He , Kaushik Roy

Auto-regressive LLM-based software engineering (SWE) agents, henceforth SWE agents, have made tremendous progress (>60% on SWE-Bench Verified) on real-world coding challenges including GitHub issue resolution. SWE agents use a combination…

Software Engineering · Computer Science 2025-04-15 Timothy Bula , Saurabh Pujar , Luca Buratti , Mihaela Bornea , Avirup Sil

SWE-Bench-Verified, a dataset comprising 500 issues, serves as a de facto benchmark for evaluating various large language models (LLMs) on their ability to resolve GitHub issues. But this benchmark may overlap with model training data. If…

Software Engineering · Computer Science 2025-12-23 Thanosan Prathifkumar , Noble Saji Mathews , Meiyappan Nagappan

Vibe coding is a new programming paradigm in which human engineers instruct large language model (LLM) agents to complete complex coding tasks with little supervision. Although vibe coding is increasingly adopted, are its outputs really…

Software Engineering · Computer Science 2026-02-18 Songwen Zhao , Danqing Wang , Kexun Zhang , Jiaxuan Luo , Zhuo Li , Lei Li

AI coding agents are being adopted at scale, yet we lack empirical evidence on how people actually use them and how much of their output is useful in practice. We present SWE-chat, the first large-scale dataset of real coding agent sessions…

Artificial Intelligence · Computer Science 2026-04-23 Joachim Baumann , Vishakh Padmakumar , Xiang Li , John Yang , Diyi Yang , Sanmi Koyejo

AI coding agents have shown great progress on Python software engineering benchmarks like SWE-Bench, and for other languages like Java and C in benchmarks like Multi-SWE-Bench. However, C# -- a prominent enterprise language ranking #5 in…

Software Engineering · Computer Science 2025-11-19 Sanket Mhatre , Yasharth Bajpai , Sumit Gulwani , Emerson Murphy-Hill , Gustavo Soares

High quality bugs are key to training the next generation of language model based software engineering (SWE) agents. We introduce a novel method for synthetic generation of difficult and diverse bugs. Our method instructs SWE Agents to…

AI agents have become increasingly capable at isolated software engineering (SWE) tasks such as resolving issues on Github. Yet long-horizon tasks involving multiple interdependent subtasks still pose challenges both with respect to…

Computation and Language · Computer Science 2026-03-24 Jiayi Geng , Graham Neubig

Large language model (LLM) based agents are increasingly used to tackle software engineering tasks that require multi-step reasoning and code modification, demonstrating promising yet limited performance. However, most existing LLM agents…

Artificial Intelligence · Computer Science 2025-11-11 Hiroaki Hayashi , Bo Pang , Wenting Zhao , Ye Liu , Akash Gokul , Srijan Bansal , Caiming Xiong , Semih Yavuz , Yingbo Zhou

The advancement of large language models (LLMs) and code agents has demonstrated significant potential to assist software engineering (SWE) tasks, such as autonomous issue resolution and feature addition. Existing AI for software…

Software Engineering · Computer Science 2025-09-22 Zhiyu Fan , Kirill Vasilevski , Dayi Lin , Boyuan Chen , Yihao Chen , Zhiqing Zhong , Jie M. Zhang , Pinjia He , Ahmed E. Hassan