English
Related papers

Related papers: Live-SWE-agent: Can Software Engineering Agents Se…

200 papers

Reinforcement learning with verifiable rewards improves reasoning in large language models (LLMs), but many methods still rely on large human-labeled datasets. While self-play reduces this dependency, it often lacks explicit planning and…

Artificial Intelligence · Computer Science 2026-03-18 Yulin Peng , Xinxin Zhu , Chenxing Wei , Nianbo Zeng , Leilei Wang , Ying Tiffany He , F. Richard Yu

Large Language Models (LLMs) have transformed software development and AI applications. While LLMs are designed for text processing, LLM agents extend this capability by enabling autonomous actions, tool use, and multi-step task completion.…

Software Engineering · Computer Science 2026-04-21 Niful Islam , Muhammad Anas Raza , Mohammad Wardat

Autoregressive Large Language Models (AR-LLMs) are widely used in software engineering (SE) but face limitations in processing code structure information and suffer from high inference latency. Diffusion LLMs (DLLMs) offer a promising…

Software Engineering · Computer Science 2025-10-07 Jingyao Zhang , Tianlin Li , Xiaoyu Zhang , Qiang Hu , Bin Shi

Recent advances in language model (LM) agents have demonstrated significant potential for automating complex real-world tasks. To make progress on these difficult tasks, LM agent architectures have become increasingly complex, often…

Computation and Language · Computer Science 2025-05-14 Mingjian Jiang , Yangjun Ruan , Luis Lastras , Pavan Kapanipathi , Tatsunori Hashimoto

Automating the adaptation of software engineering (SE) research artifacts across datasets is essential for scalability and reproducibility, yet it remains largely unstudied. Recent advances in large language model (LLM)-based multi-agent…

Software Engineering · Computer Science 2025-11-27 Jingyi Chen , Xiaoyan Guo , Songqiang Chen , Shing-Chi Cheung , Jiasi Shen

The rise of (multimodal) large language models (LLMs) has shed light on software agent -- where software can understand and follow user instructions in natural language. However, existing approaches such as API-based and GUI-based agents…

Software Engineering · Computer Science 2025-02-10 Mengwei Xu

Code generation agents powered by large language models (LLMs) are revolutionizing the software development paradigm. Distinct from previous code generation techniques, code generation agents are characterized by three core features. 1)…

Software Engineering · Computer Science 2025-10-01 Yihong Dong , Xue Jiang , Jiaru Qian , Tian Wang , Kechi Zhang , Zhi Jin , Ge Li

In this technical report, we present SWE-Master, an open-source and fully reproducible post-training framework for building effective software engineering agents. SWE-Master systematically explores the complete agent development pipeline,…

We present SWE-Gym, the first environment for training real-world software engineering (SWE) agents. SWE-Gym contains 2,438 real-world Python task instances, each comprising a codebase with an executable runtime environment, unit tests, and…

Software Engineering · Computer Science 2025-06-09 Jiayi Pan , Xingyao Wang , Graham Neubig , Navdeep Jaitly , Heng Ji , Alane Suhr , Yizhe Zhang

Large Language Models (LLMs) in Software Engineering (SE) can offer assistance for coding. To facilitate a rigorous evaluation of LLMs in practical coding contexts, Carlos et al. introduced the SWE-bench dataset, which comprises 2,294…

Software Engineering · Computer Science 2024-10-11 Reem Aleithan , Haoran Xue , Mohammad Mahdi Mohajer , Elijah Nnorom , Gias Uddin , Song Wang

Autonomous agents powered by large language models (LLMs) have the potential to significantly enhance human productivity by reasoning, using tools, and executing complex tasks in diverse environments. However, current approaches to…

Achieving mastery in real world software engineering tasks is fundamentally bottlenecked by the scarcity of large scale, high quality training data. Scaling such data has been limited by the complexity of environment setup, unit test…

Large language models have demonstrated strong capabilities in individual software engineering tasks, yet most autonomous systems still treat issue resolution as a monolithic or pipeline-based process. In contrast, real-world software…

Artificial Intelligence · Computer Science 2026-02-10 Nikita Benkovich , Vitalii Valkov

Large language models (LLMs) have shown strong reasoning and coding capabilities, yet they struggle to generalize to real-world software engineering (SWE) problems that are long-horizon and out of distribution. Existing systems often rely…

Machine Learning · Computer Science 2026-01-05 Iris Xu , Guangtao Zeng , Zexue He , Charles Jin , Aldo Pareja , Dan Gutfreund , Chuang Gan , Zhang-Wei Hong

This paper presents a benchmark self-evolving framework to dynamically evaluate rapidly advancing Large Language Models (LLMs), aiming for a more accurate assessment of their capabilities and limitations. We utilize a multi-agent system to…

Computation and Language · Computer Science 2024-02-20 Siyuan Wang , Zhuohan Long , Zhihao Fan , Zhongyu Wei , Xuanjing Huang

The rapid advancement of large language models (LLMs) has significantly enhanced the capabilities of AI-driven agents across various tasks. However, existing agentic systems, whether based on fixed pipeline algorithms or pre-defined…

Artificial Intelligence · Computer Science 2025-06-03 Xunjian Yin , Xinyi Wang , Liangming Pan , Li Lin , Xiaojun Wan , William Yang Wang

This paper provides a survey of the emerging area of Large Language Models (LLMs) for Software Engineering (SE). It also sets out open research challenges for the application of LLMs to technical problems faced by software engineers. LLMs'…

Software Engineering · Computer Science 2023-11-14 Angela Fan , Beliz Gokkaya , Mark Harman , Mitya Lyubarskiy , Shubho Sengupta , Shin Yoo , Jie M. Zhang

Large Language Models (LLMs) have achieved remarkable capabilities, yet their improvement methods remain fundamentally constrained by human design. We present Self-Developing, a framework that enables LLMs to autonomously discover,…

Computation and Language · Computer Science 2025-06-11 Yoichi Ishibashi , Taro Yano , Masafumi Oyamada

Software Engineering (SE) is the systematic design, development, maintenance, and management of software applications underpinning the digital infrastructure of our modern world. Very recently, the SE community has seen a rapidly increasing…

Software Engineering · Computer Science 2024-09-10 Quanjun Zhang , Chunrong Fang , Yang Xie , Yaxin Zhang , Yun Yang , Weisong Sun , Shengcheng Yu , Zhenyu Chen

Evaluating large language models (LLMs) for software engineering has been limited by narrow task coverage, language bias, and insufficient alignment with real-world developer workflows. Existing benchmarks often focus on algorithmic…