English
Related papers

Related papers: Beyond Fixed Tests: Repository-Level Issue Resolut…

200 papers

Rigorous software testing is crucial for developing and maintaining high-quality code, making automated test generation a promising avenue for both improving software quality and boosting the effectiveness of code generation methods.…

Software Engineering · Computer Science 2025-02-10 Niels Mündler , Mark Niklas Müller , Jingxuan He , Martin Vechev

Experience-driven self-evolving agents aim to overcome the static nature of large language models by distilling reusable experience from past interactions, thus enabling adaptation to novel tasks at deployment time. This process places…

Artificial Intelligence · Computer Science 2026-05-12 Zhiyuan Fan , Wenwei Jin , Feng Zhang , Bin Li , Yihong Dong , Yao Hu , Jiawei Li

While large language models (LLMs) have demonstrated strong performance on complex reasoning tasks such as competitive programming (CP), existing methods predominantly focus on single-attempt settings, overlooking their capacity for…

Artificial Intelligence · Computer Science 2026-04-02 Shaopeng Fu , Xingxing Zhang , Li Dong , Di Wang , Furu Wei

Large Language Model (LLM)-guided evolutionary search is increasingly used for automated algorithm discovery, yet most current methods track search progress primarily through executable programs and scalar fitness. Even when…

Computation and Language · Computer Science 2026-05-11 Sichun Luo , Yi Huang , Haochen Luo , Fengyuan Liu , Guanzhi Deng , Lei Li , Qinghua Yao , Zefa Hu , Junlan Feng , Qi Liu

Software engineers operating in complex and dynamic environments must continuously adapt to evolving requirements, learn iteratively from experience, and reconsider their approaches based on new insights. However, current large language…

Artificial Intelligence · Computer Science 2025-04-03 Antonis Antoniades , Albert Örwall , Kexun Zhang , Yuxi Xie , Anirudh Goyal , William Wang

Existing datasets for coding agents evaluate performance on isolated, single pull request (PR) tasks in a stateless manner, failing to capture the reality of real-world software development where code changes accumulate, technical debt…

Software Engineering · Computer Science 2026-04-06 KN Ajay Shastry , Ganesh Senrayan , Shrey Satapara , Pranoy Panda , Chaitanya Devaguptapu

Existing benchmarks for AI coding agents focus on isolated, single-issue tasks such as fixing a bug or adding a small feature. However, real-world software engineering is a long-horizon endeavor: developers interpret high-level…

Software Engineering · Computer Science 2026-05-25 Tue Le , Minh V. T. Thai , Dung Nguyen Manh , Huy Phan Nhat , Nghi D. Q. Bui

Reinforcement learning with verifiable rewards (RLVR) has advanced the reasoning capabilities of large language models. However, existing methods rely solely on outcome rewards, without explicitly optimizing verification or leveraging…

Software Engineering · Computer Science 2025-10-22 Yiyang Jin , Kunzhao Xu , Hang Li , Xueting Han , Yanmin Zhou , Cheng Li , Jing Bai

Recent advances in large language model (LLM) agents have shown remarkable progress in software issue resolution, leveraging advanced techniques such as multi-agent collaboration and Monte Carlo Tree Search (MCTS). However, current agents…

Software Engineering · Computer Science 2026-02-03 Silin Chen , Shaoxin Lin , Yuling Shi , Heng Lian , Xiaodong Gu , Longfei Yun , Dong Chen , Lin Cao , Jiyang Liu , Nu Xia , Qianxiang Wang

Large Language Model (LLM) agents are increasingly improved through interaction, yet most self-evolution methods adapt either the policy or the learning environment in isolation. We identify this structural gap as \emph{Agent-Environment…

Computation and Language · Computer Science 2026-05-26 Yihao Hu , Zhihao Wen , Xiujin Liu , Pan Wang , Xin Zhang , Wei Wu

Vision-language agents have achieved remarkable progress in a variety of multimodal reasoning tasks; however, their learning remains constrained by the limitations of human-annotated supervision. Recent self-rewarding approaches attempt to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Jiaqi Liu , Kaiwen Xiong , Peng Xia , Yiyang Zhou , Haonian Ji , Lu Feng , Siwei Han , Mingyu Ding , Huaxiu Yao

Traditional self-adaptive systems automatically reconfigure existing components in response to changing requirements, but provide limited support for the generation of novel functionalities. The software generation capabilities of large…

Software Engineering · Computer Science 2026-04-21 Md Asif Iqbal Fahim , Oluwadamilola Adebayo , Alessio Ferrari

Large language models hold promise as scientific assistants, yet existing agents either rely solely on algorithm evolution or on deep research in isolation, both of which face critical limitations. Pure algorithm evolution, as in…

Artificial Intelligence · Computer Science 2025-10-08 Gang Liu , Yihan Zhu , Jie Chen , Meng Jiang

As large language models (LLMs) evolve into autonomous agents, evaluating repository-level reasoning, the ability to maintain logical consistency across massive, real-world, interdependent file systems, has become critical. Current…

Software Engineering · Computer Science 2026-05-05 Jia Li , Yuxin Su , Michael R. Lyu

Large Language Models (LLMs) have recently shown strong potential in automatic program repair (APR), especially in repository-level settings where the goal is to generate patches based on natural language issue descriptions, large…

Software Engineering · Computer Science 2025-10-07 Anvith Pabba , Simin Chen , Alex Mathai , Anindya Chakraborty , Baishakhi Ray

The rapid advancement of large language models (LLMs) has transformed the landscape of agentic information seeking capabilities through the integration of tools such as search engines and web browsers. However, current mainstream approaches…

Computation and Language · Computer Science 2025-05-29 Dingchu Zhang , Yida Zhao , Jialong Wu , Baixuan Li , Wenbiao Yin , Liwen Zhang , Yong Jiang , Yufeng Li , Kewei Tu , Pengjun Xie , Fei Huang

Large Language Model (LLM) Agents, often trained with Reinforcement Learning (RL), are constrained by a dependency on human-curated data, limiting scalability and tethering AI to human knowledge. Existing self-evolution frameworks offer an…

Machine Learning · Computer Science 2025-11-21 Peng Xia , Kaide Zeng , Jiaqi Liu , Can Qin , Fang Wu , Yiyang Zhou , Caiming Xiong , Huaxiu Yao

Code repair is a fundamental task in software development, facilitating efficient bug resolution and software maintenance. Although large language models (LLMs) have demonstrated considerable potential in automated code repair, their…

Software Engineering · Computer Science 2026-02-27 Dekun Dai , MingWei Liu , Anji Li , Jialun Cao , Yanlin Wang , Chong Wang , Xin Peng , Zibin Zheng

Small language models (SLMs) offer compelling advantages in cost, latency, and adaptability, but have so far lagged behind larger models on long-horizon software engineering tasks such as SWE-bench, where they suffer from pervasive action…

Software Engineering · Computer Science 2026-02-26 Patrick Tser Jern Kon , Archana Pradeep , Ang Chen , Alexander P. Ellis , Warren Hunt , Zijian Wang , John Yang , Samuel Thompson

Large Language Models (LLMs) have recently advanced many applications on software engineering tasks, particularly the potential for code generation. Among contemporary challenges, code generated by LLMs often suffers from inaccuracies and…

Software Engineering · Computer Science 2024-08-29 Thai Tang Quoc , Duc Ha Minh , Tho Quan Thanh , Anh Nguyen-Duc