English
Related papers

Related papers: SWE-Exp: Experience-Driven Software Issue Resoluti…

200 papers

While large language models (LLMs) have advanced the development of general-purpose agents, achieving robust generalization to unseen tasks remains a significant challenge. Current approaches typically rely on either fine-tuning or…

Artificial Intelligence · Computer Science 2026-03-20 Thomas Palmeira Ferraz , Romain Deffayet , Vassilina Nikoulina , Hervé Déjean , Stéphane Clinchant

The development of Large Language Models (LLMs) has catalyzed automation in customer service, yet benchmarking their performance remains challenging. Existing benchmarks predominantly rely on static paradigms and single-dimensional metrics,…

Artificial Intelligence · Computer Science 2026-04-13 Ling Shi , Yuqin Dai , Ziyin Wang , Ning Gao , Wei Zhang , Chaozheng Wang , Yujie Wang , Wei He , Jinpeng Wang , Deiyi Xiong

Large Language Model (LLM) agents are increasingly improved through interaction, yet most self-evolution methods adapt either the policy or the learning environment in isolation. We identify this structural gap as \emph{Agent-Environment…

Computation and Language · Computer Science 2026-05-26 Yihao Hu , Zhihao Wen , Xiujin Liu , Pan Wang , Xin Zhang , Wei Wu

Evaluating software engineering capabilities has become a core component of modern large language models (LLMs); however, the key bottleneck hindering further scaling lies not in the scarcity of high-quality solutions, but in the lack of…

Software Engineering · Computer Science 2026-05-22 Yuxuan Sun , Yuze Zhao , Yufeng Wang , Yao Du , Zhiyuan Ma , Jinbo Wang , Mengdi Zhang , Kai Zhang , Zhenya Huang

Constructing large-scale datasets for the GitHub issue resolution task is crucial for both training and evaluating the software engineering capabilities of Large Language Models (LLMs). However, the existing GitHub issue resolution data…

Software Engineering · Computer Science 2026-01-06 Lianghong Guo , Yanlin Wang , Caihua Li , Wei Tao , Pengyu Yang , Jiachi Chen , Haoyu Song , Duyu Tang , Zibin Zheng

Large language models are increasingly used as coding agents for software engineering tasks. Current benchmarks mainly evaluate whether the agent can correctly solve the request or fix the bugs. They largely treat tasks as independent and…

Software Engineering · Computer Science 2026-05-07 Jiayuan Zhu , Junde Wu , Minhao Hu , Shengda Zhu , Jiazhen Pan , Weixiang Shen , Yijun Yang , Fenglin Liu , Jianye Hao , Yueming Jin , Qirong Ho , Min Xu

Improving Large Language Model (LLM) agents for sequential decision-making tasks typically requires extensive task-specific knowledge engineering--custom prompts, curated examples, and specialized observation/action spaces. We investigate a…

Machine Learning · Computer Science 2025-05-20 Vishnu Sarukkai , Zhiqiang Xie , Kayvon Fatahalian

Large Language Model-based multi-agent systems (MAS) have shown remarkable progress in solving complex tasks through collaborative reasoning and inter-agent critique. However, existing approaches typically treat each task in isolation,…

Computation and Language · Computer Science 2025-05-30 Yilong Li , Chen Qian , Yu Xia , Ruijie Shi , Yufan Dang , Zihao Xie , Ziming You , Weize Chen , Cheng Yang , Weichuan Liu , Ye Tian , Xuantang Xiong , Lei Han , Zhiyuan Liu , Maosong Sun

Existing benchmarks for AI coding agents focus on isolated, single-issue tasks such as fixing a bug or adding a small feature. However, real-world software engineering is a long-horizon endeavor: developers interpret high-level…

Software Engineering · Computer Science 2026-05-25 Tue Le , Minh V. T. Thai , Dung Nguyen Manh , Huy Phan Nhat , Nghi D. Q. Bui

Large language models (LLMs) have recently emerged as promising tools for solving challenging robotic tasks, even in the presence of action and observation uncertainties. Recent LLM-based decision-making methods (also referred to as…

Artificial Intelligence · Computer Science 2024-09-20 Abhinav Jain , Chris Jermaine , Vaibhav Unhelkar

While Large Language Models (LLMs) excel in language-based agentic tasks, their applicability to unseen, nonlinguistic environments (e.g., symbolic or spatial tasks) remains limited. Previous work attributes this performance gap to the…

Artificial Intelligence · Computer Science 2026-02-03 Haoyu Wang , Guozheng Ma , Shugang Cui , Yilun Kong , Haotian Luo , Li Shen , Mengya Gao , Yichao Wu , Xiaogang Wang , Dacheng Tao

Resolving issues on code repositories is an important part of software engineering. Various recent systems automatically resolve issues using large language models and agents, often with impressive performance. Unfortunately, most of these…

Software Engineering · Computer Science 2026-03-13 Jatin Ganhotra , Sami Serhan , Antonio Abu Nassar , Avraham Shinnar , Ziv Nevo , Martin Hirzel

With the advent of large language models (LLMs) in the artificial intelligence (AI) area, the field of software engineering (SE) has also witnessed a paradigm shift. These models, by leveraging the power of deep learning and massive amounts…

Software Engineering · Computer Science 2024-12-30 Cuiyun Gao , Xing Hu , Shan Gao , Xin Xia , Zhi Jin

Agent-based models (ABMs) stand as an essential paradigm for proposing and validating hypothetical solutions or policies aimed at addressing challenges posed by complex systems and achieving various objectives. This process demands…

Computation and Language · Computer Science 2024-04-02 Tong Niu , Weihao Zhang , Rong Zhao

Reinforcement Learning (RL) has demonstrated significant potential in enhancing the reasoning capabilities of large language models (LLMs). However, the success of RL for LLMs heavily relies on human-curated datasets and verifiable rewards,…

Artificial Intelligence · Computer Science 2025-10-31 Yixing Chen , Yiding Wang , Siqi Zhu , Haofei Yu , Tao Feng , Muhan Zhang , Mostofa Patwary , Jiaxuan You

Large Language Models (LLMs) have shown promise for automated vulnerability repair (AVR), but they still face several limitations, including the lack of intra-vulnerability experience accumulation and the lack of cross-vulnerability…

Software Engineering · Computer Science 2026-05-29 Haichuan Hu , Guoqing Xie , Quanjun Zhang , Jiawei Liu , Shengcheng Yu , Chunrong Fang , Zhenyu Chen , Liang Xiao

Software engineers resolving repository-level issues do not treat existing tests as immutable correctness oracles. Instead, they iteratively refine both code and the tests used to characterize intended behavior, as new modifications expose…

Software Engineering · Computer Science 2026-04-07 Kefan Li , Yuan Yuan , Mengfei Wang , Shihao Zheng , Wei Wang , Ping Yang , Mu Li , Weifeng Lv

Issue localization, which identifies faulty code elements such as files or functions, is critical for effective bug fixing. While recent LLM-based and LLM-agent-based approaches improve accuracy, they struggle in large-scale repositories…

Software Engineering · Computer Science 2025-10-07 Ying Wang , Wenjun Mao , Chong Wang , Zhenhao Zhou , Yicheng Zhou , Wenyun Zhao , Yiling Lou , Xin Peng

Autonomous agents based on Large Language Models (LLMs) are increasingly being utilized in complex software systems. However, reliability remains a significant challenge due to unpredictable failures such as hallucinations, execution…

Software Engineering · Computer Science 2026-05-11 Cheonsu Jeong , Younggun Shin

Researchers have made significant progress in automating the software development process in the past decades. Recent progress in Large Language Models (LLMs) has significantly impacted the development process, where developers can use…

Software Engineering · Computer Science 2024-07-26 Yuntong Zhang , Haifeng Ruan , Zhiyu Fan , Abhik Roychoudhury
‹ Prev 1 4 5 6 7 8 10 Next ›