English
Related papers

Related papers: RPG: A Repository Planning Graph for Unified and S…

200 papers

Automated program repair (APR) struggles to scale from isolated functions to full repositories, as it demands a global, task-aware understanding to locate necessary changes. Current methods, limited by context and reliant on shallow…

Software Engineering · Computer Science 2026-03-03 Zhongqiang Pan , Chuanyi Li , Wenkang Zhong , Yi Feng , Bin Luo , Vincent Ng

Retrieval-augmented generation (RAG) empowers large language models to access external and private corpus, enabling factually consistent responses in specific domains. By exploiting the inherent structure of the corpus, graph-based RAG…

Artificial Intelligence · Computer Science 2025-04-17 Tianyang Xu , Haojie Zheng , Chengze Li , Haoxiang Chen , Yixin Liu , Ruoxi Chen , Lichao Sun

The code generation capabilities of Large Language Models (LLMs) have transformed the field of software development. However, this advancement also presents significant security challenges, as LLM-generated code often contains…

Cryptography and Security · Computer Science 2025-10-14 Rupam Patir , Keyan Guo , Haipeng Cai , Hongxin Hu

As code completion task from function-level to repository-level, leveraging contextual information from large-scale codebases becomes a core challenge. However, existing retrieval-augmented generation (RAG) methods typically treat code as…

Software Engineering · Computer Science 2025-12-05 Xinkui Zhao , Rongkai Liu , Yifan Zhang , Chen Zhi , Lufei Zhang , Guanjie Cheng , Yueshen Xu , Shuiguang Deng , Jianwei Yin

Large language models (LLMs) commonly struggle with specialized or emerging topics which are rarely seen in the training corpus. Graph-based retrieval-augmented generation (GraphRAG) addresses this by structuring domain knowledge as a graph…

Information Retrieval · Computer Science 2025-06-05 Zhefan Wang , Huanjun Kong , Jie Ying , Wanli Ouyang , Nanqing Dong

Real-world tasks require decisions at varying granularities, and humans excel at this by leveraging a unified cognitive representation where planning is fundamentally understood as a high-level form of action. However, current Large…

Artificial Intelligence · Computer Science 2026-01-07 Zhaoyang Yu , Jiayi Zhang , Huixue Su , Yufan Zhao , Yifan Wu , Mingyi Deng , Jinyu Xiang , Yizhang Lin , Lingxiao Tang , Yuyu Luo , Bang Liu , Chenglin Wu

Paraphrase generation is an important task in natural language processing. Previous works focus on sentence-level paraphrase generation, while ignoring document-level paraphrase generation, which is a more challenging and valuable task. In…

Computation and Language · Computer Science 2021-09-16 Zhe Lin , Yitao Cai , Xiaojun Wan

Repository-level bug localization-the task of identifying where code must be modified to fix a bug-is a critical software engineering challenge. Standard Large Language Modles (LLMs) are often unsuitable for this task due to context window…

Machine Learning · Computer Science 2026-02-17 Juntong Wang , Libin Chen , Xiyuan Wang , Shijia Kang , Haotong Yang , Da Zheng , Muhan Zhang

Large language models (LLMs) have achieved strong performance on code generation, but existing methods still struggle with repository-level code generation under executable validation. Under this evaluation setting, success is determined…

Software Engineering · Computer Science 2026-04-07 Ruwei Pan , Junlei Shen , Linhao Wu , Yueheng Zhu , Zixiong Yang , Yakun Zhang , Lu Zhang , Hongyu Zhang

Scaling up executable code data is significant for improving language models' software engineering capability. The intricate nature of the process makes it labor-intensive, time-consuming and expert-knowledge-dependent to build a large…

Software Engineering · Computer Science 2025-10-21 Ruida Hu , Chao Peng , Xinchen Wang , Junjielong Xu , Cuiyun Gao

Large language models (LLMs) have achieved strong performance in code generation, but most methods rely on autoregressive decoding without global planning, often leading to locally coherent yet globally suboptimal solutions (e.g., failing…

Artificial Intelligence · Computer Science 2026-05-26 Zhihao Dou , Qinjian Zhao , Zhongwei Wan , Xiaoyu Xia , Sumon Biswas

Recent advancements in Large Language Models (LLMs) have transformed code generation from natural language queries. However, despite their extensive knowledge and ability to produce high-quality code, LLMs often struggle with contextual…

Artificial Intelligence · Computer Science 2025-07-17 Mihir Athale , Vishal Vaddina

Large Language Models (LLMs) excel at code generation but struggle with complex problems. Retrieval-Augmented Generation (RAG) mitigates this issue by integrating external knowledge, yet retrieval models often miss relevant context, and…

Software Engineering · Computer Science 2026-01-29 Shahd Seddik , Fahd Seddik , Iman Saberi , Fatemeh Fard , Minh Hieu Huynh , Patanamon Thongtanunam

Despite the remarkable success of large language models (LLMs) on traditional natural language processing tasks, their planning ability remains a critical bottleneck in tackling complex multi-step reasoning tasks. Existing approaches mainly…

Computation and Language · Computer Science 2024-10-07 Jiaxin Wen , Jian Guan , Hongning Wang , Wei Wu , Minlie Huang

Large Language Models (LLMs) have recently shown remarkable progress in code generation, yet their ability to construct complete software repositories from scratch remains poorly understood. A fundamental bottleneck is the lack of…

Software Engineering · Computer Science 2026-05-21 Zhaoxi Zhang , Yiming Xu , Jiahui Liang , Weikang Li , Xiaoshuai Chen , Liwei Qian , Xin Pei , Jizhou Huang , Run Sun , Yunfang Wu

Large Language Models (LLMs) excel in stand-alone code tasks like HumanEval and MBPP, but struggle with handling entire code repositories. This challenge has prompted research on enhancing LLM-codebase interaction at a repository scale.…

Software Engineering · Computer Science 2024-08-13 Xiangyan Liu , Bo Lan , Zhiyuan Hu , Yang Liu , Zhicheng Zhang , Fei Wang , Michael Shieh , Wenmeng Zhou

We introduce CRPE (Code Reasoning Process Enhancer), an innovative three-stage framework for data synthesis and model training that advances the development of sophisticated code reasoning capabilities in large language models (LLMs).…

Software Engineering · Computer Science 2025-05-19 Ningxin Gui , Qianghuai Jia , Feijun Jiang , Yuling Jiao , dechun wang , Jerry Zhijian Yang

Large Language Models (LLMs) have greatly advanced code auto-completion systems, with a potential for substantial productivity enhancements for developers. However, current benchmarks mainly focus on single-file tasks, leaving an assessment…

Computation and Language · Computer Science 2023-10-05 Tianyang Liu , Canwen Xu , Julian McAuley

Maintainable and general software allows developers to build robust applications efficiently, yet achieving these qualities often requires refactoring specialized solutions into reusable components. This challenge becomes particularly…

Software Engineering · Computer Science 2025-10-07 Ziga Kovacic , Justin T. Chiu , Celine Lee , Wenting Zhao , Kevin Ellis

Enterprise level software is implemented using multi-layer architecture. These layers are often implemented using de-coupled solutions with millions of lines of code. Programmers often have to track and debug a function call from user…

Software Engineering · Computer Science 2016-10-17 Anne Veenendaal , Elliot Daly , Eddie Jones , Zhao Gang , Sumalini Vartak , Rahul S Patwardhan