English
Related papers

Related papers: Completion by Comprehension: Guiding Code Generati…

200 papers

Code evolution is inevitable in modern software development. Changes to third-party APIs frequently break existing code and complicate maintenance, posing practical challenges for developers. While large language models (LLMs) have shown…

Software Engineering · Computer Science 2026-03-10 Jiazhen Kang , Yuchen Lu , Chen Jiang , Jinrui Liu , Tianhao Zhang , Bo Jiang , Ningyuan Sun , Tongtong Wu , Guilin Qi

Repository-scale code reasoning is a cornerstone of modern AI-assisted software engineering, enabling Large Language Models (LLMs) to handle complex workflows from program comprehension to complex debugging. However, balancing accuracy with…

Software Engineering · Computer Science 2026-03-04 Zhonghang Li , Zongwei Li , Yuxuan Chen , Han Shi , Jiawei Li , Jierun Chen , Haoli Bai , Chao Huang

Retrieval-Augmented Generation (RAG) enhances factual grounding in large language models (LLMs) by incorporating retrieved evidence, but LLM accuracy declines when long or noisy contexts exceed the model's effective attention span. Existing…

Computation and Language · Computer Science 2026-03-25 Debashish Chakraborty , Eugene Yang , Daniel Khashabi , Dawn Lawrie , Kevin Duh

Large Language Models (LLMs) for unsupervised code correctness evaluation have recently gained attention because they can judge if code runs as intended without requiring reference implementations or unit tests, which may be unavailable,…

Artificial Intelligence · Computer Science 2026-04-02 Bhrij Patel , Souradip Chakraborty , Mengdi Wang , Dinesh Manocha , Amrit Singh Bedi

Data wrangling, the process of preparing raw data for further analysis in computational notebooks, is a crucial yet time-consuming step in data science. Code generation has the potential to automate the data wrangling process to reduce…

Software Engineering · Computer Science 2024-09-23 Junjie Huang , Daya Guo , Chenglong Wang , Jiazhen Gu , Shuai Lu , Jeevana Priya Inala , Cong Yan , Jianfeng Gao , Nan Duan , Michael R. Lyu

Recent advances in large language models (LLMs) have demonstrated impressive capabilities in code-related tasks, such as code generation and automated program repair. Despite their promising performance, most existing approaches for code…

Software Engineering · Computer Science 2025-09-03 Yicong Zhao , Shisong Chen , Jiacheng Zhang , Zhixu Li

Retrieval-Augmented Generation (RAG) frameworks aim to enhance Code Language Models (CLMs) by including another module for retrieving relevant context to construct the input prompt. However, these retrieval modules commonly use semantic…

Software Engineering · Computer Science 2025-10-16 Minh Nguyen

On-the-fly retrieval of relevant knowledge has proven an essential element of reliable systems for tasks such as open-domain question answering and fact verification. However, because retrieval systems are not perfect, generation models are…

Computation and Language · Computer Science 2023-11-15 Zhiruo Wang , Jun Araki , Zhengbao Jiang , Md Rizwan Parvez , Graham Neubig

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by incorporating external knowledge to generate a response within a context with improved accuracy and reduced hallucinations. However, multi-modal RAG systems face…

Machine Learning · Computer Science 2025-01-09 Matin Mortaheb , Mohammad A. Amir Khojastepour , Srimat T. Chakradhar , Sennur Ulukus

Reliably determining the performance of Retrieval-Augmented Generation (RAG) systems depends on comprehensive test questions. While a proliferation of evaluation frameworks for LLM-powered applications exists, current practices lack a…

Machine Learning · Computer Science 2025-10-02 Noah Broestl , Adel Nasser Abdalla , Rajprakash Bale , Hersh Gupta , Max Struever

User experience of mobile apps is an essential ingredient that can influence the audience volumes and app revenue. To ensure good user experience and assist app development, several prior studies resort to analysis of app reviews, a type of…

Software Engineering · Computer Science 2020-10-14 Cuiyun Gao , Wenjie Zhou , Xin Xia , David Lo , Qi Xie , Michael R. Lyu

The newly proposed Generalized Referring Expression Segmentation (GRES) amplifies the formulation of classic RES by involving complex multiple/non-target scenarios. Recent approaches address GRES by directly extending the well-adopted RES…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Zhuoyan Luo , Yinghao Wu , Tianheng Cheng , Yong Liu , Yicheng Xiao , Hongfa Wang , Xiao-Ping Zhang , Yujiu Yang

Referring Expression Comprehension and Segmentation are critical tasks for assessing the integration of language understanding and image comprehension, serving as benchmarks for Multimodal Large Language Models (MLLMs) capabilities. To…

Computation and Language · Computer Science 2026-01-21 Qihua Dong , Luis Figueroa , Handong Zhao , Kushal Kafle , Jason Kuen , Zhihong Ding , Scott Cohen , Yun Fu

Pre-trained language models have achieved promising success in code retrieval tasks, where a natural language documentation query is given to find the most relevant existing code snippet. However, existing models focus only on optimizing…

Software Engineering · Computer Science 2022-12-22 Dong Li , Yelong Shen , Ruoming Jin , Yi Mao , Kuan Wang , Weizhu Chen

Reasoning is a fundamental capability of Large Language Models. While prior research predominantly focuses on enhancing narrow skills like math or code generation, improving performance on many other reasoning tasks remains challenging due…

Computation and Language · Computer Science 2025-05-22 Junlong Li , Daya Guo , Dejian Yang , Runxin Xu , Yu Wu , Junxian He

Large Language Models (LLMs) have demonstrated impressive capabilities in code completion tasks, where they assist developers by predicting and generating new code in real-time. However, existing LLM-based code completion systems primarily…

Software Engineering · Computer Science 2024-12-12 Zhanming Guan , Junlin Liu , Jierui Liu , Chao Peng , Dexin Liu , Ningyuan Sun , Bo Jiang , Wenchao Li , Jie Liu , Hang Zhu

Repository-level code completion remains a challenging task for existing code large language models (code LLMs) due to their limited understanding of repository-specific context and domain knowledge. While retrieval-augmented generation…

Software Engineering · Computer Science 2026-01-28 Tianyue Jiang , Yanli Wang , Yanlin Wang , Daya Guo , Ensheng Shi , Yuchi Ma , Jiachi Chen , Zibin Zheng

Large Language Models (LLMs) struggle with knowledge-intensive tasks due to hallucinations and fragmented reasoning over dispersed information. While Retrieval-Augmented Generation (RAG) grounds generation in external sources, existing…

Computation and Language · Computer Science 2026-04-14 Cheng-Yen Li , Xuanjun Chen , Claire Lin , Wei-Yu Chen , Wenhua Nie , Hung-Yi Lee , Jyh-Shing Roger Jang

Knowledge Graph Completion (KGC) aims to infer missing information in Knowledge Graphs (KGs) to address their inherent incompleteness. Traditional structure-based KGC methods, while effective, face significant computational demands and…

Computation and Language · Computer Science 2025-04-01 Jianfang Chen , Kai Zhang , Aoran Gan , Shiwei Tong , Shuanghong Shen , Qi Liu

Building upon the standard graph-based Retrieval-Augmented Generation (RAG), the introduction of heterogeneous graphs and hypergraphs aims to enrich retrieval and generation by leveraging the relationships between multiple entities through…

Computation and Language · Computer Science 2025-09-03 Xuecheng Zou , Ke Liu , Bingbing Wang , Huafei Deng , Li Zhang , Yu Tang