English
Related papers

Related papers: CodeRAG: Finding Relevant and Necessary Knowledge …

200 papers

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by integrating up-to-date external knowledge, yet real-world web environments present unique challenges. These limitations manifest as two key challenges: pervasive…

Information Retrieval · Computer Science 2026-03-24 Yuqin Dai , Shuo Yang , Guoqing Wang , Yong Deng , Zhanwei Zhang , Jun Yin , Pengyu Zeng , Zhenzhe Ying , Changhua Meng , Can Yi , Yuchen Zhou , Weiqiang Wang , Shuai Lu

Long-form Retrieval-Augmented Generation (RAG) brings the challenge of coverage-based ranking, because ranking methods must ensure the inclusion of comprehensive relevant nuggets (i.e., facts), which can thereby be synthesized into a…

Information Retrieval · Computer Science 2026-05-28 Jia-Huei Ju , Eugene Yang , Trevor Adriaanse , Suzan Verberne , Andrew Yates

Retrieval-augmented generation (RAG) has emerged as a promising paradigm for enhancing large language models (LLMs) on multi-hop question answering (QA), which requires reasoning over evidence from multiple documents. Current multi-hop RAG…

Computation and Language · Computer Science 2026-05-28 Yikai Zhu , Kunfeng Chen , Qihuang Zhong , Juhua Liu , Bo Du

Large language models (LLMs) continue to struggle with knowledge-intensive questions that require up-to-date information and multi-hop reasoning. Augmenting LLMs with hybrid external knowledge, such as unstructured text and structured…

Machine Learning · Computer Science 2026-02-12 Junhong Lin , Bing Zhang , Song Wang , Ziyan Liu , Dan Gutfreund , Julian Shun , Yada Zhu

Selecting the right knowledge is critical when using large language models (LLMs) to solve domain-specific data analysis tasks. However, most retrieval-augmented approaches rely primarily on lexical or embedding similarity, which is often a…

Computation and Language · Computer Science 2026-04-28 Xinyi Huang

Recently, Large Language Models (LLMs) have been increasingly used to support various decision-making tasks, assisting humans in making informed decisions. However, when LLMs confidently provide incorrect information, it can lead humans to…

Information Retrieval · Computer Science 2025-10-16 Chaeyun Jang , Deukhwan Cho , Seanie Lee , Hyungi Lee , Juho Lee

Large language models (LLMs) are very costly and inefficient to update with new information. To address this limitation, retrieval-augmented generation (RAG) has been proposed as a solution that dynamically incorporates external knowledge…

Computation and Language · Computer Science 2025-07-10 Sezen Perçin , Xin Su , Qutub Sha Syed , Phillip Howard , Aleksei Kuvshinov , Leo Schwinn , Kay-Ulrich Scholl

Retrieval-Augmented Generation (RAG) systems often struggle with imperfect retrieval, as traditional retrievers focus on lexical or semantic similarity rather than logical relevance. To address this, we propose \textbf{HopRAG}, a novel RAG…

Information Retrieval · Computer Science 2025-05-27 Hao Liu , Zhengren Wang , Xi Chen , Zhiyu Li , Feiyu Xiong , Qinhan Yu , Wentao Zhang

Retrieval-augmented generation (RAG) has emerged as a pivotal method for expanding the knowledge of large language models. To handle complex queries more effectively, researchers developed Adaptive-RAG (A-RAG) to enhance the generated…

Artificial Intelligence · Computer Science 2025-05-27 Jie Ou , Jinyu Guo , Shuaihong Jiang , Zhaokun Wang , Libo Qin , Shunyu Yao , Wenhong Tian

Multimodal Retrieval-Augmented Generation (MMRAG) has been introduced to enhance Multimodal Large Language Models by incorporating externally retrieved multimodal knowledge, but it introduces two challenges: Parametric-Retrieved Knowledge…

Computation and Language · Computer Science 2025-06-06 Yang Tian , Fan Liu , Jingyuan Zhang , Victoria W. , Yupeng Hu , Liqiang Nie

Retrieval Augmented Generation (RAG) is a technique used to augment Large Language Models (LLMs) with contextually relevant, time-critical, or domain-specific information without altering the underlying model parameters. However,…

Information Retrieval · Computer Science 2024-08-20 Laurent Mombaerts , Terry Ding , Adi Banerjee , Florian Felice , Jonathan Taws , Tarik Borogovac

Recent advancements in Large language models (LLMs) have demonstrated remarkable capabilities across diverse domains. While they exhibit strong zero-shot performance on various tasks, LLMs' effectiveness in music-related applications…

Computation and Language · Computer Science 2025-12-09 Daeyong Kwon , SeungHeon Doh , Juhan Nam

Recent advancements in Retrieval-Augmented Generation have significantly enhanced code completion at the repository level. Various RAG-based code completion systems are proposed based on different design choices. For instance, gaining more…

Software Engineering · Computer Science 2024-06-18 Wenrui Zhang , Tiehang Fu , Ting Yuan , Ge Zhang , Dong Chen , Jie Wang

Retrieval-Augmented Generation (RAG) systems combine dense retrievers and language models to ground LLM outputs in retrieved documents. However, the opacity of how these components interact creates challenges for deployment in high-stakes…

Computation and Language · Computer Science 2026-01-30 Korbinian Randl , Guido Rocchietti , Aron Henriksson , Ziawasch Abedjan , Tony Lindgren , John Pavlopoulos

Retrieval-Augmented Generation (RAG) has significantly enhanced large language models (LLMs) in knowledge-intensive tasks by incorporating external knowledge retrieval. However, existing RAG frameworks primarily rely on semantic similarity…

Computation and Language · Computer Science 2025-04-18 Elahe Khatibi , Ziyu Wang , Amir M. Rahmani

Retrieval-augmented generation (RAG) is widely used to augment large language models (LLMs) with external knowledge. However, many benchmark datasets, designed to test RAG performance, comprise many questions that can already be answered…

Computation and Language · Computer Science 2026-05-12 Jiayi Liu , Jiaxing Zhang , Bowen Jin , Jennifer Neville

Code retrieval is a common practice for programmers to reuse existing code snippets in open-source repositories. Given a user query (i.e., a natural language description), code retrieval aims at searching for the most relevant ones from a…

Software Engineering · Computer Science 2022-03-30 Wenchao Gu , Zongjie Li , Cuiyun Gao , Chaozheng Wang , Hongyu Zhang , Zenglin Xu , Michael R. Lyu

Large Language Models (LLMs) exhibit remarkable capabilities but are prone to generating inaccurate or hallucinatory responses. This limitation stems from their reliance on vast pretraining datasets, making them susceptible to errors in…

Computation and Language · Computer Science 2024-04-02 Chi-Min Chan , Chunpu Xu , Ruibin Yuan , Hongyin Luo , Wei Xue , Yike Guo , Jie Fu

Large language models (LLMs) have achieved strong performance on code generation, but existing methods still struggle with repository-level code generation under executable validation. Under this evaluation setting, success is determined…

Software Engineering · Computer Science 2026-04-07 Ruwei Pan , Junlei Shen , Linhao Wu , Yueheng Zhu , Zixiong Yang , Yakun Zhang , Lu Zhang , Hongyu Zhang

Retrieval-Augmented Generation (RAG) is increasingly employed in generative AI-driven scientific workflows to integrate rapidly evolving scientific knowledge bases, yet its reliability is frequently compromised by non-determinism in their…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-24 Baiqiang Wang , Dongfang Zhao , Nathan R Tallent , Luanzheng Guo