English
Related papers

Related papers: NANOGPT: A Query-Driven Large Language Model Retri…

200 papers

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by integrating external knowledge retrieved from a knowledge base. However, its effectiveness is fundamentally constrained by the reliability of both the retriever…

Computation and Language · Computer Science 2025-01-31 Yiteng Tu , Weihang Su , Yujia Zhou , Yiqun Liu , Qingyao Ai

Recent advancements in Large Language Models (LLMs) have significantly improved their performance across various Natural Language Processing (NLP) tasks. However, LLMs still struggle with generating non-factual responses due to limitations…

Computation and Language · Computer Science 2024-09-10 Taeho Hwang , Soyeong Jeong , Sukmin Cho , SeungYoon Han , Jong C. Park

The advent of Large Language Models (LLMs) has revolutionized natural language processing. However, these models face challenges in retrieving precise information from vast datasets. Retrieval-Augmented Generation (RAG) was developed to…

Information Retrieval · Computer Science 2025-03-04 Yuxin Yang , Haoyang Wu , Tao Wang , Jia Yang , Hao Ma , Guojie Luo

In real-world applications with Large Language Models (LLMs), external retrieval mechanisms - such as Search-Augmented Generation (SAG), tool utilization, and Retrieval-Augmented Generation (RAG) - are often employed to enhance the quality…

Computation and Language · Computer Science 2025-02-25 Tzu-Lin Kuo , Feng-Ting Liao , Mu-Wei Hsieh , Fu-Chieh Chang , Po-Chun Hsu , Da-Shan Shiu

Large language models (LLMs) have transformed natural language processing (NLP), enabling applications from content generation to decision support. Retrieval-Augmented Generation (RAG) improves LLMs by incorporating external knowledge but…

Cryptography and Security · Computer Science 2025-11-11 Zirui Cheng , Jikai Sun , Anjun Gao , Yueyang Quan , Zhuqing Liu , Xiaohua Hu , Minghong Fang

Retrieval-augmented generation (RAG) is a promising method for addressing some of the memory-related challenges associated with Large Language Models (LLMs). Two separate systems form the RAG pipeline, the retriever and the reader, and the…

Computation and Language · Computer Science 2024-11-13 Alexandria Leto , Cecilia Aguerrebere , Ishwar Bhati , Ted Willke , Mariano Tepper , Vy Ai Vo

Naive Retrieval-Augmented Generation (RAG) focuses on individual documents during retrieval and, as a result, falls short in handling networked documents which are very popular in many applications such as citation graphs, social media, and…

Machine Learning · Computer Science 2025-07-15 Yuntong Hu , Zhihan Lei , Zheng Zhang , Bo Pan , Chen Ling , Liang Zhao

Classical search engines using indexing methods in data infrastructures primarily allow keyword-based queries to retrieve content. While these indexing-based methods are highly scalable and efficient, due to a lack of an appropriate…

Information Retrieval · Computer Science 2025-09-30 Nafis Tanveer Islam , Zhiming Zhao

Large Language Models (LLMs) demonstrate remarkable capabilities in replicating human tasks and boosting productivity. However, their direct application for data extraction presents limitations due to a prioritisation of fluency over…

Computation and Language · Computer Science 2024-06-13 Aman Ahluwalia , Suhrud Wani

Large Language Models (LLMs) and Knowledge Graphs (KGs) offer a promising approach to robust and explainable Question Answering (QA). While LLMs excel at natural language understanding, they suffer from knowledge gaps and hallucinations.…

Machine Learning · Computer Science 2025-04-15 Jasper Linders , Jakub M. Tomczak

Retrieval-Augmented Generation (RAG) is a promising approach for mitigating the hallucination of large language models (LLMs). However, existing research lacks rigorous evaluation of the impact of retrieval-augmented generation on different…

Computation and Language · Computer Science 2023-12-21 Jiawei Chen , Hongyu Lin , Xianpei Han , Le Sun

Large Language Models (LLMs) excel at reasoning and generation but are inherently limited by static pretraining data, resulting in factual inaccuracies and weak adaptability to new information. Retrieval-Augmented Generation (RAG) addresses…

Computation and Language · Computer Science 2025-11-03 Qi Luo , Xiaonan Li , Yuxin Wang , Tingshuo Fan , Yuan Li , Xinchi Chen , Xipeng Qiu

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by integrating up-to-date external knowledge, yet real-world web environments present unique challenges. These limitations manifest as two key challenges: pervasive…

Information Retrieval · Computer Science 2026-03-24 Yuqin Dai , Shuo Yang , Guoqing Wang , Yong Deng , Zhanwei Zhang , Jun Yin , Pengyu Zeng , Zhenzhe Ying , Changhua Meng , Can Yi , Yuchen Zhou , Weiqiang Wang , Shuai Lu

Retrieval-augmented generation (RAG) appears as a promising method to alleviate the "hallucination" problem in large language models (LLMs), since it can incorporate external traceable resources for response generation. The essence of RAG…

Computation and Language · Computer Science 2024-10-16 Haosheng Qian , Yixing Fan , Ruqing Zhang , Jiafeng Guo

Large language models (LLMs) are rapidly transforming various domains, including biomedicine and healthcare, and demonstrate remarkable potential from scientific research to new drug discovery. Graph-based retrieval-augmented generation…

Quantitative Methods · Quantitative Biology 2025-11-14 Guofeng Meng , Li Shen , Qiuyan Zhong , Wei Wang , Haizhou Zhang , Xiaozhen Wang

Generative Large Language Models (LLMs) are a promising approach to structuring knowledge contained within the corpora of research literature produced by large-scale and long-running scientific collaborations. Within experimental particle…

High Energy Physics - Experiment · Physics 2025-09-09 James McGreivy , Blaise Delaney , Anja Beck , Mike Williams

Large pre-trained language models have been shown to store factual knowledge in their parameters, and achieve state-of-the-art results when fine-tuned on downstream NLP tasks. However, their ability to access and precisely manipulate…

Recommender systems have become increasingly vital in our daily lives, helping to alleviate the problem of information overload across various user-oriented online services. The emergence of Large Language Models (LLMs) has yielded…

Information Retrieval · Computer Science 2025-05-29 Shijie Wang , Wenqi Fan , Yue Feng , Shanru Lin , Xinyu Ma , Shuaiqiang Wang , Dawei Yin

Retrieval-augmented generation (RAG) has emerged as a powerful framework for enhancing large language models (LLMs) with external knowledge, particularly in scientific domains that demand specialized and dynamic information. Despite its…

Computation and Language · Computer Science 2026-02-17 Xianrui Zhong , Bowen Jin , Siru Ouyang , Yanzhen Shen , Qiao Jin , Yin Fang , Zhiyong Lu , Jiawei Han

Retrieval-Augmented Generation (RAG) improves Large Language Models (LLMs) by retrieving supporting documents into the prompt, but existing methods do not explicitly target queries that require fetching multiple documents with substantially…