English
Related papers

Related papers: Mixture-of-PageRanks: Replacing Long-Context with …

200 papers

Recent advancements in language models (LMs) have notably enhanced their ability to reason with tabular data, primarily through program-aided mechanisms that manipulate and analyze tables. However, these methods often require the entire…

Retrieval Augmented Generation or RAG is the most popular pattern for modern Large Language Model or LLM applications. RAG involves taking a user query and finding relevant paragraphs of context in a large corpus typically captured in a…

Information Retrieval · Computer Science 2024-08-20 Dattaraj Rao

Retrieval-Augmented Generation (RAG) systems commonly use chunking strategies for retrieval, which enhance large language models (LLMs) by enabling them to access external knowledge, ensuring that the retrieved information is up-to-date and…

Computation and Language · Computer Science 2025-07-15 Hai Toan Nguyen , Tien Dat Nguyen , Viet Ha Nguyen

Overcoming the limited context limitations in early-generation LLMs, retrieval-augmented generation (RAG) has been a reliable solution for context-based answer generation in the past. Recently, the emergence of long-context LLMs allows the…

Computation and Language · Computer Science 2024-09-04 Tan Yu , Anbang Xu , Rama Akkiraju

Recent studies show that large language models (LLMs) struggle with technical standards in telecommunications. We propose a fine-tuned retrieval-augmented generation (RAG) system based on the Phi-2 small language model (SLM) to serve as an…

Computation and Language · Computer Science 2025-01-17 Omar Erak , Nouf Alabbasi , Omar Alhussein , Ismail Lotfi , Amr Hussein , Sami Muhaidat , Merouane Debbah

Retrieval-augmented generation (RAG) is critical for reducing hallucinations and incorporating external knowledge into Large Language Models (LLMs). However, advanced RAG systems face a trade-off between performance and efficiency.…

Information Retrieval · Computer Science 2025-08-05 Shengbo Gong , Xianfeng Tang , Carl Yang , Wei jin

Retrieval-augmented generation (RAG) effectively addresses issues of static knowledge and hallucination in large language models. Existing studies mostly focus on question scenarios with clear user intents and concise answers. However, it…

Computation and Language · Computer Science 2025-02-18 Shuting Wang , Xin Yu , Mang Wang , Weipeng Chen , Yutao Zhu , Zhicheng Dou

Retrieval-augmented generation (RAG) is a powerful technique that enhances downstream task execution by retrieving additional information, such as knowledge, skills, and tools from external sources. Graph, by its intrinsic "nodes connected…

Large language models (LLMs) have demonstrated remarkable in-context reasoning capabilities across a wide range of tasks, particularly with unstructured inputs such as language or images. However, LLMs struggle to handle structured data,…

Machine Learning · Computer Science 2025-02-20 Jintang Li , Ruofan Wu , Yuchang Zhu , Huizhe Zhang , Liang Chen , Zibin Zheng

Retrieval-Augmented Generation (RAG) enhances language models by incorporating external knowledge at inference time. However, graph-based RAG systems often suffer from structural overhead and imprecise retrieval: they require costly…

Information Retrieval · Computer Science 2025-06-24 Jiale Zhang , Jiaxiang Chen , Zhucong Li , Jie Ding , Kui Zhao , Zenglin Xu , Xin Pang , Yinghui Xu

Extracting real-time insights from multi-modal data streams from various domains such as healthcare, intelligent transportation, and satellite remote sensing remains a challenge. High computational demands and limited knowledge scope…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Murugan Sankaradas , Ravi K. Rajendran , Srimat T. Chakradhar

Since large language models (LLMs) have a tendency to generate factually inaccurate output, retrieval-augmented generation (RAG) has gained significant attention as a key means to mitigate this downside of harnessing only LLMs. However,…

Computation and Language · Computer Science 2025-12-18 Youmin Ko , Sungjong Seo , Hyunjoon Kim

The volume of scientific literature is growing exponentially, leading to underutilized discoveries, duplicated efforts, and limited cross-disciplinary collaboration. Retrieval Augmented Generation (RAG) offers a way to assist scientists by…

Retrieval-Augmented Generation (RAG) is widely used to mitigate hallucinations of Large Language Models (LLMs) by leveraging external knowledge. While effective for simple queries, traditional RAG systems struggle with large-scale,…

Computation and Language · Computer Science 2025-11-11 Luyao Zhuang , Shengyuan Chen , Yilin Xiao , Huachi Zhou , Yujing Zhang , Hao Chen , Qinggang Zhang , Xiao Huang

Retrieval-augmented generation (RAG) enhances large language models by incorporating context retrieved from external knowledge sources. While the effectiveness of the retrieval module is typically evaluated with relevance-based ranking…

Information Retrieval · Computer Science 2026-01-13 Jia-Huei Ju , Suzan Verberne , Maarten de Rijke , Andrew Yates

Retrieval-Augmented Generation (RAG) offers a cost-effective approach to injecting real-time knowledge into large language models (LLMs). Nevertheless, constructing and validating high-quality knowledge repositories require considerable…

Computation and Language · Computer Science 2024-05-28 Xun Liang , Simin Niu , Zhiyu li , Sensen Zhang , Shichao Song , Hanyu Wang , Jiawei Yang , Feiyu Xiong , Bo Tang , Chenyang Xi

Large language models (LLMs) have recently been adopted for recommendations due to their ability to understand user intent and item semantics. However, LLM-based recommender systems often rely on parametric knowledge and suffer from…

Information Retrieval · Computer Science 2026-05-28 Shijie Wang , Chengyi Liu , Yujuan Ding , Shanru Lin , See-Kiong Ng , Xu Xin , Wenqi Fan

Retrieval-Augmented Generation (RAG) has emerged as a promising paradigm for improving the timeliness of knowledge updates and the factual accuracy of large language models. However, incorporating a large volume of retrieved documents…

Computation and Language · Computer Science 2026-05-29 Ziqiang Cui , Yunpeng Weng , Xing Tang , Peiyang Liu , Shiwei Li , Bowei He , Jiamin Chen , Yansen Zhang , Xiuqiang He , Chen Ma

Retrieval-augmented generation (RAG) has gained traction as a powerful approach for enhancing language models by integrating external knowledge sources. However, RAG introduces challenges such as retrieval latency, potential errors in…

Computation and Language · Computer Science 2025-02-25 Brian J Chan , Chao-Ting Chen , Jui-Hung Cheng , Hen-Hsen Huang

Retrieval-Augmented Generation (RAG) enhances the factual grounding of Large Language Models by conditioning their outputs on external documents. However, standard embedding-based retrievers treat naturally structured corpora, such as…

Information Retrieval · Computer Science 2026-05-11 Giorgia Bolognesi , Claudio Estatico , Ulderico Fugacci , Isabella Mastroianni , Claudio Muselli , Luca Oneto