English
Related papers

Related papers: Retrieval-Generation Synergy Augmented Large Langu…

200 papers

Retrieval augmented generation has emerged as an effective method to enhance large language model performance. This approach typically relies on an internal retrieval module that uses various indexing mechanisms to manage a static…

Information Retrieval · Computer Science 2024-12-31 Guangxin He , Zonghong Dai , Jiangcheng Zhu , Binqiang Zhao , Qicheng Hu , Chenyue Li , You Peng , Chen Wang , Binhang Yuan

Question answering (QA) has become an important application in the advanced development of large language models. General pre-trained large language models for question-answering are not trained to properly understand the knowledge or…

Computation and Language · Computer Science 2024-05-30 Sanat Sharma , David Seunghyun Yoon , Franck Dernoncourt , Dewang Sultania , Karishma Bagga , Mengjiao Zhang , Trung Bui , Varun Kotte

Developing the logic necessary to solve mathematical problems or write mathematical proofs is one of the more difficult objectives for large language models (LLMS). Currently, the most popular methods in literature consists of fine-tuning…

Machine Learning · Computer Science 2025-02-11 Tianbo Yang , Mingqi Yan , Hongyi Zhao , Tianshuo Yang

Large Language Models (LLMs) have shown proficiency in question-answering tasks but often struggle to integrate real-time knowledge, leading to potentially outdated or inaccurate responses. This problem becomes even more challenging when…

Computation and Language · Computer Science 2024-08-15 Yucheng Shi , Qiaoyu Tan , Xuansheng Wu , Shaochen Zhong , Kaixiong Zhou , Ninghao Liu

Generative retrieval (GR) is an emerging paradigm that leverages large language models (LLMs) to autoregressively generate document identifiers (docids) relevant to a given query. Prior works have focused on leveraging the generative…

Information Retrieval · Computer Science 2025-10-22 Yingchen Zhang , Ruqing Zhang , Jiafeng Guo , Wenjun Peng , Sen Li , Fuyu Lv

Current state-of-the-art large language models are effective in generating high-quality text and encapsulating a broad spectrum of world knowledge. These models, however, often hallucinate and lack locally relevant factual data.…

Software Engineering · Computer Science 2024-02-21 Anton Shapkin , Denis Litvinov , Yaroslav Zharov , Egor Bogomolov , Timur Galimzyanov , Timofey Bryksin

Effective knowledge management is critical for preserving institutional expertise and improving the efficiency of workforce training in state transportation agencies. Traditional approaches, such as static documentation, classroom-based…

Computation and Language · Computer Science 2026-03-05 Divija Amaram , Lu Gao , Gowtham Reddy Gudla , Tejaswini Sanjay Katale

Intelligent personal assistant systems that are able to have multi-turn conversations with human users are becoming increasingly popular. Most previous research has been focused on using either retrieval-based or generation-based methods to…

Information Retrieval · Computer Science 2019-08-27 Liu Yang , Junjie Hu , Minghui Qiu , Chen Qu , Jianfeng Gao , W. Bruce Croft , Xiaodong Liu , Yelong Shen , Jingjing Liu

In the rapidly changing world of smart technology, searching for documents has become more challenging due to the rise of advanced language models. These models sometimes face difficulties, like providing inaccurate information, commonly…

Information Retrieval · Computer Science 2025-03-20 Julien Pierre Edmond Ghali , Kosuke Shima , Koichi Moriyama , Atsuko Mutoh , Nobuhiro Inuzuka

How retrieved documents are used in language models (LMs) for long-form generation task is understudied. We present two controlled studies on retrieval-augmented LM for long-form question answering (LFQA): one fixing the LM and varying…

Computation and Language · Computer Science 2025-10-07 Hung-Ting Chen , Fangyuan Xu , Shane Arora , Eunsol Choi

Despite the remarkable ability of large language models (LMs) to comprehend and generate language, they have a tendency to hallucinate and create factually inaccurate output. Augmenting LMs by retrieving information from external knowledge…

Computation and Language · Computer Science 2023-10-24 Zhengbao Jiang , Frank F. Xu , Luyu Gao , Zhiqing Sun , Qian Liu , Jane Dwivedi-Yu , Yiming Yang , Jamie Callan , Graham Neubig

Graph-based Retrieval-Augmented Generation (RAG) methods have significantly enhanced the performance of large language models (LLMs) in domain-specific tasks. However, existing RAG methods do not adequately utilize the naturally inherent…

Computation and Language · Computer Science 2025-09-29 Haoyu Huang , Yongfeng Huang , Junjie Yang , Zhenyu Pan , Yongqiang Chen , Kaili Ma , Hongzhi Chen , James Cheng

Large language models(LLMS)have shown excellent text generation capabilities, capable of generating fluent human-like responses for many downstream tasks. However, applying large language models to real-world critical tasks remains…

Computation and Language · Computer Science 2023-07-21 Le Xiao , Xin Shan

Retrieval augmented generation (RAG) combines the generative abilities of large language models (LLMs) with external knowledge sources to provide more accurate and up-to-date responses. Recent RAG advancements focus on improving retrieval…

Large language models (LLMs) have gained significant attention in various fields but prone to hallucination, especially in knowledge-intensive (KI) tasks. To address this, retrieval-augmented generation (RAG) has emerged as a popular…

Computation and Language · Computer Science 2024-04-23 Xiaoxi Li , Zhicheng Dou , Yujia Zhou , Fangchao Liu

A Comparison of Independent and Joint Fine-tuning Strategies for Retrieval-Augmented Generation Download PDF Neal Gregory Lawton, Alfy Samuel, Anoop Kumar, Daben Liu Published: 20 Aug 2025, Retrieval augmented generation (RAG) is a popular…

Computation and Language · Computer Science 2025-10-21 Neal Gregory Lawton , Alfy Samuel , Anoop Kumar , Daben Liu

Recent advances in Large Language Models (LLMs) have significantly improved complex reasoning capabilities. Retrieval-Augmented Generation (RAG) has further extended these capabilities by grounding generation in dynamically retrieved…

Computation and Language · Computer Science 2026-02-23 Jash Rajesh Parekh , Pengcheng Jiang , Jiawei Han

When the world changes, so does the text that humans write about it. How do we build language models that can be easily updated to reflect these changes? One popular approach is retrieval-augmented generation, in which new documents are…

Computation and Language · Computer Science 2024-06-18 Belinda Z. Li , Emmy Liu , Alexis Ross , Abbas Zeitoun , Graham Neubig , Jacob Andreas

Retrieval-Augmented Generation (RAG) systems using Multimodal Large Language Models (MLLMs) show great promise for complex document understanding, yet their development is critically hampered by inadequate evaluation. Current benchmarks…

Computation and Language · Computer Science 2025-08-06 Wenxuan Shen , Mingjia Wang , Yaochen Wang , Dongping Chen , Junjie Yang , Yao Wan , Weiwei Lin

Large Language Models (LLMs) often falter in complex reasoning tasks due to their static, parametric knowledge, leading to hallucinations and poor performance in specialized domains like mathematics. This work explores a fundamental…

Machine Learning · Computer Science 2026-02-10 Srijan Shakya , Anamaria-Roberta Hartl , Sepp Hochreiter , Korbinian Pöppel