English
Related papers

Related papers: Recitation-Augmented Language Models

200 papers

Ensuring the verifiability of model answers is a fundamental challenge for retrieval-augmented generation (RAG) in the question answering (QA) domain. Recently, self-citation prompting was proposed to make large language models (LLMs)…

Computation and Language · Computer Science 2024-12-02 Jirui Qi , Gabriele Sarti , Raquel Fernández , Arianna Bisazza

Visual Question Answering with Natural Language Explanation (VQA-NLE) task is challenging due to its high demand for reasoning-based inference. Recent VQA-NLE studies focus on enhancing model networks to amplify the model's reasoning…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Su Hyeon Lim , Minkuk Kim , Hyeon Bae Kim , Seong Tae Kim

Retrieval-Augmented Generation (RAG) has been widely adopted to enhance Large Language Models (LLMs) in knowledge-intensive tasks. To enhance credibility and verifiability in RAG systems, Attributed Text Generation (ATG) is proposed, which…

Computation and Language · Computer Science 2025-05-26 Sirui Xia , Xintao Wang , Jiaqing Liang , Yifei Zhang , Weikang Zhou , Jiaji Deng , Fei Yu , Yanghua Xiao

Large language models (LLMs) have achieved remarkable advancements in natural language understanding and generation. However, one major issue towards their widespread deployment in the real world is that they can generate "hallucinated"…

Computation and Language · Computer Science 2024-04-04 Xi Ye , Ruoxi Sun , Sercan Ö. Arik , Tomas Pfister

Retrieval Augmented Generation (RAG) has emerged as a powerful application of Large Language Models (LLMs), revolutionizing information search and consumption. RAG systems combine traditional search capabilities with LLMs to generate…

Information Retrieval · Computer Science 2025-06-12 Harsh Maheshwari , Srikanth Tenneti , Alwarappan Nakkiran

Although Large Language Models (LLMs) have demonstrated extraordinary capabilities in many domains, they still have a tendency to hallucinate and generate fictitious responses to user requests. This problem can be alleviated by augmenting…

Information Retrieval · Computer Science 2023-06-09 Jiongnan Liu , Jiajie Jin , Zihan Wang , Jiehan Cheng , Zhicheng Dou , Ji-Rong Wen

Model editing aims to correct outdated or erroneous knowledge in large language models (LLMs) without the need for costly retraining. Lifelong model editing is the most challenging task that caters to the continuous editing requirements of…

Computation and Language · Computer Science 2025-03-17 Qizhou Chen , Taolin Zhang , Xiaofeng He , Dongyang Li , Chengyu Wang , Longtao Huang , Hui Xue

Retrieval-Augmented Generation (RAG) has been shown to enhance the factual accuracy of Large Language Models (LLMs), but existing methods often suffer from limited reasoning capabilities in effectively using the retrieved evidence,…

Computation and Language · Computer Science 2024-10-03 Shayekh Bin Islam , Md Asib Rahman , K S M Tozammel Hossain , Enamul Hoque , Shafiq Joty , Md Rizwan Parvez

The Retrieval-Augmented Language Model (RALM) has shown remarkable performance on knowledge-intensive tasks by incorporating external knowledge during inference, which mitigates the factual hallucinations inherited in large language models…

Computation and Language · Computer Science 2024-12-20 Yuan Xia , Jingbo Zhou , Zhenhui Shi , Jun Chen , Haifeng Huang

This paper contains what the Georgetown InfoSense group has done in regard to solving the challenges presented by TREC iKAT 2023. Our submitted runs outperform the median runs by a significant margin, exhibiting superior performance in nDCG…

Computation and Language · Computer Science 2023-11-17 Quinn Patwardhan , Grace Hui Yang

While recent Large Language Models (LLMs) have proven useful in answering user queries, they are prone to hallucination, and their responses often lack credibility due to missing references to reliable sources. An intuitive solution to…

Computation and Language · Computer Science 2024-09-04 Chengyu Huang , Zeqiu Wu , Yushi Hu , Wenya Wang

Retrieval-augmented generation (RAG) systems rely on retrieval models for identifying relevant contexts and answer generation models for utilizing those contexts. However, retrievers exhibit imperfect recall and precision, limiting…

Computation and Language · Computer Science 2026-04-29 Jerry Huang , Siddarth Madala , Risham Sidhu , Cheng Niu , Hao Peng , Julia Hockenmaier , Tong Zhang

Large language models (LLMs) often struggle with context fidelity, producing inconsistent answers when responding to questions based on provided information. Existing approaches either rely on expensive supervised fine-tuning to generate…

Computation and Language · Computer Science 2025-09-18 Suyuchen Wang , Jinlin Wang , Xinyu Wang , Shiqi Li , Xiangru Tang , Sirui Hong , Xiao-Wen Chang , Chenglin Wu , Bang Liu

Despite their impressive capabilities, large language models (LLMs) often face challenges such as temporal misalignment and generating hallucinatory content. Enhancing LLMs with retrieval mechanisms to fetch relevant information from…

Computation and Language · Computer Science 2024-06-21 Yige Shen , Hao Jiang , Hua Qu , Jihong Zhao

Large-scale pre-trained language models (LLMs) have demonstrated exceptional performance in various natural language processing (NLP) tasks. However, the massive size of these models poses huge challenges for their deployment in real-world…

Computation and Language · Computer Science 2023-10-25 Jiduan Liu , Jiahao Liu , Qifan Wang , Jingang Wang , Xunliang Cai , Dongyan Zhao , Ran Lucien Wang , Rui Yan

Though current long-context large language models (LLMs) have demonstrated impressive capacities in answering user questions based on extensive text, the lack of citations in their responses makes user verification difficult, leading to…

Computation and Language · Computer Science 2024-09-11 Jiajie Zhang , Yushi Bai , Xin Lv , Wanjun Gu , Danqing Liu , Minhao Zou , Shulin Cao , Lei Hou , Yuxiao Dong , Ling Feng , Juanzi Li

Large language models that use retrieval augmented generation have the potential to unlock valuable knowledge for researchers, policymakers, and the public by making long and technical climate-related documents more accessible. While this…

Computation and Language · Computer Science 2025-05-22 David Thulke , Jakob Kemmler , Christian Dugast , Hermann Ney

Large Language Models (LLMs) exhibit remarkable capabilities but are prone to generating inaccurate or hallucinatory responses. This limitation stems from their reliance on vast pretraining datasets, making them susceptible to errors in…

Computation and Language · Computer Science 2024-04-02 Chi-Min Chan , Chunpu Xu , Ruibin Yuan , Hongyin Luo , Wei Xue , Yike Guo , Jie Fu

Access to external knowledge is essential for many natural language processing tasks, such as question answering and dialogue. Existing methods often rely on a parametric model that stores knowledge in its parameters, or use a…

Computation and Language · Computer Science 2022-11-01 Yuxiang Wu , Yu Zhao , Baotian Hu , Pasquale Minervini , Pontus Stenetorp , Sebastian Riedel

Large Language Models (LLMs) have been integrated into recommender systems to enhance user behavior comprehension. The Retrieval Augmented Generation (RAG) technique is further incorporated into these systems to retrieve more relevant items…

Information Retrieval · Computer Science 2025-03-27 Sichun Luo , Jian Xu , Xiaojie Zhang , Linrong Wang , Sicong Liu , Hanxu Hou , Linqi Song