English
Related papers

Related papers: From RAGs to rich parameters: Probing how language…

200 papers

Retrieval-augmented generation (RAG) has emerged as a pivotal method for expanding the knowledge of large language models. To handle complex queries more effectively, researchers developed Adaptive-RAG (A-RAG) to enhance the generated…

Artificial Intelligence · Computer Science 2025-05-27 Jie Ou , Jinyu Guo , Shuaihong Jiang , Zhaokun Wang , Libo Qin , Shunyu Yao , Wenhong Tian

Retrieval-Augmented Generation (RAG) has emerged as a powerful technique for enhancing the quality of responses in Question-Answering (QA) tasks. However, existing approaches often struggle with retrieving contextually relevant information,…

Computation and Language · Computer Science 2026-01-27 Tianyi Yang , Nashrah Haque , Vaishnave Jonnalagadda , Yuya Jeremy Ong , Zhehui Chen , Yanzhao Wu , Lei Yu , Divyesh Jadav , Wenqi Wei

Large language models (LLMs) often struggle with knowledge intensive NLP tasks, such as answering "Who won the latest World Cup?" because the knowledge they learn during training may be insufficient or outdated. Conditioning generation on…

Computation and Language · Computer Science 2025-03-04 Matthew Finlayson , Ilia Kulikov , Daniel M. Bikel , Barlas Oguz , Xilun Chen , Aasish Pappu

Long-Context Question Answering (LCQA), a challenging task, aims to reason over long-context documents to yield accurate answers to questions. Existing long-context Large Language Models (LLMs) for LCQA often struggle with the "lost in the…

Computation and Language · Computer Science 2024-11-04 Qingfei Zhao , Ruobing Wang , Yukuo Cen , Daren Zha , Shicheng Tan , Yuxiao Dong , Jie Tang

Recent prompt-based text-to-speech (TTS) models can clone an unseen speaker using only a short speech prompt. They leverage a strong in-context ability to mimic the speech prompts, including speaker style, prosody, and emotion. Therefore,…

Sound · Computer Science 2024-06-07 Jinlong Xue , Yayue Deng , Yingming Gao , Ya Li

Large Language Models (LLMs) often generate inaccurate responses (hallucinations) when faced with questions beyond their knowledge scope. Retrieval-Augmented Generation (RAG) addresses this by leveraging external knowledge, but a critical…

Information Retrieval · Computer Science 2025-09-10 Haoxiang Jin , Ronghan Li , Zixiang Lu , Qiguang Miao

Large Language Models~(LLMs) are prone to hallucinations, and Retrieval-Augmented Generation (RAG) helps mitigate this, but at a high computational cost while risking misinformation. Adaptive retrieval aims to retrieve only when necessary,…

Large language models (LLMs) demonstrate strong performance in natural language processing but often generate factual errors when relying solely on parametric knowledge. Retrieval-Augmented Generation (RAG) mitigates these errors by…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Zhifeng Wang , Jason Jingshi Li , Kaihao Zhang , Ramesh Sankaranarayana

Retrieval-Augmented Generation (RAG) combines the language understanding and reasoning power of large language models (LLMs) with external retrieval to enable domain-grounded responses. Effectively adapting RAG systems to domain-specific…

Computation and Language · Computer Science 2026-04-14 Chris Xing Tian , Weihao Xie , Zhen Chen , Zhengyuan Yi , Hui Liu , Haoliang Li , Shiqi Wang , Siwei Ma

In order for large language models to achieve true conversational continuity and benefit from experiential learning, they need memory. While research has focused on the development of complex memory systems, it remains unclear which types…

Computation and Language · Computer Science 2025-12-09 Alessandra Terranova , Björn Ross , Alexandra Birch

Retrieval-Augmented Generation (RAG) grounds Large Language Models (LLMs) to mitigate factual hallucinations. Recent paradigms shift from static pipelines to Modular and Agentic RAG frameworks, granting models autonomy for multi-hop…

Information Retrieval · Computer Science 2026-03-03 Yichao Wu , Penghao Liang , Yafei Xiang , Mengwei Yuan , Jianan Liu , Jing Yang , Xianyou Li , Weiran Yan

Retrieval-Augmented Generation (RAG) offers an effective solution to the issues faced by Large Language Models (LLMs) in hallucination generation and knowledge obsolescence by incorporating externally retrieved knowledge. However, existing…

Computation and Language · Computer Science 2025-07-01 Yongxin Xu , Ruizhe Zhang , Xinke Jiang , Yujie Feng , Yuzhen Xiao , Xinyu Ma , Runchuan Zhu , Xu Chu , Junfeng Zhao , Yasha Wang

Retrieval-Augmented Generation (RAG) systems have emerged as a promising solution to mitigate LLM hallucinations and enhance their performance in knowledge-intensive domains. However, these systems are vulnerable to adversarial poisoning…

Information Retrieval · Computer Science 2025-07-29 Jinyan Su , Jin Peng Zhou , Zhengxin Zhang , Preslav Nakov , Claire Cardie

Retrieval-Augmented Generation (RAG) has recently demonstrated the performance of Large Language Models (LLMs) in the knowledge-intensive tasks such as Question-Answering (QA). RAG expands the query context by incorporating external…

Machine Learning · Computer Science 2024-06-18 Zijian Hei , Weiling Liu , Wenjie Ou , Juyi Qiao , Junming Jiao , Guowen Song , Ting Tian , Yi Lin

Retrieval-Augmented Generation (RAG) has emerged as a powerful framework to improve factuality in large language models (LLMs) by grounding their outputs in retrieved documents. However, ensuring perfect retrieval of relevant information…

Computation and Language · Computer Science 2025-12-04 Zhan Peng Lee , Andre Lin , Calvin Tan

Retrieval Augmented Generation (RAG) is a common method for integrating external knowledge into pretrained Large Language Models (LLMs) to enhance accuracy and relevancy in question answering (QA) tasks. However, prompt engineering and…

Computation and Language · Computer Science 2024-10-18 Isaac Chung , Phat Vo , Arman C. Kizilkale , Aaron Reite

Retrieval-augmented generation (RAG) improves performance on knowledge-intensive tasks but can be derailed by wrong, irrelevant, or conflicting retrieved text, causing models to rely on inaccurate evidence and cascade errors. We propose…

Computation and Language · Computer Science 2026-02-26 Chenyu Lin , Yilin Wen , Du Su , Hexiang Tan , Fei Sun , Muhan Chen , Chenfu Bao , Zhonghou Lyu

Retrieval-augmented generation (RAG) has become a cornerstone of contemporary NLP, enhancing large language models (LLMs) by allowing them to access richer factual contexts through in-context retrieval. While effective in monolingual…

Computation and Language · Computer Science 2026-03-31 Leonardo Ranaldi , Barry Haddow , Alexandra Birch

Retrieval-augmented generation (RAG) has emerged as a promising paradigm for improving factual accuracy in large language models (LLMs). We introduce a benchmark designed to evaluate RAG pipelines as a whole, evaluating a pipeline's ability…

Artificial Intelligence · Computer Science 2026-05-25 Samuel Hildebrand , Curtis Taylor , Sean Oesch , James M Ghawaly , Amir Sadovnik , Ryan Shivers , Brandon Schreiber , Kevin Kurian

This technical report details a novel approach to combining reasoning and retrieval augmented generation (RAG) within a single, lean language model architecture. While existing RAG systems typically rely on large-scale models and external…