English
Related papers

Related papers: When retrieval outperforms generation: Dense evide…

200 papers

Verifiable generation aims to let the large language model (LLM) generate text with supporting documents, which enables the user to flexibly verify the answer and makes the LLM's output more reliable. Retrieval plays a crucial role in…

Computation and Language · Computer Science 2024-03-28 Xiaonan Li , Changtai Zhu , Linyang Li , Zhangyue Yin , Tianxiang Sun , Xipeng Qiu

Dense retrievers and rerankers are central to retrieval-augmented generation (RAG) pipelines, where accurately retrieving factual information is crucial for maintaining system trustworthiness and defending against RAG poisoning. However,…

Information Retrieval · Computer Science 2025-08-29 Haoyu Wu , Qingcheng Zeng , Kaize Ding

Retrieval Augmented Generation (RAG) has emerged as a powerful application of Large Language Models (LLMs), revolutionizing information search and consumption. RAG systems combine traditional search capabilities with LLMs to generate…

Information Retrieval · Computer Science 2025-06-12 Harsh Maheshwari , Srikanth Tenneti , Alwarappan Nakkiran

Large Language Models (LLMs) have achieved remarkable progress in language understanding and generation. Custom LLMs leveraging textual features have been applied to recommendation systems, demonstrating improvements across various…

Information Retrieval · Computer Science 2024-06-19 Shaohuang Wang , Lun Wang , Yunhan Bu , Tianwei Huang

We present the DEREK (Deep Extraction & Reasoning Engine for Knowledge) Module, a secure and scalable Retrieval-Augmented Generation pipeline designed specifically for enterprise document question answering. Designed and implemented by…

Computation and Language · Computer Science 2025-07-23 Isaac Shi , Zeyuan Li , Fan Liu , Wenli Wang , Lewei He , Yang Yang , Tianyu Shi

The hallucinations of large language models (LLMs) are increasingly mitigated by allowing LLMs to search for information and to ground their answers in real sources. Unfortunately, LLMs often struggle with posing the right search queries,…

Machine Learning · Computer Science 2024-11-01 Sheryl Hsu , Omar Khattab , Chelsea Finn , Archit Sharma

Large Language Models (LLMs) augmented with retrieval mechanisms have demonstrated significant potential in fact-checking tasks by integrating external knowledge. However, their reliability decreases when confronted with conflicting…

Computation and Language · Computer Science 2025-05-26 Ziyu Ge , Yuhao Wu , Daniel Wai Kit Chin , Roy Ka-Wei Lee , Rui Cao

Dense vector retrieval is the practical backbone of Retrieval- Augmented Generation (RAG), but similarity search can suffer from precision limitations. Conversely, utility-based approaches leveraging LLM re-ranking often achieve superior…

Information Retrieval · Computer Science 2026-04-27 Rajinder Sandhu , Di Mu , Cheng Chang , Md Shahriar Tasjid , Himanshu Rai , Maksims Volkovs , Ga Wu

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by integrating external knowledge bases, achieving state-of-the-art results in various coding tasks. The core of RAG is retrieving demonstration examples, which is…

Software Engineering · Computer Science 2025-02-25 Pengfei He , Shaowei Wang , Shaiful Chowdhury , Tse-Hsun Chen

Large Language Models (LLMs) often generate inaccurate responses (hallucinations) when faced with questions beyond their knowledge scope. Retrieval-Augmented Generation (RAG) addresses this by leveraging external knowledge, but a critical…

Information Retrieval · Computer Science 2025-09-10 Haoxiang Jin , Ronghan Li , Zixiang Lu , Qiguang Miao

Large Language Models (LLMs) have achieved impressive progress in natural language processing, but their limited ability to retain long-term context constrains performance on document-level or multi-turn tasks. Retrieval-Augmented…

Computation and Language · Computer Science 2025-05-20 Zhangyu Wang , Siyuan Gao , Rong Zhou , Hao Wang , Li Ning

Large Reasoning Models (LRMs) exhibit remarkable reasoning abilities but rely primarily on parametric knowledge, limiting factual accuracy. While recent works equip reinforcement learning (RL)-based LRMs with retrieval capabilities, they…

Computation and Language · Computer Science 2025-05-20 Zhicheng Lee , Shulin Cao , Jinxin Liu , Jiajie Zhang , Weichuan Liu , Xiaoyin Che , Lei Hou , Juanzi Li

Dense retrievers enhance retrieval by encoding queries and documents into continuous vectors, but they often struggle with reasoning-intensive queries. Although Large Language Models (LLMs) can reformulate queries to capture complex…

Information Retrieval · Computer Science 2025-10-29 Yichi Zhang , Jun Bai , Zhixin Cai , Shuhan Qin , Zhuofan Chen , Jinghua Guan , Wenge Rong

Retrieval-Augmented Generation (RAG) significantly improves the factuality of Large Language Models (LLMs), yet standard pipelines often lack mechanisms to verify inter- mediate reasoning, leaving them vulnerable to hallucinations in…

Computation and Language · Computer Science 2026-03-12 Eeham Khan , Luis Rodriguez , Marc Queudot

Recent work has shown that directly fine-tuning large language models (LLMs) for dense retrieval yields strong performance, but their substantial parameter counts make them computationally inefficient. While prior studies have revealed…

Information Retrieval · Computer Science 2025-12-24 Yibin Lei , Shwai He , Ang Li , Andrew Yates

Retrieval-Augmented Generation (RAG) effectively enhances Large Language Models (LLMs) by incorporating retrieved external knowledge into the generation process. Reasoning models improve LLM performance in multi-hop QA tasks, which require…

Computation and Language · Computer Science 2026-01-21 Guo Chen , Junjie Huang , Huaijin Xie , Fei Sun , Tao Jia

Dense retrieval methods have shown great promise over sparse retrieval methods in a range of NLP problems. Among them, dense phrase retrieval-the most fine-grained retrieval unit-is appealing because phrases can be directly used as the…

Computation and Language · Computer Science 2021-09-17 Jinhyuk Lee , Alexander Wettig , Danqi Chen

Large Language Models (LLMs) have shown great potential in reasoning tasks through test-time scaling methods like self-consistency with majority voting. However, this approach often leads to diminishing returns in accuracy and high…

Machine Learning · Computer Science 2025-08-22 Yichao Fu , Xuewei Wang , Yuandong Tian , Jiawei Zhao

Large language models (LLMs) suffer from high inference latency due to the auto-regressive decoding process. Speculative decoding accelerates inference by generating multiple draft tokens using a lightweight model and verifying them in…

Machine Learning · Computer Science 2025-05-27 Yixuan Wang , Yijun Liu , Shiyu ji , Yuzhuang Xu , Yang Xu , Qingfu Zhu , Wanxiang Che

Hallucination remains a major challenge for the safe and trustworthy deployment of large language models (LLMs) in factual content generation. Prior work has explored confidence estimation as an effective approach to hallucination…

Computation and Language · Computer Science 2026-05-15 Caiqi Zhang , Xiaochen Zhu , Chengzu Li , Nigel Collier , Andreas Vlachos