English
Related papers

Related papers: When retrieval outperforms generation: Dense evide…

200 papers

Despite strong performance on existing benchmarks, it remains unclear whether large language models can reason over genuinely novel scientific information. Most evaluations score end-to-end RAG pipelines, where reasoning is confounded with…

With the emergence of Large Language Models (LLMs), new methods in Information Retrieval are available in which relevance is estimated directly through language understanding and reasoning, instead of embedding similarity. We argue that…

Information Retrieval · Computer Science 2026-03-10 Matei Benescu , Ivo Pascal de Jong

Dense retrieval has made significant advancements in information retrieval (IR) by achieving high levels of effectiveness while maintaining online efficiency during a single-pass retrieval process. However, the application of pseudo…

Information Retrieval · Computer Science 2023-08-22 Xueru Wen , Xiaoyang Chen , Xuanang Chen , Ben He , Le Sun

Retrieval-Augmented Generation (RAG) has emerged as a powerful framework to improve factuality in large language models (LLMs) by grounding their outputs in retrieved documents. However, ensuring perfect retrieval of relevant information…

Computation and Language · Computer Science 2025-12-04 Zhan Peng Lee , Andre Lin , Calvin Tan

Large language models are limited by challenges in factuality and hallucinations to be directly employed off-the-shelf for judging the veracity of news articles, where factual accuracy is paramount. In this work, we propose DELL that…

Computation and Language · Computer Science 2024-07-08 Herun Wan , Shangbin Feng , Zhaoxuan Tan , Heng Wang , Yulia Tsvetkov , Minnan Luo

Large language models (LLMs) inevitably exhibit hallucinations since the accuracy of generated texts cannot be secured solely by the parametric knowledge they encapsulate. Although retrieval-augmented generation (RAG) is a practicable…

Computation and Language · Computer Science 2024-10-08 Shi-Qi Yan , Jia-Chen Gu , Yun Zhu , Zhen-Hua Ling

Retrieval-Augmented Generation (RAG) effectively improves the accuracy of Large Language Models (LLMs). However, retrieval noises significantly undermine the quality of LLMs' generation, necessitating the development of denoising…

Computation and Language · Computer Science 2026-04-21 Xinping Zhao , Shouzheng Huang , Yan Zhong , Xinshuo Hu , Meishan Zhang , Baotian Hu , Min Zhang

Dense retrieval is a basic building block of information retrieval applications. One of the main challenges of dense retrieval in real-world settings is the handling of queries containing misspelled words. A popular approach for handling…

While Retrieval-Augmented Generation (RAG) systems enhance Large Language Models (LLMs) by incorporating external knowledge, they still face persistent challenges in retrieval inefficiency and the inability of LLMs to filter out irrelevant…

Computation and Language · Computer Science 2025-02-13 Ruobing Yao , Yifei Zhang , Shuang Song , Yuhua Liu , Neng Gao , Chenyang Tu

Dense retrievers in retrieval-augmented generation (RAG) systems exhibit systematic biases -- including brevity, position, literal matching, and repetition biases -- that can compromise retrieval quality. Query rewriting techniques are now…

Information Retrieval · Computer Science 2026-04-21 Agam Goyal , Koyel Mukherjee , Apoorv Saxena , Anirudh Phukan , Eshwar Chandrasekharan , Hari Sundaram

Deep learning malware detectors achieve high classification accuracy but suffer from severe interpretability limitations, typically returning probabilistic verdicts that lack forensic context. We introduce AsmRAG, a framework performing…

Cryptography and Security · Computer Science 2026-04-28 ElMouatez Billah Karbab

The development of large language models (LLMs) has achieved superior performance in a range of downstream tasks, including LLM-based retrieval-augmented generation (RAG). The quality of generated content heavily relies on the usefulness of…

Computation and Language · Computer Science 2026-01-27 Fengran Mo , Zhan Su , Yuchen Hui , Jinghan Zhang , Jia Ao Sun , Zheyuan Liu , Chao Zhang , Tetsuya Sakai , Jian-Yun Nie

Transformer-based models such as BERT and E5 have significantly advanced text embedding by capturing rich contextual representations. However, many complex real-world queries require sophisticated reasoning to retrieve relevant documents…

Computation and Language · Computer Science 2025-09-03 Yuxiang Liu , Tian Wang , Gourab Kundu , Tianyu Cao , Guang Cheng , Zhen Ge , Jianshu Chen , Qingjun Cui , Trishul Chilimbi

Despite their remarkable capabilities, large language models (LLMs) often produce responses containing factual inaccuracies due to their sole reliance on the parametric knowledge they encapsulate. Retrieval-Augmented Generation (RAG), an ad…

Computation and Language · Computer Science 2023-10-19 Akari Asai , Zeqiu Wu , Yizhong Wang , Avirup Sil , Hannaneh Hajishirzi

Large reasoning models such as DeepSeek-R1 and OpenAI o1 generate extended chains of thought spanning thousands of tokens, yet their integration with retrieval-augmented generation (RAG) remains fundamentally misaligned. Current RAG systems…

Information Retrieval · Computer Science 2026-04-30 Dongxin Guo , Jikun Wu , Siu Ming Yiu

Retrieval-Augmented Generation (RAG) enables Large Language Models (LLMs) to extend their existing knowledge by dynamically incorporating external information. However, practical deployment is fundamentally constrained by the LLM's finite…

Information Retrieval · Computer Science 2026-03-24 Jiarui Guo , Yuemeng Xu , Zongwei Lv , Yangyujia Wang , Xiaolin Wang , Kan Liu , Tao Lan , Lin Qu , Tong Yang

Large Language Models (LLMs)-based text retrieval retrieves documents relevant to search queries based on vector similarities. Documents are pre-encoded offline, while queries arrive in real-time, necessitating an efficient online query…

Information Retrieval · Computer Science 2026-02-02 Guangyuan Ma , Yongliang Ma , Xuanrui Gou , Zhenpeng Su , Ming Zhou , Songlin Hu

Separating disinformation from fact on the web has long challenged both the search and the reasoning powers of humans. We show that the reasoning power of large language models (LLMs) and the retrieval power of modern search engines can be…

Computation and Language · Computer Science 2024-11-11 Christopher Malon

Retrieval-augmented generation (RAG) systems have advanced large language models (LLMs) in complex deep search scenarios requiring multi-step reasoning and iterative information retrieval. However, existing approaches face critical…

Computation and Language · Computer Science 2025-10-09 Shuang Sun , Huatong Song , Yuhao Wang , Ruiyang Ren , Jinhao Jiang , Junjie Zhang , Fei Bai , Jia Deng , Wayne Xin Zhao , Zheng Liu , Lei Fang , Zhongyuan Wang , Ji-Rong Wen

Retrieval-augmented generation (RAG) has shown promising potential to enhance the accuracy and factuality of language models (LMs). However, imperfect retrievers or noisy corpora can introduce misleading or even erroneous information to the…

Computation and Language · Computer Science 2025-03-04 Zhepei Wei , Wei-Lin Chen , Yu Meng