English
Related papers

Related papers: FreshStack: Building Realistic Benchmarks for Eval…

200 papers

Large language models (LLMs) often need to incorporate external knowledge to solve theme-specific problems. Retrieval-augmented generation (RAG) has shown its high promise, empowering LLMs to generate more qualified responses with retrieved…

Machine Learning · Computer Science 2025-08-05 Jimeng Shi , Sizhe Zhou , Bowen Jin , Wei Hu , Runchu Tian , Shaowen Wang , Giri Narasimhan , Jiawei Han

Multimodal documents contain diverse elements, such as tables, figures, and layouts, which can complicate retrieval tasks. While current approaches typically combine dense visual embedding models with supervised rerankers to achieve…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Ruofan Hu , Menghui Zhu , Jieming Zhu , Bo Chen , Shengyang Xu , Minjie Hong , Xiaoda Yang , Sashuai Zhou , Li Tang , Tao Jin , Zhou Zhao

With the rapid development of large-scale language models, Retrieval-Augmented Generation (RAG) has been widely adopted. However, existing RAG paradigms are inevitably influenced by erroneous retrieval information, thereby reducing the…

Information Retrieval · Computer Science 2024-05-30 Ridong Wu , Shuhong Chen , Xiangbiao Su , Yuankai Zhu , Yifei Liao , Jianming Wu

Recent research in retrieval-augmented generation (RAG) has concentrated on retrieving useful information from candidate documents. However, numerous methodologies frequently neglect the calibration capabilities of large language models…

Computation and Language · Computer Science 2025-06-23 Guanhua Chen , Yutong Yao , Lidia S. Chao , Xuebo Liu , Derek F. Wong

Retrieval-augmented language models (RALMs) hold promise to produce language understanding systems that are are factual, efficient, and up-to-date. An important desideratum of RALMs, is that retrieved information helps model performance…

Computation and Language · Computer Science 2024-05-07 Ori Yoran , Tomer Wolfson , Ori Ram , Jonathan Berant

Reasoning-intensive retrieval requires deep semantic inference beyond surface-level keyword matching, posing a challenge for current LLM-based rerankers limited by context constraints and order sensitivity. We propose \textbf{\BracketRank},…

Information Retrieval · Computer Science 2026-04-13 Abdelrahman Abdallah , Mohammed Ali , Bhawna Piryani , Adam Jatowt

Retrieval Augmented Generation (RAG) is a promising technique for mitigating two key limitations of large language models (LLMs): outdated information and hallucinations. RAG system stores documents as embedding vectors in a database. Given…

Information Retrieval · Computer Science 2026-02-10 Taehee Jeong , Xingzhe Zhao , Peizu Li , Markus Valvur , Weihua Zhao

The widely used retrieve-and-rerank pipeline faces two critical limitations: they are constrained by the initial retrieval quality of the top-k documents, and the growing computational demands of LLM-based rerankers restrict the number of…

Information Retrieval · Computer Science 2025-09-10 Haike Xu , Tong Chen

Large language models (LLMs), including zero-shot and few-shot paradigms, have shown promising capabilities in clinical text generation. However, real-world applications face two key challenges: (1) patient data is highly unstructured,…

Computation and Language · Computer Science 2025-07-10 Garapati Keerthana , Manik Gupta

Retrieval-Augmented Generation (RAG) architectures have recently garnered significant attention for their ability to improve truth grounding and coherence in natural language processing tasks. However, the reliability of RAG systems in…

Computation and Language · Computer Science 2024-12-04 Joel Suro

Much of the information processed by Information Retrieval (IR) systems is unreliable, biased, and generally untrustworthy [1], [2], [3]. Yet, factuality & objectivity detection is not a standard component of IR systems, even though it has…

Information Retrieval · Computer Science 2016-10-11 Christina Lioma , Birger Larsen , Wei Lu , Yong Huang

Evaluation plays a crucial role in the advancement of information retrieval (IR) models. However, current benchmarks, which are based on predefined domains and human-labeled data, face limitations in addressing evaluation needs for emerging…

Information Retrieval · Computer Science 2025-07-25 Jianlyu Chen , Nan Wang , Chaofan Li , Bo Wang , Shitao Xiao , Han Xiao , Hao Liao , Defu Lian , Zheng Liu

Retrieval-Augmented Generation (RAG) is a cornerstone of modern question answering (QA) systems, enabling grounded answers based on external knowledge. Although recent progress has been driven by open-domain datasets, enterprise QA systems…

Artificial Intelligence · Computer Science 2025-05-14 Dvir Cohen , Lin Burg , Sviatoslav Pykhnivskyi , Hagit Gur , Stanislav Kovynov , Olga Atzmon , Gilad Barkan

Retrieval-Augmented Generation (RAG) has emerged as a powerful paradigm to enhance large language models (LLMs) by conditioning generation on external evidence retrieved at inference time. While RAG addresses critical limitations of…

Information Retrieval · Computer Science 2025-06-03 Chaitanya Sharma

Retrieval-Augmented Generation (RAG) has been used in question answering (QA) systems to improve performance when relevant information is in one (single-hop) or multiple (multi-hop) passages. However, many real life scenarios (e.g. dealing…

Computation and Language · Computer Science 2026-04-02 Mykolas Sveistrys , Richard Kunert

Neural information retrieval (IR) systems have progressed rapidly in recent years, in large part due to the release of publicly available benchmarking tasks. Unfortunately, some dimensions of this progress are illusory: the majority of the…

Document-based question answering (QA) increasingly includes abstract questions that require synthesizing scattered information from long documents or across multiple documents into coherent answers. However, this setting is still poorly…

Computation and Language · Computer Science 2026-05-12 Shu Wang , Shansong Zhou , Xinyang Wang , Shiwei Wang , Hulong Wu , Yixiang Fang

This paper presents the submission of the UDInfo team to the SIGIR 2025 LiveRAG Challenge. We introduce PreQRAG, a Retrieval Augmented Generation (RAG) architecture designed to improve retrieval and generation quality through targeted…

Information Retrieval · Computer Science 2025-06-24 Damian Martinez , Catalina Riano , Hui Fang

In the field of Material Science, effective information retrieval systems are essential for facilitating research. Traditional Retrieval-Augmented Generation (RAG) approaches in Large Language Models (LLMs) often encounter challenges such…

Information Retrieval · Computer Science 2024-12-03 Radeen Mostafa , Mirza Nihal Baig , Mashaekh Tausif Ehsan , Jakir Hasan

The automated generation of research workflows is essential for improving the reproducibility of research and accelerating the paradigm of "AI for Science". However, existing methods typically extract merely fragmented procedural components…

Computation and Language · Computer Science 2025-09-24 Heng Zhang , Chengzhi Zhang