English
Related papers

Related papers: SIGIR 2025 -- LiveRAG Challenge Report

200 papers

With Retrieval Augmented Generation (RAG) becoming more and more prominent in generative AI solutions, there is an emerging need for systematically evaluating their effectiveness. We introduce the LiveRAG benchmark, a publicly available…

Computation and Language · Computer Science 2025-11-19 David Carmel , Simone Filice , Guy Horowitz , Yoelle Maarek , Alex Shtoff , Oren Somekh , Ran Tavory

Retrieval-Augmented Generation (RAG) enriches Large Language Models (LLMs) by combining their internal, parametric knowledge with external, non-parametric sources, with the goal of improving factual correctness and minimizing…

Information Retrieval · Computer Science 2025-08-13 Tim Cofala , Oleh Astappiev , William Xion , Hailay Teklehaymanot

We present TopClustRAG, a retrieval-augmented generation (RAG) system developed for the LiveRAG Challenge, which evaluates end-to-end question answering over large-scale web corpora. Our system employs a hybrid retrieval strategy combining…

Computation and Language · Computer Science 2025-06-19 Juli Bakagianni , John Pavlopoulos , Aristidis Likas

This paper presents the RMIT--ADM+S winning system in the SIGIR 2025 LiveRAG Challenge. Our Generation-Retrieval-Augmented Generation (G-RAG) approach generates a hypothetical answer that is used during the retrieval phase, alongside the…

Information Retrieval · Computer Science 2025-07-25 Kun Ran , Shuoqi Sun , Khoi Nguyen Dinh Anh , Damiano Spina , Oleg Zendel

This paper presents mRAG, a multi-agent retrieval-augmented generation (RAG) framework composed of specialized agents for subtasks such as planning, searching, reasoning, and coordination. Our system uses a self-training paradigm with…

Computation and Language · Computer Science 2025-06-13 Alireza Salemi , Mukta Maddipatla , Hamed Zamani

We present our submission to the LiveRAG Challenge 2025, which evaluates retrieval-augmented generation (RAG) systems on dynamic test sets using the FineWeb-10BT corpus. Our final hybrid approach combines sparse (BM25) and dense (E5)…

Computation and Language · Computer Science 2025-07-01 Chase Fensore , Kaustubh Dhole , Joyce C Ho , Eugene Agichtein

Retrieval-augmented generation (RAG) faces challenges related to factual correctness, source attribution, and response completeness. The LiveRAG Challenge hosted at SIGIR'25 aims to advance RAG research using a fixed corpus and a shared,…

Information Retrieval · Computer Science 2025-06-30 Weronika Łajewska , Ivica Kostric , Gabriel Iturra-Bocaz , Mariam Arustashvili , Krisztian Balog

This paper presents Team Marikarp's solution for the SIGIR 2025 LiveRAG competition. The competition's evaluation set, automatically generated by DataMorgana from internet corpora, encompassed a wide range of target topics, question types,…

Computation and Language · Computer Science 2025-06-26 Tong Zhou

This paper presents the submission of the UDInfo team to the SIGIR 2025 LiveRAG Challenge. We introduce PreQRAG, a Retrieval Augmented Generation (RAG) architecture designed to improve retrieval and generation quality through targeted…

Information Retrieval · Computer Science 2025-06-24 Damian Martinez , Catalina Riano , Hui Fang

Real-world live retrieval-augmented generation (RAG) systems face significant challenges when processing user queries that are often noisy, ambiguous, and contain multiple intents. While RAG enhances large language models (LLMs) with…

Computation and Language · Computer Science 2025-06-27 Guanting Dong , Xiaoxi Li , Yuyao Zhang , Mengjie Deng

Recently, increasing research interests have focused on retrieval augmented generation (RAG) to mitigate hallucination for large language models (LLMs). Following this trend, we launch the FutureDial-RAG challenge at SLT 2024, which aims at…

Computation and Language · Computer Science 2024-09-17 Yucheng Cai , Si Chen , Yuxuan Wu , Yi Huang , Junlan Feng , Zhijian Ou

Evaluating Retrieval-Augmented Generation (RAG) systems, especially in domain-specific contexts, requires benchmarks that address the distinctive requirements of the applicative scenario. Since real data can be hard to obtain, a common…

Computation and Language · Computer Science 2025-01-23 Simone Filice , Guy Horowitz , David Carmel , Zohar Karnin , Liane Lewin-Eytan , Yoelle Maarek

The question-answering system for Life science research, which is characterized by the rapid pace of discovery, evolving insights, and complex interactions among knowledge entities, presents unique challenges in maintaining a comprehensive…

Computation and Language · Computer Science 2024-08-15 Chengrui Wang , Qingqing Long , Meng Xiao , Xunxin Cai , Chengjun Wu , Zhen Meng , Xuezhi Wang , Yuanchun Zhou

Retrieval-Augmented Generation has made significant progress in the field of natural language processing. By combining the advantages of information retrieval and large language models, RAG can generate relevant and contextually appropriate…

Information Retrieval · Computer Science 2025-10-20 Da Li , Zecheng Fang , Qiang Yan , Wei Huang , Xuanpu Luo

Recent studies have explored graph-based approaches to retrieval-augmented generation, leveraging structured or semi-structured information -- such as entities and their relations extracted from documents -- to enhance retrieval. However,…

Computation and Language · Computer Science 2025-07-24 Zhili Shen , Chenxin Diao , Pascual Merita , Pavlos Vougiouklis , Jeff Z. Pan

We present BioRAGent, an interactive web-based retrieval-augmented generation (RAG) system for biomedical question answering. The system uses large language models (LLMs) for query expansion, snippet extraction, and answer generation while…

Computation and Language · Computer Science 2024-12-18 Samy Ateia , Udo Kruschwitz

This paper presents the award-winning RMIT-ADM+S system for the Text-to-Text track of the NeurIPS~2025 MMU-RAG Competition. We introduce Routing-to-RAG (R2RAG), a research-focused retrieval-augmented generation (RAG) architecture composed…

Retrieval-augmented generation (RAG) has gained wide attention as the key component to improve generative models with external knowledge augmentation from information retrieval. It has shown great prominence in enhancing the functionality…

Information Retrieval · Computer Science 2024-11-06 Zihan Wang , Xuri Ge , Joemon M. Jose , Haitao Yu , Weizhi Ma , Zhaochun Ren , Xin Xin

Retrieval-Augmented Generation (RAG) has recently emerged as a promising solution to alleviate Large Language Model (LLM)'s deficiency in lack of knowledge. Existing RAG datasets, however, do not adequately represent the diverse and dynamic…

Agentic Retrieval Augmented Generation (RAG) and 'deep research' systems aim to enable autonomous search processes where Large Language Models (LLMs) iteratively refine outputs. However, applying these systems to domain-specific…

Computation and Language · Computer Science 2025-08-08 Samy Ateia , Udo Kruschwitz
‹ Prev 1 2 3 10 Next ›