English
Related papers

Related papers: IndicRAGSuite: Large-Scale Datasets and a Benchmar…

200 papers

Retrieval-Augmented Generation (RAG) has become the standard approach for grounding large language models in information that was not available during training. While existing datasets and benchmarks focus on web or other public sources,…

Information Retrieval · Computer Science 2026-05-21 Yuhong Sun , Joachim Rahmfeld , Chris Weaver , Weijia Chen , Roshan Desai , Wenxi Huang , Mark H. Butler

Large Language Models (LLMs) have made significant progress in incorporating Indic languages within multilingual models. However, it is crucial to quantitatively assess whether these languages perform comparably to globally dominant ones,…

Computation and Language · Computer Science 2024-10-31 Pritika Rohera , Chaitrali Ginimav , Akanksha Salunke , Gayatri Sawant , Raviraj Joshi

We propose XRAG, a novel benchmark designed to evaluate the generation abilities of LLMs in cross-lingual Retrieval-Augmented Generation (RAG) settings where the user language does not match the retrieval results. XRAG is constructed from…

Computation and Language · Computer Science 2025-05-16 Wei Liu , Sony Trenous , Leonardo F. R. Ribeiro , Bill Byrne , Felix Hieber

We present a new benchmark for evaluating Deep Search--a realistic and complex form of retrieval-augmented generation (RAG) that requires source-aware, multi-hop reasoning over diverse, sparsed, but related sources. These include documents,…

Computation and Language · Computer Science 2025-07-01 Prafulla Kumar Choubey , Xiangyu Peng , Shilpa Bhagavath , Kung-Hsiang Huang , Caiming Xiong , Chien-Sheng Wu

As one of the most advanced techniques in AI, Retrieval-Augmented Generation (RAG) can offer reliable and up-to-date external knowledge, providing huge convenience for numerous tasks. Particularly in the era of AI-Generated Content (AIGC),…

Computation and Language · Computer Science 2024-06-18 Wenqi Fan , Yujuan Ding , Liangbo Ning , Shijie Wang , Hengyun Li , Dawei Yin , Tat-Seng Chua , Qing Li

A Comparison of Independent and Joint Fine-tuning Strategies for Retrieval-Augmented Generation Download PDF Neal Gregory Lawton, Alfy Samuel, Anoop Kumar, Daben Liu Published: 20 Aug 2025, Retrieval augmented generation (RAG) is a popular…

Computation and Language · Computer Science 2025-10-21 Neal Gregory Lawton , Alfy Samuel , Anoop Kumar , Daben Liu

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by integrating external knowledge retrieved at inference time. While RAG demonstrates strong performance on benchmarks largely derived from general-domain corpora…

Computation and Language · Computer Science 2025-07-29 Ran Xu , Yuchen Zhuang , Yue Yu , Haoyu Wang , Wenqi Shi , Carl Yang

Known by more than 1.5 billion people in the Indian subcontinent, Indic languages present unique challenges and opportunities for natural language processing (NLP) research due to their rich cultural heritage, linguistic diversity, and…

Computation and Language · Computer Science 2025-01-29 Sankalp KJ , Ashutosh Kumar , Laxmaan Balaji , Nikunj Kotecha , Vinija Jain , Aman Chadha , Sreyoshi Bhaduri

While large language models excel on high-resource multilingual tasks, low- and extremely low-resource Indic languages remain severely under-evaluated. We present IndicParam, a human-curated benchmark of over 13,000 multiple-choice…

Computation and Language · Computer Science 2026-01-13 Ayush Maheshwari , Kaushal Sharma , Vivek Patel , Aditya Maheshwari

Retrieval-augmented generation (RAG) is key to enhancing large language models (LLMs) to systematically access richer factual knowledge. Yet, using RAG brings intrinsic challenges, as LLMs must deal with potentially conflicting knowledge,…

Computation and Language · Computer Science 2025-04-08 Leonardo Ranaldi , Federico Ranaldi , Fabio Massimo Zanzotto , Barry Haddow , Alexandra Birch

This paper introduces uRAG--a framework with a unified retrieval engine that serves multiple downstream retrieval-augmented generation (RAG) systems. Each RAG system consumes the retrieval results for a unique purpose, such as open-domain…

Computation and Language · Computer Science 2024-05-02 Alireza Salemi , Hamed Zamani

Recent advancements in large language models (LLMs) and multi-modal LLMs have been remarkable. However, these models still rely solely on their parametric knowledge, which limits their ability to generate up-to-date information and…

Artificial Intelligence · Computer Science 2025-04-22 Zihan Ling , Zhiyao Guo , Yixuan Huang , Yi An , Shuai Xiao , Jinsong Lan , Xiaoyong Zhu , Bo Zheng

Retrieval-Augmented Generation (RAG) is an effective approach to enhance the factual accuracy of large language models (LLMs) by retrieving information from external databases, which are typically composed of diverse sources, to supplement…

Machine Learning · Computer Science 2025-10-15 Jeongyeon Hwang , Junyoung Park , Hyejin Park , Dongwoo Kim , Sangdon Park , Jungseul Ok

Retrieval-Augmented Generation (RAG) offers a promising solution to address various limitations of Large Language Models (LLMs), such as hallucination and difficulties in keeping up with real-time updates. This approach is particularly…

Computation and Language · Computer Science 2024-06-18 Shuting Wang , Jiongnan Liu , Shiren Song , Jiehan Cheng , Yuqi Fu , Peidong Guo , Kun Fang , Yutao Zhu , Zhicheng Dou

Retrieval-augmented generation (RAG) has emerged as an approach to augment large language models (LLMs) by reducing their reliance on static knowledge and improving answer factuality. RAG retrieves relevant context snippets and generates an…

Computation and Language · Computer Science 2025-02-21 Juraj Vladika , Florian Matthes

Large Language Models (LLMs) has shown exceptional capabilities in many natual language understanding and generation tasks. However, the personalization issue still remains a much-coveted property, especially when it comes to the multiple…

Computation and Language · Computer Science 2024-11-27 Hongru Wang , Wenyu Huang , Yang Deng , Rui Wang , Zezhong Wang , Yufei Wang , Fei Mi , Jeff Z. Pan , Kam-Fai Wong

Access to reliable agricultural advisory remains limited in many developing regions due to a persistent language barrier: authoritative agricultural manuals are predominantly written in English, while farmers primarily communicate in…

Computation and Language · Computer Science 2026-01-06 Md. Asif Hossain , Nabil Subhan , Mantasha Rahman Mahi , Jannatul Ferdous Nabila

Retrieval-Augmented Generation (RAG) systems are showing promising potential, and are becoming increasingly relevant in AI-powered legal applications. Existing benchmarks, such as LegalBench, assess the generative capabilities of Large…

Artificial Intelligence · Computer Science 2024-08-21 Nicholas Pipitone , Ghita Houir Alami

Large Language Models (LLMs) are tools that have become indispensable in development and programming. However, they suffer from hallucinations, especially when dealing with unknown knowledge. This is particularly the case when LLMs are to…

Computation and Language · Computer Science 2026-05-05 Andreas Baumann , Peter Eberhard

Retrieval-augmented systems are typically evaluated in settings where information required to answer the query can be found within a single source or the answer is short-form or factoid-based. However, many real-world applications demand…

Computation and Language · Computer Science 2025-08-29 Rohan Phanse , Yijie Zhou , Kejian Shi , Wencai Zhang , Yixin Liu , Yilun Zhao , Arman Cohan