English
Related papers

Related papers: Quality analysis and evaluation prediction of RAG …

200 papers

Multilingual Retrieval-Augmented Generation (mRAG) systems enable language models to answer knowledge-intensive queries with citation-supported responses across languages. While such systems have been proposed, an open questions is whether…

Computation and Language · Computer Science 2025-10-03 Dayeon Ki , Marine Carpuat , Paul McNamee , Daniel Khashabi , Eugene Yang , Dawn Lawrie , Kevin Duh

Retrieval-Augmented Generation (RAG) prevails in Large Language Models. It mainly consists of retrieval and generation. The retrieval modules (a.k.a. retrievers) aim to find useful information used to facilitate the generation modules…

Information Retrieval · Computer Science 2025-02-18 Xinping Zhao , Yan Zhong , Zetian Sun , Xinshuo Hu , Zhenyu Liu , Dongfang Li , Baotian Hu , Min Zhang

Large Language Models (LLMs) have demonstrated impressive ability in generation and reasoning tasks but struggle with handling up-to-date knowledge, leading to inaccuracies or hallucinations. Retrieval-Augmented Generation (RAG) mitigates…

Databases · Computer Science 2026-03-13 Ziting Wang , Haitao Yuan , Wei Dong , Gao Cong , Feifei Li

Retrieval augmented generation (RAG) has been applied in many scenarios to augment large language models (LLMs) with external documents provided by retrievers. However, a semantic gap exists between LLMs and retrievers due to differences in…

Computation and Language · Computer Science 2024-10-31 Fuda Ye , Shuangyin Li , Yongqi Zhang , Lei Chen

This research paper presents a comprehensive analysis of integrating advanced language models with search and retrieval systems in the fields of information retrieval and natural language processing. The objective is to evaluate and compare…

Information Retrieval · Computer Science 2024-05-06 Dmytro Mozolevskyi , Waseem AlShikh

Retrieval-Augmented Generation (RAG) is a prevalent approach to infuse a private knowledge base of documents with Large Language Models (LLM) to build Generative Q\&A (Question-Answering) systems. However, RAG accuracy becomes increasingly…

Information Retrieval · Computer Science 2025-03-10 Kunal Sawarkar , Abhilasha Mangal , Shivam Raj Solanki

Cross-lingual retrieval-augmented generation (RAG) is a critical capability for retrieving and generating answers across languages. Prior work in this context has mostly focused on generation and relied on benchmarks derived from…

Computation and Language · Computer Science 2025-10-28 Chen Amiraz , Yaroslav Fyodorov , Elad Haramaty , Zohar Karnin , Liane Lewin-Eytan

RAG systems face limitations when semantic relevance alone does not guarantee improved generation quality. This issue becomes particularly evident due to the sensitivity of large language models (LLMs) to the ordering of few-shot prompts,…

Information Retrieval · Computer Science 2024-11-04 Yu Bai , Yukai Miao , Li Chen , Dawei Wang , Dan Li , Yanyu Ren , Hongtao Xie , Ce Yang , Xuhui Cai

Ranking models play a crucial role in enhancing overall accuracy of text retrieval systems. These multi-stage systems typically utilize either dense embedding models or sparse lexical indices to retrieve relevant passages based on a given…

Information Retrieval · Computer Science 2024-09-13 Gabriel de Souza P. Moreira , Ronay Ak , Benedikt Schifferer , Mengyao Xu , Radek Osmulski , Even Oldridge

Retrieval Augmented Generation or RAG is the most popular pattern for modern Large Language Model or LLM applications. RAG involves taking a user query and finding relevant paragraphs of context in a large corpus typically captured in a…

Information Retrieval · Computer Science 2024-08-20 Dattaraj Rao

Retrieval-Augmented Generation (RAG) enhances recency and factuality in answers. However, existing evaluations rarely test how well these systems cope with real-world noise, conflicting between internal and external retrieved contexts, or…

Computation and Language · Computer Science 2025-10-29 Yixiao Zeng , Tianyu Cao , Danqing Wang , Xinran Zhao , Zimeng Qiu , Morteza Ziyadi , Tongshuang Wu , Lei Li

Conventional Retrieval-Augmented Generation (RAG) systems often struggle with complex multi-hop queries over long documents due to their single-pass retrieval. We introduce MM-Doc-R1, a novel framework that employs an agentic, vision-aware…

Computation and Language · Computer Science 2026-04-16 Jiahang Lin , Kai Hu , Binghai Wang , Yuhao Zhou , Zhiheng Xi , Honglin Guo , Shichun Liu , Junzhe Wang , Shihan Dou , Enyu Zhou , Hang Yan , Zhenhua Han , Tao Gui , Qi Zhang , Xuanjing Huang

This paper compares the performances of three supervised machine learning algorithms in terms of predictive ability and model interpretation on structured or tabular data. The algorithms considered were scikit-learn implementations of…

Machine Learning · Statistics 2022-05-06 Alice J. Liu , Arpita Mukherjee , Linwei Hu , Jie Chen , Vijayan N. Nair

Despite the impressive performance of Retrieval-augmented Generation (RAG) systems across various NLP benchmarks, their robustness in handling real-world user-LLM interaction queries remains largely underexplored. This presents a critical…

Computation and Language · Computer Science 2026-01-28 Tianyu Cao , Neel Bhandari , Akhila Yerukola , Akari Asai , Maarten Sap

Among the various types of cyberattacks, identifying zero-day attacks is problematic because they are unknown to security systems as their pattern and characteristics do not match known blacklisted attacks. There are many Machine Learning…

Cryptography and Security · Computer Science 2025-12-09 Zahra Lotfi , Mostafa Lotfi

Large Language Models (LLMs) have shown great potential in the biomedical domain with the advancement of retrieval-augmented generation (RAG). However, existing retrieval-augmented approaches face challenges in addressing diverse queries…

Computation and Language · Computer Science 2024-10-17 Minda Hu , Licheng Zong , Hongru Wang , Jingyan Zhou , Jingjing Li , Yichen Gao , Kam-Fai Wong , Yu Li , Irwin King

Information retrieval systems have traditionally optimized for topical relevance-the degree to which retrieved documents match a query. However, relevance only approximates a deeper goal: utility, namely, whether retrieved information helps…

Information Retrieval · Computer Science 2026-04-13 Hengran Zhang , Minghao Tang , Keping Bi , Jiafeng Guo

Large-scale digitization initiatives have unlocked massive collections of historical newspapers, yet effective computational access remains hindered by OCR corruption, multilingual orthographic variation, and temporal language drift. We…

Digital Libraries · Computer Science 2025-12-16 Anthony Mudet , Souhail Bakkali

The research paper presents a novel approach to optimizing the tensile stress of Triply Periodic Minimal Surface (TPMS) structures through machine learning and Simulated Annealing (SA). The study evaluates the performance of Random Forest,…

Materials Science · Physics 2024-06-11 Akshansh Mishra

Retrieval-augmented systems are typically evaluated in settings where information required to answer the query can be found within a single source or the answer is short-form or factoid-based. However, many real-world applications demand…

Computation and Language · Computer Science 2025-08-29 Rohan Phanse , Yijie Zhou , Kejian Shi , Wencai Zhang , Yixin Liu , Yilun Zhao , Arman Cohan