English
Related papers

Related papers: DICE: Discrete Interpretable Comparative Evaluatio…

200 papers

Retrieval-augmented reasoning (RAR) is a recent evolution of retrieval-augmented generation (RAG) that employs multiple reasoning steps for retrieval and generation. While effective for some complex queries, RAR remains vulnerable to errors…

Information Retrieval · Computer Science 2026-05-28 Heydar Soudani , Hamed Zamani , Faegheh Hasibi

Retrieval-Augmented Generation (RAG) significantly improves the factuality of Large Language Models (LLMs), yet standard pipelines often lack mechanisms to verify inter- mediate reasoning, leaving them vulnerable to hallucinations in…

Computation and Language · Computer Science 2026-03-12 Eeham Khan , Luis Rodriguez , Marc Queudot

Discrete diffusion models have achieved success in tasks like image generation and masked language modeling but face limitations in controlled content editing. We introduce DICE (Discrete Inversion for Controllable Editing), the first…

Retrieval-Augmented Generation (RAG) is widely used to ground large language models in external knowledge sources. However, when applied to heterogeneous corpora and multi-step queries, Naive RAG pipelines often degrade in quality due to…

Information Retrieval · Computer Science 2026-04-10 Valeriy Kovalskiy , Nikita Belov , Nikita Miteyko , Igor Reshetnikov , Max Maximov

Multi-trait automated essay scoring (AES) systems provide a fine-grained evaluation of an essay's diverse aspects. While they excel in scoring, prior systems fail to explain why specific trait scores are assigned. This lack of transparency…

Computation and Language · Computer Science 2025-03-03 Heejin Do , Sangwon Ryu , Gary Geunbae Lee

Preference-based alignment is pivotal for training large reasoning models; however, standard methods like Direct Preference Optimization (DPO) typically treat all preference pairs uniformly, overlooking the evolving utility of training…

Artificial Intelligence · Computer Science 2026-02-03 Hui Wu , Hengyi Cai , Jinman Zhao , Xinran Chen , Ziheng Li , Zhejun Zhao , Shuaiqiang Wang , Yuchen Li , Dawei Yin

Existing retrieval-augmented generation (RAG) systems typically use a centralized architecture, causing a high cost of data collection, integration, and management, as well as privacy concerns. There is a great need for a decentralized RAG…

Cryptography and Security · Computer Science 2025-11-12 Yining Lu , Wenyi Tang , Max Johnson , Taeho Jung , Meng Jiang

Retrieval-Augmented Generation (RAG) has emerged as the standard paradigm for answering questions on enterprise data. Traditionally, RAG has centered on text-based semantic search and re-ranking. However, this approach falls short when…

Information Retrieval · Computer Science 2025-09-29 Gurbinder Gill , Ritvik Gupta , Denis Lusson , Anand Chandrashekar , Donald Nguyen

Retrieval-Augmented Generation (RAG) has become a powerful and widely used approach for improving large language models by grounding generation in retrieved evidence. However, RAG systems still produce incorrect answers in many cases. Why…

Computation and Language · Computer Science 2026-05-15 Kai Guo , Xinnan Dai , Zhibo Zhang , Nuohan Lin , Shenglai Zeng , Jie Ren , Haoyu Han , Jiliang Tang

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by integrating their parametric knowledge with external retrieved content. However, knowledge conflicts caused by internal inconsistencies or noisy retrieved content…

Computation and Language · Computer Science 2025-07-03 Juan Chen , Baolong Bi , Wei Zhang , Jingyan Sui , Xiaofei Zhu , Yuanzhuo Wang , Lingrui Mei , Shenghua Liu

Despite their remarkable capabilities, large language models (LLMs) often produce responses containing factual inaccuracies due to their sole reliance on the parametric knowledge they encapsulate. Retrieval-Augmented Generation (RAG), an ad…

Computation and Language · Computer Science 2023-10-19 Akari Asai , Zeqiu Wu , Yizhong Wang , Avirup Sil , Hannaneh Hajishirzi

Retriever-augmented generation (RAG) has become a widely adopted approach for enhancing the factual accuracy of large language models (LLMs). While current benchmarks evaluate the performance of RAG methods from various perspectives, they…

Information Retrieval · Computer Science 2025-04-08 Kepu Zhang , Zhongxiang Sun , Weijie Yu , Xiaoxue Zang , Kai Zheng , Yang Song , Han Li , Jun Xu

Retrieval-Augmented Generation (RAG) enhances large language models by incorporating external knowledge, yet suffers from critical limitations in high-stakes domains -- namely, sensitivity to noisy or contradictory evidence and opaque,…

Artificial Intelligence · Computer Science 2025-08-29 Yuqicheng Zhu , Nico Potyka , Daniel Hernández , Yuan He , Zifeng Ding , Bo Xiong , Dongzhuoran Zhou , Evgeny Kharlamov , Steffen Staab

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by integrating external knowledge, leading to improved accuracy and relevance. However, scaling RAG pipelines remains computationally expensive as retrieval sizes…

Information Retrieval · Computer Science 2026-03-05 Maxime Louis , Thibault Formal , Hervé Dejean , Stéphane Clinchant

Retrieval-Augmented Generation (RAG) has emerged as a powerful solution to mitigate the limitations of Large Language Models (LLMs), such as hallucinations and outdated knowledge. However, deploying RAG-based tools in Small and Medium…

Computation and Language · Computer Science 2025-08-29 Mathieu Bourdin , Anas Neumann , Thomas Paviot , Robert Pellerin , Samir Lamouri

Retrieval-augmented generation (RAG) often falls short when retrieved context includes confusing semi-relevant passages, or when answering questions require deep contextual understanding and reasoning. We propose an efficient fine-tuning…

Computation and Language · Computer Science 2025-07-28 Mohammad Kachuee , Teja Gollapudi , Minseok Kim , Yin Huang , Kai Sun , Xiao Yang , Jiaqi Wang , Nirav Shah , Yue Liu , Aaron Colak , Anuj Kumar , Wen-tau Yih , Xin Luna Dong

This paper explores the intricate relationship between interpretability and robustness in deep learning models. Despite their remarkable performance across various tasks, deep learning models often exhibit critical vulnerabilities,…

Machine Learning · Computer Science 2024-12-30 Navid Nayyem , Abdullah Rakin , Longwei Wang

Large Language Models (LLMs) excel in many areas but continue to face challenges with complex reasoning tasks, such as Multi-Hop Question Answering (MHQA). MHQA requires integrating evidence from diverse sources while managing intricate…

Computation and Language · Computer Science 2025-05-29 Bolei He , Xinran He , Mengke Chen , Xianwei Xue , Ying Zhu , Zhenhua Ling

Automatic methods for evaluating machine-generated texts hold significant importance due to the expanding applications of generative systems. Conventional methods tend to grapple with a lack of explainability, issuing a solitary numerical…

Computation and Language · Computer Science 2024-03-19 Shenyu Zhang , Yu Li , Rui Wu , Xiutian Huang , Yongrui Chen , Wenhao Xu , Guilin Qi

Retrieval-augmented generation (RAG) has demonstrated strong performance in single-hop question answering (QA) by integrating external knowledge into large language models (LLMs). However, its effectiveness remains limited in multi-hop QA,…

Computation and Language · Computer Science 2026-01-13 Ningning Zhang , Chi Zhang , Zhizhong Tan , Xingxing Yang , Weiping Deng , Wenyong Wang