English
Related papers

Related papers: ATLANTIC: Structure-Aware Retrieval-Augmented Lang…

200 papers

The paradigm of retrieval-augmented generated (RAG) helps mitigate hallucinations of large language models (LLMs). However, RAG also introduces biases contained within the retrieved documents. These biases can be amplified in scenarios…

Computation and Language · Computer Science 2025-06-24 Bryan Li , Fiona Luo , Samar Haider , Adwait Agashe , Tammy Li , Runqi Liu , Muqing Miao , Shriya Ramakrishnan , Yuan Yuan , Chris Callison-Burch

Retrieval-augmented language models (LMs) have received much attention recently. However, typically the retriever is not trained jointly as a native component of the LM, but added post-hoc to an already-pretrained LM, which limits the…

Computation and Language · Computer Science 2024-07-23 Ohad Rubin , Jonathan Berant

Current general-purpose large language models (LLMs) commonly exhibit knowledge hallucination and insufficient domain-specific adaptability in domain-specific tasks, limiting their effectiveness in specialized question answering scenarios.…

Information Retrieval · Computer Science 2025-09-16 Mengzheng Yang , Yanfei Ren , David Osei Opoku , Ruochang Li , Peng Ren , Chunxiao Xing

Retrieval augmentation is critical when Language Models (LMs) exploit non-parametric knowledge related to the query through external knowledge bases before reasoning. The retrieved information is incorporated into LMs as context alongside…

Information Retrieval · Computer Science 2024-11-21 Mingzhu Wang , Yuzhe Zhang , Qihang Zhao , Junyi Yang , Hong Zhang

Recent studies have proposed leveraging Large Language Models (LLMs) as information retrievers through query rewriting. However, for challenging corpora, we argue that enhancing queries alone is insufficient for robust semantic matching;…

Information Retrieval · Computer Science 2025-06-24 Jingming Liu , Yumeng Li , Wei Shi , Yao-Xiang Ding , Hui Su , Kun Zhou

Incorporating external knowledge bases in traditional retrieval-augmented generation (RAG) relies on parsing the document, followed by querying a language model with the parsed information via in-context learning. While effective for…

Computation and Language · Computer Science 2026-02-03 Jacob Si , Mike Qu , Michelle Lee , Marek Rei , Yingzhen Li

The goal of case-based retrieval is to assist physicians in the clinical decision making process, by finding relevant medical literature in large archives. We propose a research that aims at improving the effectiveness of case-based…

Information Retrieval · Computer Science 2018-11-28 Stefano Marchesin

Large pre-trained language models have been shown to store factual knowledge in their parameters, and achieve state-of-the-art results when fine-tuned on downstream NLP tasks. However, their ability to access and precisely manipulate…

Retrieval-augmented generation (RAG) has emerged as a pivotal method for expanding the knowledge of large language models. To handle complex queries more effectively, researchers developed Adaptive-RAG (A-RAG) to enhance the generated…

Artificial Intelligence · Computer Science 2025-05-27 Jie Ou , Jinyu Guo , Shuaihong Jiang , Zhaokun Wang , Libo Qin , Shunyu Yao , Wenhong Tian

Recent advances in Large Language Models (LLMs) have significantly improved complex reasoning capabilities. Retrieval-Augmented Generation (RAG) has further extended these capabilities by grounding generation in dynamically retrieved…

Computation and Language · Computer Science 2026-02-23 Jash Rajesh Parekh , Pengcheng Jiang , Jiawei Han

We study leveraging adaptive retrieval to ensure sufficient "bridge" documents are retrieved for reasoning-intensive retrieval. Bridge documents are those that contribute to the reasoning process yet are not directly relevant to the initial…

Information Retrieval · Computer Science 2026-04-15 Jongho Kim , Jaeyoung Kim , Seung-won Hwang , Jihyuk Kim , Yu Jin Kim , Moontae Lee

Retrieval-Augmented Language Modeling (RALM) methods, which condition a language model (LM) on relevant documents from a grounding corpus during generation, were shown to significantly improve language modeling performance. In addition,…

Computation and Language · Computer Science 2023-08-02 Ori Ram , Yoav Levine , Itay Dalmedigos , Dor Muhlgay , Amnon Shashua , Kevin Leyton-Brown , Yoav Shoham

Retrieval augmented language models have recently become the standard for knowledge intensive tasks. Rather than relying purely on latent semantics within the parameters of large neural models, these methods enlist a semi-parametric memory…

Computation and Language · Computer Science 2023-01-24 Wenhu Chen , Pat Verga , Michiel de Jong , John Wieting , William Cohen

Organizations increasingly rely on proprietary enterprise data, including HR records, structured reports, and tabular documents, for critical decision-making. While Large Language Models (LLMs) have strong generative capabilities, they are…

Computation and Language · Computer Science 2025-07-17 Chandana Cheerla

Retrieval-augmented generation (RAG) is a powerful technique that enhances downstream task execution by retrieving additional information, such as knowledge, skills, and tools from external sources. Graph, by its intrinsic "nodes connected…

Text-conditioned generative models for volumetric medical imaging provide semantic control but lack explicit anatomical guidance, often resulting in outputs that are spatially ambiguous or anatomically inconsistent. In contrast,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Daniele Molino , Camillo Maria Caruso , Paolo Soda , Valerio Guarrasi

This paper proposes a structure-aware decoding method based on large language models to address the difficulty of traditional approaches in maintaining both semantic integrity and structural consistency in nested and overlapping entity…

Computation and Language · Computer Science 2026-01-29 Zhimin Qiu , Di Wu , Feng Liu , Yuxiao Wang

Large language models are powerful text processors and reasoners, but are still subject to limitations including outdated knowledge and hallucinations, which necessitates connecting them to the world. Retrieval-augmented large language…

Computation and Language · Computer Science 2023-10-24 Zhihong Shao , Yeyun Gong , Yelong Shen , Minlie Huang , Nan Duan , Weizhu Chen

In enterprise settings, efficiently retrieving relevant information from large and complex knowledge bases is essential for operational productivity and informed decision-making. This research presents a systematic empirical framework for…

Retrieval-augmented generation (RAG) techniques have emerged as a promising solution to enhance the reliability of large language models (LLMs) by addressing issues like hallucinations, outdated knowledge, and domain adaptation. In…

Computation and Language · Computer Science 2025-01-28 Weihang Su , Yichen Tang , Qingyao Ai , Junxi Yan , Changyue Wang , Hongning Wang , Ziyi Ye , Yujia Zhou , Yiqun Liu