中文
相关论文

相关论文: Towards Mixed-Modal Retrieval for Universal Retrie…

200 篇论文

Retrieval-Augmented Generation (RAG) significantly enhances the performance of large language models (LLMs) in downstream tasks by integrating external knowledge. To facilitate researchers in deploying RAG systems, various RAG toolkits have…

Recent advancements in Retrieval-Augmented Generation (RAG) have revolutionized natural language processing by integrating Large Language Models (LLMs) with external information retrieval, enabling accurate, up-to-date, and verifiable text…

计算与语言 · 计算机科学 2025-04-22 Aoran Gan , Hao Yu , Kai Zhang , Qi Liu , Wenyu Yan , Zhenya Huang , Shiwei Tong , Guoping Hu

We aim to develop a retrieval-augmented generation (RAG) framework that answers questions over a corpus of visually-rich documents presented in mixed modalities (e.g., charts, tables) and diverse formats (e.g., PDF, PPTX). In this paper, we…

计算与语言 · 计算机科学 2025-04-15 Ryota Tanaka , Taichi Iki , Taku Hasegawa , Kyosuke Nishida , Kuniko Saito , Jun Suzuki

Large Language Models (LLMs) have achieved impressive performance across a wide range of applications. However, they often suffer from hallucinations in knowledge-intensive domains due to their reliance on static pretraining corpora. To…

信息检索 · 计算机科学 2026-02-10 Lihui Liu , Jiayuan Ding , Subhabrata Mukherjee , Carl J. Yang

Retrieval-Augmented Generation (RAG) improves Large Language Models (LLMs) by retrieving supporting documents into the prompt, but existing methods do not explicitly target queries that require fetching multiple documents with substantially…

Recent multimodal large language models (MLLMs) still struggle with long document understanding due to two fundamental challenges: information interference from abundant irrelevant content, and the quadratic computational cost of…

计算与语言 · 计算机科学 2025-11-14 Yongxin Shi , Jiapeng Wang , Zeyu Shan , Dezhi Peng , Zening Lin , Lianwen Jin

Retrieval-Augmented Generation (RAG) has emerged as a fundamental paradigm for expanding Large Language Models beyond their static training limitations. However, a critical misalignment exists between current RAG capabilities and real-world…

人工智能 · 计算机科学 2025-10-15 Zirui Guo , Xubin Ren , Lingrui Xu , Jiahao Zhang , Chao Huang

Retrieval-augmented generation (RAG) techniques have proven to be effective in integrating up-to-date information, mitigating hallucinations, and enhancing response quality, particularly in specialized domains. While many RAG approaches…

With the rapid advancement of Multi-modal Large Language Models (MLLMs), their capability in understanding both images and text has greatly improved. However, their potential for leveraging multi-modal contextual information in…

人工智能 · 计算机科学 2025-08-08 Zhenghao Liu , Xingsheng Zhu , Tianshuo Zhou , Xinyi Zhang , Xiaoyuan Yi , Yukun Yan , Ge Yu , Maosong Sun

Retrieval-Augmented Generation (RAG) has emerged as a widely adopted approach for enhancing LLMs in scenarios that demand extensive factual knowledge. However, current RAG evaluations concentrate primarily on correctness, which may not…

计算与语言 · 计算机科学 2026-03-23 Vinh Nguyen , Cuong Dang , Jiahao Zhang , Hoa Tran , Minh Tran , Trinh Chau , Thai Le , Lu Cheng , Suhang Wang

Large Language Models (LLMs) showcase impressive capabilities but encounter challenges like hallucination, outdated knowledge, and non-transparent, untraceable reasoning processes. Retrieval-Augmented Generation (RAG) has emerged as a…

计算与语言 · 计算机科学 2024-03-28 Yunfan Gao , Yun Xiong , Xinyu Gao , Kangxiang Jia , Jinliu Pan , Yuxi Bi , Yi Dai , Jiawei Sun , Meng Wang , Haofen Wang

Retrieval-Augmented Generation (RAG) integrates non-parametric knowledge into Large Language Models (LLMs), typically from unstructured texts and structured graphs. While recent progress has advanced text-based RAG to multi-turn reasoning…

计算与语言 · 计算机科学 2025-12-11 Yucan Guo , Miao Su , Saiping Guan , Zihao Sun , Xiaolong Jin , Jiafeng Guo , Xueqi Cheng

Large Language Models (LLMs) are becoming essential tools for various natural language processing tasks but often suffer from generating outdated or incorrect information. Retrieval-Augmented Generation (RAG) addresses this issue by…

Large Language Models (LLMs) suffer from hallucinations and outdated knowledge due to their reliance on static training data. Retrieval-Augmented Generation (RAG) mitigates these issues by integrating external dynamic information for…

Large Language Models (LLMs) have enabled a wide range of applications through their powerful capabilities in language understanding and generation. However, as LLMs are trained on static corpora, they face difficulties in addressing…

计算与语言 · 计算机科学 2025-10-13 Yongjie Wang , Yue Yu , Kaisong Song , Jun Lin , Zhiqi Shen

Retrieval Augmented Generation (RAG) is a technique used to augment Large Language Models (LLMs) with contextually relevant, time-critical, or domain-specific information without altering the underlying model parameters. However,…

信息检索 · 计算机科学 2024-08-20 Laurent Mombaerts , Terry Ding , Adi Banerjee , Florian Felice , Jonathan Taws , Tarik Borogovac

Multimodal Large Language Models (MLLMs) have shown impressive capabilities in jointly understanding text, images, and videos, often evaluated via Visual Question Answering (VQA). However, even state-of-the-art MLLMs struggle with…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Alberto Compagnoni , Marco Morini , Sara Sarto , Federico Cocchi , Davide Caffagni , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Retrieval-augmented generation (RAG) has emerged to address the knowledge-intensive visual question answering (VQA) task. Current methods mainly employ separate retrieval and generation modules to acquire external knowledge and generate…

计算机视觉与模式识别 · 计算机科学 2025-02-25 Xinwei Long , Zhiyuan Ma , Ermo Hua , Kaiyan Zhang , Biqing Qi , Bowen Zhou

Large language models (LLMs) inevitably exhibit hallucinations since the accuracy of generated texts cannot be secured solely by the parametric knowledge they encapsulate. Although retrieval-augmented generation (RAG) is a practicable…

计算与语言 · 计算机科学 2024-10-08 Shi-Qi Yan , Jia-Chen Gu , Yun Zhu , Zhen-Hua Ling

Large Language Models (LLMs) exhibit remarkable capabilities but are prone to generating inaccurate or hallucinatory responses. This limitation stems from their reliance on vast pretraining datasets, making them susceptible to errors in…

计算与语言 · 计算机科学 2024-04-02 Chi-Min Chan , Chunpu Xu , Ruibin Yuan , Hongyin Luo , Wei Xue , Yike Guo , Jie Fu