中文
相关论文

相关论文: MuRAR: A Simple and Effective Multimodal Retrieval…

200 篇论文

Retrieval-augmented generation (RAG) has emerged to address the knowledge-intensive visual question answering (VQA) task. Current methods mainly employ separate retrieval and generation modules to acquire external knowledge and generate…

计算机视觉与模式识别 · 计算机科学 2025-02-25 Xinwei Long , Zhiyuan Ma , Ermo Hua , Kaiyan Zhang , Biqing Qi , Bowen Zhou

Retrieval-Augmented Generation (RAG) systems are widely used across various industries for querying closed-domain and in-house knowledge bases. However, evaluating these systems presents significant challenges due to the private nature of…

计算与语言 · 计算机科学 2024-10-24 Xinzhe Li , Ming Liu , Shang Gao

Retrieval-Augmented Generation (RAG) over Knowledge Graphs (KGs) suffers from the fact that indexing approaches may lose important contextual nuance when text is reduced to triples, thereby degrading performance in downstream…

计算与语言 · 计算机科学 2026-03-13 Riccardo Campi , Nicolò Oreste Pinciroli Vago , Mathyas Giudici , Marco Brambilla , Piero Fraternali

Multimodal large language models (MLLMs) often fail in fine-grained visual question answering, producing hallucinations about object identities, positions, and relations because textual queries are not explicitly anchored to visual…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Suyang Xi , Chenxi Yang , Hong Ding , Yiqing Ni , Catherine C. Liu , Yunhao Liu , Chengqi Zhang

Understanding temporal relations and answering time-sensitive questions is crucial yet a challenging task for question-answering systems powered by large language models (LLMs). Existing approaches either update the parametric knowledge of…

计算与语言 · 计算机科学 2025-05-22 Zhang Siyue , Xue Yuxiang , Zhang Yiming , Wu Xiaobao , Luu Anh Tuan , Zhao Chen

Universal Multimodal Retrieval (UMR) seeks any-to-any search across text and vision, yet modern embedding models remain brittle when queries require latent reasoning (e.g., resolving underspecified references or matching compositional…

信息检索 · 计算机科学 2026-02-10 Jianrui Zhang , Anirudh Sundara Rajan , Brandon Han , Soochahn Lee , Sukanta Ganguly , Yong Jae Lee

Multimodal emotion recognition utilizes complete multimodal information and robust multimodal joint representation to gain high performance. However, the ideal condition of full modality integrity is often not applicable in reality and…

计算机视觉与模式识别 · 计算机科学 2024-10-07 Qi Fan , Hongyu Yuan , Haolin Zuo , Rui Liu , Guanglai Gao

Multi-modal retrieval-augmented Question Answering (MRAQA), integrating text and images, has gained significant attention in information retrieval (IR) and natural language processing (NLP). Traditional ranking methods rely on small…

计算与语言 · 计算机科学 2025-01-24 Yang Bai , Christan Earl Grant , Daisy Zhe Wang

Retrieval-Augmented Generation (RAG) has emerged as a powerful paradigm for enhancing large language models (LLMs) by retrieving relevant documents from an external corpus. However, existing RAG systems primarily focus on unimodal text…

计算与语言 · 计算机科学 2025-10-21 Chenghao Zhang , Guanting Dong , Xinyu Yang , Zhicheng Dou

Retrieval-Augmented Generation has made significant progress in the field of natural language processing. By combining the advantages of information retrieval and large language models, RAG can generate relevant and contextually appropriate…

信息检索 · 计算机科学 2025-10-20 Da Li , Zecheng Fang , Qiang Yan , Wei Huang , Xuanpu Luo

Multi-modal Retrieval-Augmented Generation (RAG) has become a critical method for empowering LLMs by leveraging candidate visual documents. However, current methods consider the entire document as the basic retrieval unit, introducing…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Yinglu Li , Zhiying Lu , Zhihang Liu , Yiwei Sun , Chuanbin Liu , Hongtao Xie

Textbook question answering (TQA) is a challenging task in artificial intelligence due to the complex nature of context needed to answer complex questions. Although previous research has improved the task, there are still some limitations…

计算与语言 · 计算机科学 2025-01-23 Hessa Abdulrahman Alawwad , Areej Alhothali , Usman Naseem , Ali Alkhathlan , Amani Jamal

Medical question answering requires extensive access to specialized conceptual knowledge. The current paradigm, Retrieval-Augmented Generation (RAG), acquires expertise medical knowledge through large-scale corpus retrieval and uses this…

计算与语言 · 计算机科学 2025-02-20 Sichu Liang , Linhai Zhang , Hongyu Zhu , Wenwen Wang , Yulan He , Deyu Zhou

Large Language Models (LLMs) have significantly enhanced conversational Artificial Intelligence(AI) chatbots; however, domain-specific accuracy and the avoidance of factual inconsistencies remain pressing challenges, particularly for large…

信息检索 · 计算机科学 2025-09-24 Olalekan K. Akindele , Bhupesh Kumar Mishra , Kenneth Y. Wertheim

Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to access external knowledge sources, but the effectiveness of RAG relies on the coordination between the retriever and the generator. Since these components are…

计算与语言 · 计算机科学 2025-09-24 Junlin Wang , Zehao Wu , Shaowei Lu , Yanlan Li , Xinghao Huang

This article presents the QUASAR system for question answering over unstructured text, structured tables, and knowledge graphs, with unified treatment of all sources. The system adopts a RAG-based architecture, with a pipeline of evidence…

计算与语言 · 计算机科学 2024-12-11 Philipp Christmann , Gerhard Weikum

Retrieval-augmented generation (RAG) has proven to be effective in mitigating hallucinations in large language models, yet its effectiveness remains limited in complex, multi-step reasoning scenarios. Recent efforts have incorporated…

计算与语言 · 计算机科学 2025-12-29 Wenda Wei , Yu-An Liu , Ruqing Zhang , Jiafeng Guo , Lixin Su , Shuaiqiang Wang , Dawei Yin , Maarten de Rijke , Xueqi Cheng

Processing long contexts presents a significant challenge for large language models (LLMs). While recent advancements allow LLMs to handle much longer contexts than before (e.g., 32K or 128K tokens), it is computationally expensive and can…

计算与语言 · 计算机科学 2025-04-10 Hongjin Qian , Zheng Liu , Peitian Zhang , Kelong Mao , Defu Lian , Zhicheng Dou , Tiejun Huang

This paper presents Loops On Retrieval Augmented Generation (LoRAG), a new framework designed to enhance the quality of retrieval-augmented text generation through the incorporation of an iterative loop mechanism. The architecture…

计算与语言 · 计算机科学 2024-03-26 Ayush Thakur , Rashmi Vashisth

Vision-language retrieval-augmented generation (RAG) has become an effective approach for tackling Knowledge-Based Visual Question Answering (KB-VQA), which requires external knowledge beyond the visual content presented in images. The…

信息检索 · 计算机科学 2025-09-15 Wei Yang , Jingjing Fu , Rui Wang , Jinyu Wang , Lei Song , Jiang Bian