中文
相关论文

相关论文: Multi-modal Retrieval Augmented Multi-modal Genera…

200 篇论文

Retrieval-augmented generation (RAG) has recently become a very popular task for Large Language Models (LLMs). Evaluating them on multi-turn RAG conversations, where the system is asked to generate a response to a question in the context of…

Finance decision-making often relies on in-depth data analysis across various data sources, including financial tables, news articles, stock prices, etc. In this work, we introduce FinTMMBench, the first comprehensive benchmark for…

计算金融 · 定量金融 2025-08-05 Fengbin Zhu , Junfeng Li , Liangming Pan , Wenjie Wang , Fuli Feng , Chao Wang , Huanbo Luan , Tat-Seng Chua

Recent advancements in Large language models (LLMs) have demonstrated remarkable capabilities across diverse domains. While they exhibit strong zero-shot performance on various tasks, LLMs' effectiveness in music-related applications…

计算与语言 · 计算机科学 2025-12-09 Daeyong Kwon , SeungHeon Doh , Juhan Nam

Retrieval-Augmented Generation (RAG) is a powerful technique for enriching Large Language Models (LLMs) with external knowledge, allowing for factually grounded responses, a critical requirement in high-stakes domains such as healthcare.…

计算与语言 · 计算机科学 2025-10-07 Eduardo Martínez Rivera , Filippo Menolascina

Retrieval-Augmented Generation (RAG) is an advanced technique designed to address the challenges of Artificial Intelligence-Generated Content (AIGC). By integrating context retrieval into content generation, RAG provides reliable and…

Retrieval-Augmented Generation (RAG) has demonstrated significant effectiveness in enhancing large language models (LLMs) for complex multi-hop question answering (QA). For multi-hop QA tasks, current iterative approaches predominantly rely…

计算与语言 · 计算机科学 2026-01-19 Yuling Shi , Maolin Sun , Zijun Liu , Mo Yang , Yixiong Fang , Tianran Sun , Xiaodong Gu

We designed a Retrieval-Augmented Generation (RAG) system to provide large language models with relevant documents for answering domain-specific questions about Pittsburgh and Carnegie Mellon University (CMU). We extracted over 1,800…

机器学习 · 计算机科学 2024-11-22 Haojia Sun , Yaqi Wang , Shuting Zhang

Retrieval Augmented Generation (RAG) is a technique used to augment Large Language Models (LLMs) with contextually relevant, time-critical, or domain-specific information without altering the underlying model parameters. However,…

信息检索 · 计算机科学 2024-08-20 Laurent Mombaerts , Terry Ding , Adi Banerjee , Florian Felice , Jonathan Taws , Tarik Borogovac

Adaptive Retrieval-Augmented Generation (RAG) promises accuracy and efficiency by dynamically triggering retrieval only when needed and is widely used in practice. However, real-world queries vary in surface form even with the same intent,…

计算与语言 · 计算机科学 2026-04-14 Yunah Jang , Megha Sundriyal , Kyomin Jung , Meeyoung Cha

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by integrating up-to-date external knowledge, yet real-world web environments present unique challenges. These limitations manifest as two key challenges: pervasive…

Retrieval-Augmented Generation (RAG) pipelines must address challenges beyond simple single-document retrieval, such as interpreting visual elements (tables, charts, images), synthesizing information across documents, and providing accurate…

The paradigm of retrieval-augmented generated (RAG) helps mitigate hallucinations of large language models (LLMs). However, RAG also introduces biases contained within the retrieved documents. These biases can be amplified in scenarios…

In the field of Material Science, effective information retrieval systems are essential for facilitating research. Traditional Retrieval-Augmented Generation (RAG) approaches in Large Language Models (LLMs) often encounter challenges such…

信息检索 · 计算机科学 2024-12-03 Radeen Mostafa , Mirza Nihal Baig , Mashaekh Tausif Ehsan , Jakir Hasan

Retrieval-based multimodal document QA aims to identify and integrate relevant information from visually rich documents with complex multimodal structures. While retrieval-augmented generation (RAG) has shown strong performance in…

Medical vision-language models (VLMs) achieve strong performance in diagnostic reporting and image-text alignment, yet their underlying reasoning mechanisms remain fundamentally correlational, exhibiting reliance on superficial statistical…

机器学习 · 计算机科学 2026-01-27 Weiqin Yang , Haowen Xue , Qingyi Peng , Hexuan Hu , Qian Huang , Tingbo Zhang

Climate decision making is constrained by the complexity and inaccessibility of key information within lengthy, technical, and multi-lingual documents. Generative AI technologies offer a promising route for improving the accessibility of…

计算与语言 · 计算机科学 2024-11-01 Matyas Juhasz , Kalyan Dutia , Henry Franks , Conor Delahunty , Patrick Fawbert Mills , Harrison Pim

Retrieval-augmented generation (RAG) has emerged as a promising approach to enhance the performance of large language models (LLMs) in knowledge-intensive tasks such as those from medical domain. However, the sensitive nature of the medical…

计算与语言 · 计算机科学 2024-11-15 Nghia Trung Ngo , Chien Van Nguyen , Franck Dernoncourt , Thien Huu Nguyen

Retrieval-Augmented Generation (RAG) methods enhance LLM performance by efficiently filtering relevant context for LLMs, reducing hallucinations and inference cost. However, most existing RAG methods focus on single-step retrieval, which is…

This paper presents an advancement in Question-Answering (QA) systems using a Retrieval Augmented Generation (RAG) framework to enhance information extraction from PDF files. Recognizing the richness and diversity of data within…

计算与语言 · 计算机科学 2026-04-08 Thi Thu Uyen Hoang , Meenakshi Rajendran , Kun Zhang , Yuhan Wu , Viet Anh Nguyen

Large Language Models (LLMs) are becoming essential tools for various natural language processing tasks but often suffer from generating outdated or incorrect information. Retrieval-Augmented Generation (RAG) addresses this issue by…