中文
相关论文

相关论文: A Multimodal RAG Framework for Housing Damage Asse…

200 篇论文

Multimodal retrieval-augmented Generation (MM-RAG) is a key approach for applying large language models (LLMs) and agents to real-world knowledge bases, yet current evaluations are fragmented -- focusing on either text or images in…

计算与语言 · 计算机科学 2026-01-06 Xiangyu Peng , Can Qin , Zeyuan Chen , Ran Xu , Caiming Xiong , Chien-Sheng Wu

The scaling of large language models to encode all the world's knowledge in model parameters is unsustainable and has exacerbated resource barriers. Retrieval-Augmented Generation (RAG) presents a potential solution, yet its application to…

计算机视觉与模式识别 · 计算机科学 2024-06-28 Varun Nagaraj Rao , Siddharth Choudhary , Aditya Deshpande , Ravi Kumar Satzoda , Srikar Appalaraju

Multi-modal Retrieval-Augmented Generation (RAG) has become a critical method for empowering LLMs by leveraging candidate visual documents. However, current methods consider the entire document as the basic retrieval unit, introducing…

计算机视觉与模式识别 · 计算机科学 2025-12-23 Yinglu Li , Zhiying Lu , Zhihang Liu , Yiwei Sun , Chuanbin Liu , Hongtao Xie

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by grounding responses in external knowledge during inference. However, conventiona RAG systems under-perform on structured tabular data, largely due to coarse…

计算与语言 · 计算机科学 2026-05-05 Zebin Guo , Weidong Geng , Ruichen Mao

Medical retrieval-augmented generation (RAG) systems typically operate on text chunks extracted from biomedical literature, discarding the rich visual content (tables, figures, structured layouts) of original document pages. We propose…

人工智能 · 计算机科学 2026-05-01 Xupeng Chen , Binbin Shi , Chenqian Le , Jiaqi Zhang , Kewen Wang , Ran Gong , Jinhan Zhang , Chihang Wang

Retrieval-Augmented Generation (RAG) has emerged as a fundamental paradigm for expanding Large Language Models beyond their static training limitations. However, a critical misalignment exists between current RAG capabilities and real-world…

人工智能 · 计算机科学 2025-10-15 Zirui Guo , Xubin Ren , Lingrui Xu , Jiahao Zhang , Chao Huang

Automated radiology report generation has gained increasing attention with the rise of deep learning and large language models. However, fully generative approaches often suffer from hallucinations and lack clinical grounding, limiting…

定量方法 · 定量生物学 2026-05-01 Himadri S Samanta

Understanding high-resolution (HR) images remains a critical challenge for multimodal large language models (MLLMs). Recent approaches leverage vision-based retrieval-augmented generation (RAG) to retrieve query-relevant crops from HR…

计算机视觉与模式识别 · 计算机科学 2026-03-20 Fan Yang , Xingping Dong , Xin Yu , Wenhan Luo , Wei Liu , Kaihao Zhang

Understanding information from a collection of multiple documents, particularly those with visually rich elements, is important for document-grounded question answering. This paper introduces VisDoMBench, the first comprehensive benchmark…

计算与语言 · 计算机科学 2025-02-12 Manan Suri , Puneet Mathur , Franck Dernoncourt , Kanika Goswami , Ryan A. Rossi , Dinesh Manocha

Large Language Models (LLMs) have demonstrated impressive capabilities in answering questions, but they lack domain-specific knowledge and are prone to hallucinations. Retrieval Augmented Generation (RAG) is one approach to address these…

计算与语言 · 计算机科学 2024-10-30 Monica Riedler , Stefan Langer

Retrieval-Augmented Generation (RAG) integrates non-parametric knowledge into Large Language Models (LLMs), typically from unstructured texts and structured graphs. While recent progress has advanced text-based RAG to multi-turn reasoning…

计算与语言 · 计算机科学 2025-12-11 Yucan Guo , Miao Su , Saiping Guan , Zihao Sun , Xiaolong Jin , Jiafeng Guo , Xueqi Cheng

Multi-modal Retrieval-Augmented Generation (MMRAG) has emerged as a powerful paradigm for enhancing Multimodal Large Language Models in knowledge-intensive question answering by integrating external visual, textual, and structural…

计算机视觉与模式识别 · 计算机科学 2026-05-29 Xiang Fang , Wanlong Fang , Changshuo Wang

Retrieval-augmented generation (RAG) techniques have proven to be effective in integrating up-to-date information, mitigating hallucinations, and enhancing response quality, particularly in specialized domains. While many RAG approaches…

Retrieval-Augmented Generation (RAG) has become a pivotal paradigm for Large Language Models (LLMs), yet current approaches struggle with visually rich documents by treating text and images as isolated retrieval targets. Existing methods…

计算与语言 · 计算机科学 2026-01-13 Xuan Li , Yining Wang , Haocai Luo , Shengping Liu , Jerry Liang , Ying Fu , Weihuang , Jun Yu , Junnan Zhu

Effective knowledge management is critical for preserving institutional expertise and improving the efficiency of workforce training in state transportation agencies. Traditional approaches, such as static documentation, classroom-based…

计算与语言 · 计算机科学 2026-03-05 Divija Amaram , Lu Gao , Gowtham Reddy Gudla , Tejaswini Sanjay Katale

Retrieval-Augmented Generation (RAG) systems using Multimodal Large Language Models (MLLMs) show great promise for complex document understanding, yet their development is critically hampered by inadequate evaluation. Current benchmarks…

计算与语言 · 计算机科学 2025-08-06 Wenxuan Shen , Mingjia Wang , Yaochen Wang , Dongping Chen , Junjie Yang , Yao Wan , Weiwei Lin

Retrieval-Augmented Generation (RAG) merges retrieval methods with deep learning advancements to address the static limitations of large language models (LLMs) by enabling the dynamic integration of up-to-date external information. This…

信息检索 · 计算机科学 2026-05-19 Yizheng Huang , Jimmy Huang

Retrieval-Augmented Generation (RAG) over Knowledge Graphs (KGs) suffers from the fact that indexing approaches may lose important contextual nuance when text is reduced to triples, thereby degrading performance in downstream…

计算与语言 · 计算机科学 2026-03-13 Riccardo Campi , Nicolò Oreste Pinciroli Vago , Mathyas Giudici , Marco Brambilla , Piero Fraternali

Retrieval-augmented generation (RAG) systems offer a promising approach to reduce hallucinations and improve answer accuracy in large language models (LLMs), a requirement for reliable, financial analysis where answers must be grounded in…

机器学习 · 计算机科学 2026-05-26 Magnus Samuelsen , Wilmer Nyström , Somnath Mazumdar , Mansoor Hussain , Mikkel Strange

Retrieval-Augmented Generation (RAG) systems for biomedical literature are typically evaluated using ranking metrics like Mean Reciprocal Rank (MRR), which measure how well the system identifies the single most relevant chunk. We argue that…

人工智能 · 计算机科学 2026-03-25 Pouria Mortezaagha , Arya Rahgozar