English
Related papers

Related papers: A Multimodal RAG Framework for Housing Damage Asse…

200 papers

Automated content-aware layout generation -- the task of arranging visual elements such as text, logos, and underlays on a background canvas -- remains a fundamental yet under-explored problem in intelligent design systems. While recent…

Information Retrieval · Computer Science 2025-06-30 Najmeh Forouzandehmehr , Reza Yousefi Maragheh , Sriram Kollipara , Kai Zhao , Topojoy Biswas , Evren Korpeoglu , Kannan Achan

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by retrieving relevant memories from an external database. However, existing RAG methods typically organize all memories in a whole database, potentially limiting…

Computation and Language · Computer Science 2024-05-28 Zheng Wang , Shu Xian Teo , Jieer Ouyang , Yongjun Xu , Wei Shi

Organizations increasingly rely on proprietary enterprise data, including HR records, structured reports, and tabular documents, for critical decision-making. While Large Language Models (LLMs) have strong generative capabilities, they are…

Computation and Language · Computer Science 2025-07-17 Chandana Cheerla

Traditional Retrieval-Augmented Generation (RAG) methods are limited by their reliance on a fixed number of retrieved documents, often resulting in incomplete or noisy information that undermines task performance. Although recent adaptive…

Computation and Language · Computer Science 2024-10-16 Wenjia Zhai

This paper focuses on the dynamic optimization of the Retrieval-Augmented Generation (RAG) architecture. It proposes a state-aware dynamic knowledge retrieval mechanism to enhance semantic understanding and knowledge scheduling efficiency…

Computation and Language · Computer Science 2025-04-29 Jacky He , Guiran Liu , Binrong Zhu , Hanlu Zhang , Hongye Zheng , Xiaokai Wang

Artificial Intelligence (AI) has demonstrated significant potential in healthcare, particularly in disease diagnosis and treatment planning. Recent progress in Medical Large Vision-Language Models (Med-LVLMs) has opened up new possibilities…

Machine Learning · Computer Science 2025-03-04 Peng Xia , Kangyu Zhu , Haoran Li , Tianze Wang , Weijia Shi , Sheng Wang , Linjun Zhang , James Zou , Huaxiu Yao

To effectively engage in human society, the ability to adapt, filter information, and make informed decisions in ever-changing situations is critical. As robots and intelligent agents become more integrated into human life, there is a…

Artificial Intelligence · Computer Science 2025-11-13 Mingyang Mao , Mariela M. Perez-Cabarcas , Utteja Kallakuri , Nicholas R. Waytowich , Xiaomin Lin , Tinoosh Mohsenin

Retrieval-Augmented Generation (RAG) struggles on long, structured financial filings where relevant evidence is sparse and cross-referenced. This paper presents a systematic investigation of advanced metadata-driven Retrieval-Augmented…

Information Retrieval · Computer Science 2025-10-29 Michail Dadopoulos , Anestis Ladas , Stratos Moschidis , Ioannis Negkakis

Multimodal Retrieval-Augmented Generation (Visual RAG) significantly advances question answering by integrating visual and textual evidence. Yet, current evaluations fail to systematically account for query difficulty and ambiguity. We…

Computation and Language · Computer Science 2026-01-14 Yuelyu Ji , Wuwei Lan , Patrick NG

Current research on Multimodal Retrieval-Augmented Generation (MRAG) enables diverse multimodal inputs but remains limited to single-modality outputs, restricting expressive capacity and practical utility. In contrast, real-world…

Information Retrieval · Computer Science 2025-08-11 Zhiyou Xiao , Qinhan Yu , Binghui Li , Geng Chen , Chong Chen , Wentao Zhang

Retrieval-Augmented Generation (RAG) improves Large Language Models (LLMs) by retrieving supporting documents into the prompt, but existing methods do not explicitly target queries that require fetching multiple documents with substantially…

Retrieval-Augmented Generation (RAG) improves Large Language Models (LLMs) by using external knowledge, but it struggles with precise entity information retrieval. In this paper, we proposed MES-RAG framework, which enhances entity-specific…

Computation and Language · Computer Science 2025-03-19 Pingyu Wu , Daiheng Gao , Jing Tang , Huimin Chen , Wenbo Zhou , Weiming Zhang , Nenghai Yu

Retrieval-augmented generation (RAG) is a common way to ground language models in external documents and up-to-date information. Classical retrieval systems relied on lexical methods such as BM25, which rank documents by term overlap with…

Computation and Language · Computer Science 2026-03-05 Martin Asenov , Kenza Benkirane , Dan Goldwater , Aneiss Ghodsi

Condition monitoring (CM) plays a crucial role in ensuring reliability and efficiency in the process industry. Although computerised maintenance systems effectively detect and classify faults, tasks like fault severity estimation, and…

Machine Learning · Computer Science 2025-06-12 Karl Löwenmark , Daniel Strömbergsson , Chang Liu , Marcus Liwicki , Fredrik Sandin

Post-disaster reconnaissance reports contain critical evidence for understanding multi-hazard interactions, yet their unstructured narratives make systematic knowledge transfer difficult. Large language models (LLMs) offer new potential for…

Computation and Language · Computer Science 2025-11-20 Chenchen Kuai , Zihao Li , Braden Rosen , Stephanie Paal , Navid Jafari , Jean-Louis Briaud , Yunlong Zhang , Youssef M. A. Hashash , Yang Zhou

To effectively leverage user-specific data, retrieval augmented generation (RAG) is employed in multimodal large language model (MLLM) applications. However, conventional retrieval approaches often suffer from limited retrieval accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Maoliang Li , Ke Li , Yaoyang Liu , Jiayu Chen , Zihao Zheng , Yinjun Wu , Chenchen Liu , Xiang Chen

Retrieval-Augmented Generation (RAG) enhances language models by combining retrieval with generation. However, its current workflow remains largely text-centric, limiting its applicability in geoscience. Many geoscientific tasks are…

Emerging Technologies · Computer Science 2025-08-18 Runlong Yu , Shiyuan Luo , Rahul Ghosh , Lingyao Li , Yiqun Xie , Xiaowei Jia

Multi-modal Retrieval-Augmented Generation (MMRAG) enables highly credible generation by integrating external multi-modal knowledge, thus demonstrating impressive performance in complex multi-modal scenarios. However, existing MMRAG methods…

Artificial Intelligence · Computer Science 2025-12-22 Shengwei Zhao , Jingwen Yao , Sitong Wei , Linhai Xu , Yuying Liu , Dong Zhang , Zhiqiang Tian , Shaoyi Du

Retrieval-based multimodal document QA aims to identify and integrate relevant information from visually rich documents with complex multimodal structures. While retrieval-augmented generation (RAG) has shown strong performance in…

Information Retrieval · Computer Science 2026-04-21 Hui Wu , Haoquan Zhai , Yuchen Li , Hengyi Cai , Peirong Zhang , Yidan Zhang , Lei Wang , Chunle Wang , Yingyan Hou , Shuaiqiang Wang , Dawei Yin

We introduce MiRAGE, an evaluation framework for retrieval-augmented generation (RAG) from multimodal sources. As audiovisual media becomes a prevalent source of information online, it is essential for RAG systems to integrate information…

Computation and Language · Computer Science 2025-10-30 Alexander Martin , William Walden , Reno Kriz , Dengjia Zhang , Kate Sanders , Eugene Yang , Chihsheng Jin , Benjamin Van Durme