English
Related papers

Related papers: AeroRAG: Structured Multimodal Retrieval-Augmented…

200 papers

Existing aerial Vision-Language Navigation (VLN) methods predominantly adopt a detection-and-planning pipeline, which converts open-vocabulary detections into discrete textual scene graphs. These approaches are plagued by inadequate spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Haoyu Tong , Xiangyu Dong , Xiaoguang Ma , Haoran Zhao , Yaoming Zhou , Chenghao Lin

The evolution of digital manufacturing requires intelligent Question Answering (QA) systems that can seamlessly integrate and analyze complex multi-modal data, such as text, images, formulas, and tables. Conventional Retrieval Augmented…

Computational Engineering, Finance, and Science · Computer Science 2026-01-27 Yunqing Li , Zihan Dong , Farhad Ameri , Jianbang Zhang

Due to recent advancements in Large Audio-Language Models (LALMs) that demonstrate remarkable performance across a range of sound-, speech- and music-related tasks, there is a growing interest in proposing benchmarks to assess these models.…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-12 Jingru Lin , Chen Zhang , Tianrui Wang , Haizhou Li

Retrieval-Augmented Generation (RAG) improves large language models (LLMs) by retrieving relevant information from external sources and has been widely adopted for text-based tasks. For structured data, such as knowledge graphs, Graph…

Information Retrieval · Computer Science 2026-03-05 Haoyu Han , Li Ma , Yu Wang , Harry Shomer , Yongjia Lei , Zhisheng Qi , Kai Guo , Zhigang Hua , Bo Long , Hui Liu , Charu C. Aggarwal , Jiliang Tang

Vision-based Retrieval-Augmented Generation (VisRAG) leverages vision-language models (VLMs) to jointly retrieve relevant visual documents and generate grounded answers based on multimodal evidence. However, existing VisRAG models degrade…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 I-Hsiang Chen , Yu-Wei Liu , Tse-Yu Wu , Yu-Chien Chiang , Jen-Chien Yang , Wei-Ting Chen

Ensuring cultural values alignment in Large Language Models (LLMs) remains a critical challenge, as these models often embed Western-centric biases from their training data, leading to misrepresentations and fairness concerns in…

Computation and Language · Computer Science 2025-05-09 Wonduk Seo , Zonghao Yuan , Yi Bu

Large Reasoning Models (LRMs) exhibit remarkable reasoning abilities but rely primarily on parametric knowledge, limiting factual accuracy. While recent works equip reinforcement learning (RL)-based LRMs with retrieval capabilities, they…

Computation and Language · Computer Science 2025-05-20 Zhicheng Lee , Shulin Cao , Jinxin Liu , Jiajie Zhang , Weichuan Liu , Xiaoyin Che , Lei Hou , Juanzi Li

Multimodal Retrieval-Augmented Generation (MRAG) is widely adopted for Multimodal Large Language Models (MLLMs) with external evidence to reduce hallucinations. Despite its success, most existing MRAG frameworks treat retrieved evidence as…

Information Retrieval · Computer Science 2026-05-01 Xihang Wang , Zihan Wang , Chengkai Huang , Cao Liu , Ke Zeng , Quan Z. Sheng , Lina Yao

Recent advancements in multimodal large language models have driven breakthroughs in visual question answering. Yet, a critical gap persists, `conceptualization'-the ability to recognize and reason about the same concept despite variations…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Zahra Babaiee , Peyman M. Kiasari , Daniela Rus , Radu Grosu

Medical vision-language models (VLMs) achieve strong performance in diagnostic reporting and image-text alignment, yet their underlying reasoning mechanisms remain fundamentally correlational, exhibiting reliance on superficial statistical…

Machine Learning · Computer Science 2026-01-27 Weiqin Yang , Haowen Xue , Qingyi Peng , Hexuan Hu , Qian Huang , Tingbo Zhang

Large language models (LLMs) achieve optimal utility when their responses are grounded in external knowledge sources. However, real-world documents, such as annual reports, scientific papers, and clinical guidelines, frequently combine…

Information Retrieval · Computer Science 2025-12-17 Chi Zhang , Qiyang Chen , Mengqi Zhang

Automated road sign recognition is a critical task for intelligent transportation systems, but traditional deep learning methods struggle with the sheer number of sign classes and the impracticality of creating exhaustive labeled datasets.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Minghao Zhu , Zhihao Zhang , Anmol Sidhu , Keith Redmill

Multimodal Retrieval-Augmented Generation (Visual RAG) significantly advances question answering by integrating visual and textual evidence. Yet, current evaluations fail to systematically account for query difficulty and ambiguity. We…

Computation and Language · Computer Science 2026-01-14 Yuelyu Ji , Wuwei Lan , Patrick NG

Large Language Models (LLMs) suffer from hallucinations and outdated knowledge due to their reliance on static training data. Retrieval-Augmented Generation (RAG) mitigates these issues by integrating external dynamic information for…

Retrieval Augmented Generation (RAG) has gained widespread adoption owing to its capacity to empower large language models (LLMs) to integrate external knowledge. However, existing RAG frameworks are primarily designed for text-based LLMs…

Sound · Computer Science 2025-02-21 Yifu Chen , Shengpeng Ji , Haoxiao Wang , Ziqing Wang , Siyu Chen , Jinzheng He , Jin Xu , Zhou Zhao

We present a Collaborative Agent-Based Framework for Multi-Image Reasoning. Our approach tackles the challenge of interleaved multimodal reasoning across diverse datasets and task formats by employing a dual-agent system: a language-based…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Angelos Vlachos , Giorgos Filandrianos , Maria Lymperaiou , Nikolaos Spanos , Ilias Mitsouras , Vasileios Karampinis , Athanasios Voulodimos

Recently, Retrieval-Augmented Generation (RAG) has achieved remarkable success in addressing the challenges of Large Language Models (LLMs) without necessitating retraining. By referencing an external knowledge base, RAG refines LLM…

Artificial Intelligence · Computer Science 2024-09-11 Boci Peng , Yun Zhu , Yongchao Liu , Xiaohe Bo , Haizhou Shi , Chuntao Hong , Yan Zhang , Siliang Tang

Recent advancements in retrieval-augmented generation (RAG) have demonstrated impressive performance in the question-answering (QA) task. However, most previous works predominantly focus on text-based answers. While some studies address…

Information Retrieval · Computer Science 2025-02-10 Zhengyuan Zhu , Daniel Lee , Hong Zhang , Sai Sree Harsha , Loic Feujio , Akash Maharaj , Yunyao Li

The performance of language models is commonly limited by insufficient knowledge and constrained reasoning. Prior approaches such as Retrieval-Augmented Generation (RAG) and Chain-of-Thought (CoT) address these issues by incorporating…

Information Retrieval · Computer Science 2026-03-31 Xinyi Duan , Yuanrong Tang , Jiangtao Gong

Retrieval-Augmented Generation (RAG) has become a robust framework for enhancing Large Language Models (LLMs) with external knowledge. Recent advances in RAG have investigated graph based retrieval for intricate reasoning; however, the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Tejas Sarnaik , Manan Shah , Ravi Hegde