中文
相关论文

相关论文: RobustVisRAG: Causality-Aware Vision-Based Retriev…

200 篇论文

Large language models (LLMs) demonstrate strong performance in natural language processing but often generate factual errors when relying solely on parametric knowledge. Retrieval-Augmented Generation (RAG) mitigates these errors by…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Zhifeng Wang , Jason Jingshi Li , Kaihao Zhang , Ramesh Sankaranarayana

Retrieval-Augmented Generation (RAG) has become a pivotal paradigm for Large Language Models (LLMs), yet current approaches struggle with visually rich documents by treating text and images as isolated retrieval targets. Existing methods…

计算与语言 · 计算机科学 2026-01-13 Xuan Li , Yining Wang , Haocai Luo , Shengping Liu , Jerry Liang , Ying Fu , Weihuang , Jun Yu , Junnan Zhu

Retrieval-augmented generation (RAG) systems combine large language models (LLMs) with external knowledge retrieval, making them highly effective for knowledge-intensive tasks. A crucial but often under-explored component of these systems…

计算与语言 · 计算机科学 2025-05-19 Jiashuo Sun , Xianrui Zhong , Sizhe Zhou , Jiawei Han

Financial documents--such as 10-Ks, 10-Qs, and investor presentations--span hundreds of pages and combine diverse modalities, including dense narrative text, structured tables, and complex figures. Answering questions over such content…

计算与语言 · 计算机科学 2026-04-13 Chinmay Gondhalekar , Urjitkumar Patel , Fang-Chun Yeh

With the rapid advancement of Multi-modal Large Language Models (MLLMs), their capability in understanding both images and text has greatly improved. However, their potential for leveraging multi-modal contextual information in…

人工智能 · 计算机科学 2025-08-08 Zhenghao Liu , Xingsheng Zhu , Tianshuo Zhou , Xinyi Zhang , Xiaoyuan Yi , Yukun Yan , Ge Yu , Maosong Sun

Retrieval-Augmented Generation (RAG) has demonstrated strong effectiveness in knowledge-intensive tasks by grounding language generation in external evidence. Despite its success, many existing RAG systems are built based on a…

计算与语言 · 计算机科学 2026-04-27 Lichang Song , Ting Long , Yi Chang

Artificial Intelligence (AI) has demonstrated significant potential in healthcare, particularly in disease diagnosis and treatment planning. Recent progress in Medical Large Vision-Language Models (Med-LVLMs) has opened up new possibilities…

机器学习 · 计算机科学 2025-03-04 Peng Xia , Kangyu Zhu , Haoran Li , Tianze Wang , Weijia Shi , Sheng Wang , Linjun Zhang , James Zou , Huaxiu Yao

Vision-language (VL) models have shown transformative potential across various critical domains due to their capability to comprehend multi-modal information. However, their performance frequently degrades under distribution shifts, making…

人机交互 · 计算机科学 2025-09-19 Huanchen Wang , Wencheng Zhang , Zhiqiang Wang , Zhicong Lu , Yuxin Ma

Retrieval-Augmented Generation (RAG) mitigates hallucinations in Multimodal Large Language Models (MLLMs), yet existing systems struggle with complex cross-modal reasoning. Flat vector retrieval often ignores structural dependencies, while…

信息检索 · 计算机科学 2026-04-08 Sijun Dai , Qiang Huang , Xiaoxing You , Jun Yu

Retrieval Augmented Generation (RAG) has emerged as a promising solution to address hallucination issues in Large Language Models (LLMs). However, the integration of multiple retrieval sources, while potentially more informative, introduces…

信息检索 · 计算机科学 2025-08-12 Wenlong Wu , Haofen Wang , Bohan Li , Peixuan Huang , Xinzhe Zhao , Lei Liang

Retrieval-Augmented Generation (RAG) improves reliability of large language models by incorporating external knowledge, but the retrieval process can introduce bias that propagates to generated outputs. This issue is particularly…

数据库 · 计算机科学 2026-05-18 Yingqi Zhao , Vasilis Efthymiou , Jyrki Nummenmaa , Kostas Stefanidis

Retrieval-Augmented Generation (RAG) has emerged as a powerful framework to improve factuality in large language models (LLMs) by grounding their outputs in retrieved documents. However, ensuring perfect retrieval of relevant information…

计算与语言 · 计算机科学 2025-12-04 Zhan Peng Lee , Andre Lin , Calvin Tan

Retrieval-augmented generation (RAG) has emerged as a promising paradigm for enhancing large language models (LLMs) on multi-hop question answering (QA), which requires reasoning over evidence from multiple documents. Current multi-hop RAG…

计算与语言 · 计算机科学 2026-05-28 Yikai Zhu , Kunfeng Chen , Qihuang Zhong , Juhua Liu , Bo Du

Retrieval-Augmented Generation (RAG) is a promising approach to mitigate hallucinations in Large Language Models (LLMs) for legal applications, but its reliability is critically dependent on the accuracy of the retrieval step. This is…

Retrieval-Augmented Generation (RAG) improves large language models by retrieving external knowledge, often truncated into smaller chunks due to the input context window, which leads to information loss, resulting in response hallucinations…

计算与语言 · 计算机科学 2025-11-18 Jie Zhang , Bo Tang , Wanzi Shao , Wenqiang Wei , Jihao Zhao , Jianqing Zhu , Zhiyu li , Wen Xi , Zehao Lin , Feiyu Xiong , Yanchao Tan

Recent work shows that text-only reinforcement learning with verifiable rewards (RLVR) can match or outperform image-text RLVR on multimodal medical VQA benchmarks, suggesting current evaluation protocols may fail to measure causal visual…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Anas Zafar , Leema Krishna Murali , Ashish Vashist

To effectively engage in human society, the ability to adapt, filter information, and make informed decisions in ever-changing situations is critical. As robots and intelligent agents become more integrated into human life, there is a…

Visual understanding is inherently intention-driven - humans selectively focus on different regions of a scene based on their goals. Recent advances in large multimodal models (LMMs) enable flexible expression of such intentions through…

计算机视觉与模式识别 · 计算机科学 2025-04-02 Zhangquan Chen , Xufang Luo , Dongsheng Li

Automatic generation of executable Blender code from natural language remains challenging, with state-of-the-art LLMs producing frequent syntactic errors and geometrically inconsistent objects. We present BlenderRAG, a retrieval-augmented…

计算机视觉与模式识别 · 计算机科学 2026-05-04 Massimo Rondelli , Francesco Pivi , Maurizio Gabbrielli

Retrieval-augmented generation (RAG) equips large language models (LLMs) with reliable knowledge memory. To strengthen cross-text associations, recent research integrates graphs and hypergraphs into RAG to capture pairwise and multi-entity…

信息检索 · 计算机科学 2026-02-10 Xingliang Hou , Yuyan Liu , Qi Sun , haoxiu wang , Hao Hu , Shaoyi Du , Zhiqiang Tian