中文
相关论文

相关论文: QualiRAG: Retrieval-Augmented Generation for Visua…

200 篇论文

Image-to-video generation has made remarkable progress with the advancements in diffusion models, yet generating videos with realistic motion remains highly challenging. This difficulty arises from the complexity of accurately modeling…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Chenhui Zhu , Yilu Wu , Shuai Wang , Gangshan Wu , Limin Wang

Traditional Retrieval-Augmented Generation (RAG) methods are limited by their reliance on a fixed number of retrieved documents, often resulting in incomplete or noisy information that undermines task performance. Although recent adaptive…

计算与语言 · 计算机科学 2024-10-16 Wenjia Zhai

Existing multimodal retrieval benchmarks primarily focus on evaluating whether models can retrieve and utilize external textual knowledge for question answering. However, there are scenarios where retrieving visual information is either…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Wenbo Hu , Jia-Chen Gu , Zi-Yi Dou , Mohsen Fayyaz , Pan Lu , Kai-Wei Chang , Nanyun Peng

Retrieval Augmented Generation (RAG) has emerged as a promising solution to address hallucination issues in Large Language Models (LLMs). However, the integration of multiple retrieval sources, while potentially more informative, introduces…

信息检索 · 计算机科学 2025-08-12 Wenlong Wu , Haofen Wang , Bohan Li , Peixuan Huang , Xinzhe Zhao , Lei Liang

Retrieval-augmented generation (RAG) often falls short when retrieved context includes confusing semi-relevant passages, or when answering questions require deep contextual understanding and reasoning. We propose an efficient fine-tuning…

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by integrating external knowledge sources to address their limitations in accessing up-to-date or specialized information. A natural strategy to increase the…

计算与语言 · 计算机科学 2025-11-10 Song Wang , Zihan Chen , Peng Wang , Zhepei Wei , Zhen Tan , Yu Meng , Cong Shen , Jundong Li

We propose XRAG, a novel benchmark designed to evaluate the generation abilities of LLMs in cross-lingual Retrieval-Augmented Generation (RAG) settings where the user language does not match the retrieval results. XRAG is constructed from…

计算与语言 · 计算机科学 2025-05-16 Wei Liu , Sony Trenous , Leonardo F. R. Ribeiro , Bill Byrne , Felix Hieber

Retrieval-augmented generation (RAG) systems have predominantly focused on text-based retrieval, limiting their effectiveness in handling visually-rich documents that encompass text, images, tables, and charts. To bridge this gap, we…

信息检索 · 计算机科学 2025-05-07 Mingjun Xu , Zehui Wang , Hengxing Cai , Renxin Zhong

Iterative retrieval-augmented generation (iRAG) models offer an effective approach for multi-hop question answering (QA). However, their retrieval process faces two key challenges: (1) it can be disrupted by irrelevant documents or…

计算与语言 · 计算机科学 2025-02-26 Jinyuan Fang , Zaiqiao Meng , Craig Macdonald

Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to access external knowledge sources, but the effectiveness of RAG relies on the coordination between the retriever and the generator. Since these components are…

计算与语言 · 计算机科学 2025-09-24 Junlin Wang , Zehao Wu , Shaowei Lu , Yanlan Li , Xinghao Huang

Retrieval-augmented generation (RAG) has emerged as a pivotal method for expanding the knowledge of large language models. To handle complex queries more effectively, researchers developed Adaptive-RAG (A-RAG) to enhance the generated…

人工智能 · 计算机科学 2025-05-27 Jie Ou , Jinyu Guo , Shuaihong Jiang , Zhaokun Wang , Libo Qin , Shunyu Yao , Wenhong Tian

Recent advances in large language models (LLMs) have led to impressive progress in natural language generation, yet their tendency to produce hallucinated or unsubstantiated content remains a critical concern. To improve factual…

计算与语言 · 计算机科学 2025-05-20 Xukai Liu , Ye Liu , Shiwen Wu , Yanghai Zhang , Yihao Yuan , Kai Zhang , Qi Liu

Free-energy-guided self-repair mechanisms have shown promising results in image quality assessment (IQA), but remain under-explored in video quality assessment (VQA), where temporal dynamics and model constraints pose unique challenges.…

计算机视觉与模式识别 · 计算机科学 2025-06-16 Zhaoyang Wang , Wen Lu , Jie Li , Lihuo He , Maoguo Gong , Xinbo Gao

Text-VQA aims at answering questions that require understanding the textual cues in an image. Despite the great progress of existing Text-VQA methods, their performance suffers from insufficient human-labeled question-answer (QA) pairs.…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Jun Wang , Mingfei Gao , Yuqian Hu , Ramprasaath R. Selvaraju , Chetan Ramaiah , Ran Xu , Joseph F. JaJa , Larry S. Davis

With the rapid advancement of Multi-modal Large Language Models (MLLMs), their capability in understanding both images and text has greatly improved. However, their potential for leveraging multi-modal contextual information in…

人工智能 · 计算机科学 2025-08-08 Zhenghao Liu , Xingsheng Zhu , Tianshuo Zhou , Xinyi Zhang , Xiaoyuan Yi , Yukun Yan , Ge Yu , Maosong Sun

Graph Retrieval-Augmented Generation (Graph RAG) effectively builds a knowledge graph (KG) to connect disparate facts across a large document corpus. However, this broad-view approach often lacks the deep structured reasoning needed for…

计算与语言 · 计算机科学 2025-10-27 Jiaoyang Li , Junhao Ruan , Shengwei Tang , Saihan Chen , Kaiyan Chang , Yuan Ge , Tong Xiao , Jingbo Zhu

Retrieval-Augmented Generation (RAG) merges retrieval methods with deep learning advancements to address the static limitations of large language models (LLMs) by enabling the dynamic integration of up-to-date external information. This…

信息检索 · 计算机科学 2026-05-19 Yizheng Huang , Jimmy Huang

Textbook question answering (TQA) is a challenging task in artificial intelligence due to the complex nature of context needed to answer complex questions. Although previous research has improved the task, there are still some limitations…

计算与语言 · 计算机科学 2025-01-23 Hessa Abdulrahman Alawwad , Areej Alhothali , Usman Naseem , Ali Alkhathlan , Amani Jamal

Visual Quality Assessment (QA) seeks to predict human perceptual judgments of visual fidelity. While recent multimodal large language models (MLLMs) show promise in reasoning about image and video quality, existing approaches mainly rely on…

计算机视觉与模式识别 · 计算机科学 2025-11-10 Zehui Feng , Tian Qiu , Tong Wu , Junxuan Li , Huayuan Xu , Ting Han

Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to access broader knowledge sources, yet factual inconsistencies persist due to noise in retrieved documents-even with advanced retrieval methods. We demonstrate that…

计算与语言 · 计算机科学 2025-06-04 Yongjian Li , HaoCheng Chu , Yukun Yan , Zhenghao Liu , Shi Yu , Zheni Zeng , Ruobing Wang , Sen Song , Zhiyuan Liu , Maosong Sun