English
Related papers

Related papers: RAVENEA: A Benchmark for Multimodal Retrieval-Augm…

200 papers

Visual Question Answering (VQA) is an evolving research field aimed at enabling machines to answer questions about visual content by integrating image and language processing techniques such as feature extraction, object detection, text…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Ngoc Dung Huynh , Mohamed Reda Bouadjenek , Sunil Aryal , Imran Razzak , Hakim Hacid

Recent advances in large language models (LLMs) provide new opportunities for context understanding in virtual reality (VR). However, VR contexts are often highly localized and personalized, limiting the effectiveness of general-purpose…

Information Retrieval · Computer Science 2025-04-15 Shiyi Ding , Ying Chen

Retrieval-augmented generation (RAG) is a popular technique for using large language models (LLMs) to build customer-support, question-answering solutions. In this paper, we share our team's practical experience building and maintaining…

Information Retrieval · Computer Science 2024-10-18 Sarah Packowski , Inge Halilovic , Jenifer Schlotfeldt , Trish Smith

Large language models (LLMs) have become a disruptive force in the industry, introducing unprecedented capabilities in natural language processing, logical reasoning and so on. However, the challenges of knowledge updates and hallucination…

Machine Learning · Computer Science 2025-04-22 Chunjing Gan , Dan Yang , Binbin Hu , Ziqi Liu , Yue Shen , Zhiqiang Zhang , Jian Wang , Jun Zhou

Vision-language generative reward models (VL-GenRMs) play a crucial role in aligning and evaluating multimodal AI systems, yet their own evaluation remains under-explored. Current assessment methods primarily rely on AI-annotated preference…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Lei Li , Yuancheng Wei , Zhihui Xie , Xuqing Yang , Yifan Song , Peiyi Wang , Chenxin An , Tianyu Liu , Sujian Li , Bill Yuchen Lin , Lingpeng Kong , Qi Liu

Retrieval-Augmented Generation (RAG) systems have revolutionized information retrieval and question answering, but traditional text-based chunking methods struggle with complex document structures, multi-page tables, embedded figures, and…

Machine Learning · Computer Science 2025-07-15 Vishesh Tripathi , Tanmay Odapally , Indraneel Das , Uday Allu , Biddwan Ahmed

Despite significant progress, existing research on Multimodal Large Language Models (MLLMs) mainly focuses on general visual understanding, overlooking the ability to integrate textual context associated with objects for a more…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Hongliang Wei , Xianqi Zhang , Xingtao Wang , Xiaopeng Fan , Debin Zhao

Recent advancements in video models have shown tremendous progress, particularly in long video understanding. However, current benchmarks predominantly feature western-centric data and English as the dominant language, introducing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Darshan Singh , Arsha Nagrani , Kawshik Manikantan , Harman Singh , Dinesh Tewari , Tobias Weyand , Cordelia Schmid , Anelia Angelova , Shachi Dave

Multimodal large language models (MLLMs) have recently shown great progress in text-rich image understanding, yet they still struggle with complex, multi-page visually-rich documents. Traditional methods using document parsers for…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Jian Chen , Ruiyi Zhang , Yufan Zhou , Tong Yu , Franck Dernoncourt , Jiuxiang Gu , Ryan A. Rossi , Changyou Chen , Tong Sun

Vision Language Models (VLMs) have recently shown significant advancements in video understanding, especially in feature alignment, event reasoning, and instruction-following tasks. However, their capability for counterfactual reasoning,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Yuefei Chen , Jiang Liu , Xiaodong Lin , Ruixiang Tang

Retrieval-Augmented Generation (RAG) aims to mitigate hallucinations in large language models (LLMs) by grounding responses in retrieved documents. Yet, RAG-based LLMs still hallucinate even when provided with correct and sufficient…

Computation and Language · Computer Science 2026-02-04 Samuel Yeh , Sharon Li , Tanwi Mallick

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities in processing and generating content across multiple data modalities. However, a significant drawback of MLLMs is their reliance on static training data,…

Artificial Intelligence · Computer Science 2024-09-26 Zhanpeng Chen , Chengjin Xu , Yiyan Qi , Jian Guo

Large Language Models (LLMs) have shown proficiency in question-answering tasks but often struggle to integrate real-time knowledge, leading to potentially outdated or inaccurate responses. This problem becomes even more challenging when…

Computation and Language · Computer Science 2024-08-15 Yucheng Shi , Qiaoyu Tan , Xuansheng Wu , Shaochen Zhong , Kaixiong Zhou , Ninghao Liu

Text-to-image retrieval (T2I retrieval) remains challenging because cross-modal embeddings often behave as bags of concepts, underrepresenting structured visual relationships such as pose and viewpoint. We proposeVisualize-then-Retrieve…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Di Wu , Yixin Wan , Kai-Wei Chang

Knowledge-based visual question answering (KB-VQA) requires visual language models (VLMs) to integrate visual understanding with external knowledge retrieval. Although retrieval-augmented generation (RAG) achieves significant advances in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Yuyang Hong , Jiaqi Gu , Qi Yang , Lubin Fan , Yue Wu , Ying Wang , Kun Ding , Shiming Xiang , Jieping Ye

Current Vision Language Models (VLMs) demonstrate a critical gap between surface-level recognition and deep narrative reasoning when processing sequential visual storytelling. Through a comprehensive investigation of manga narrative…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Aaditya Baranwal , Madhav Kataria , Naitik Agrawal , Yogesh S Rawat , Shruti Vyas

Multimodal Retrieval-Augmented Generation (MRAG) enhances reasoning capabilities by integrating external knowledge. However, existing benchmarks primarily focus on simple image-text interactions, overlooking complex visual formats like…

Artificial Intelligence · Computer Science 2025-02-21 Yuming Yang , Jiang Zhong , Li Jin , Jingwang Huang , Jingpeng Gao , Qing Liu , Yang Bai , Jingyuan Zhang , Rui Jiang , Kaiwen Wei

Existing Reward Models (RMs), typically trained on general preference data, struggle in Retrieval Augmented Generation (RAG) settings, which require judging responses for faithfulness to retrieved context, relevance to the user query,…

Computation and Language · Computer Science 2025-10-01 Andrei C. Coman , Ionut-Teodor Sorodoc , Leonardo F. R. Ribeiro , Bill Byrne , James Henderson , Adrià de Gispert

Retrieval Augmented Generation (RAG) has gained widespread adoption owing to its capacity to empower large language models (LLMs) to integrate external knowledge. However, existing RAG frameworks are primarily designed for text-based LLMs…

Sound · Computer Science 2025-02-21 Yifu Chen , Shengpeng Ji , Haoxiao Wang , Ziqing Wang , Siyu Chen , Jinzheng He , Jin Xu , Zhou Zhao

Medical Visual Question Answering (MedVQA) enables natural language queries over medical images to support clinical decision-making and patient care. The MEDIQA-WV 2025 shared task addressed wound-care VQA, requiring systems to generate…

Computation and Language · Computer Science 2025-10-17 A H M Rezaul Karim , Ozlem Uzuner
‹ Prev 1 8 9 10 Next ›