English
Related papers

Related papers: MUVR: A Multi-Modal Untrimmed Video Retrieval Benc…

200 papers

Multimodal Large Language Models (MLLMs) have demonstrated significant success in visual understanding tasks. However, challenges persist in adapting these models for video comprehension due to the large volume of data and temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Shaojie Zhang , Jiahui Yang , Jianqin Yin , Zhenbo Luo , Jian Luan

Cross-lingual cross-modal retrieval (CCR) aims to retrieve visually relevant content based on non-English queries, without relying on human-labeled cross-modal data pairs during training. One popular approach involves utilizing machine…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Yabing Wang , Le Wang , Qiang Zhou , Zhibin Wang , Hao Li , Gang Hua , Wei Tang

Large multimodal models (LMMs) have recently gained attention due to their effectiveness to understand and generate descriptions of visual content. Most existing LMMs are in English language. While few recent works explore multilingual…

The prevailing video retrieval paradigm is structurally misaligned, as narrow benchmarks incentivize correspondingly limited data and single-task training. Therefore, universal capability is suppressed due to the absence of a diagnostic…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Zhuoning Guo , Mingxin Li , Yanzhao Zhang , Dingkun Long , Pengjun Xie , Xiaowen Chu

Multimodal Large Language Models (MLLMs) have advanced VQA and now support Vision-DeepResearch systems that use search engines for complex visual-textual fact-finding. However, evaluating these visual and textual search abilities is still…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yu Zeng , Wenxuan Huang , Zhen Fang , Shuang Chen , Yufan Shen , Yishuo Cai , Xiaoman Wang , Zhenfei Yin , Lin Chen , Zehui Chen , Shiting Huang , Yiming Zhao , Xu Tang , Yao Hu , Philip Torr , Wanli Ouyang , Shaosheng Cao

Retrieval-Augmented Generation (RAG) has demonstrated remarkable success in enhancing Large Language Models (LLMs) through external knowledge integration, yet its application has primarily focused on textual content, leaving the rich domain…

Information Retrieval · Computer Science 2025-02-04 Xubin Ren , Lingrui Xu , Long Xia , Shuaiqiang Wang , Dawei Yin , Chao Huang

This study focuses on weakly-supervised Video Moment Retrieval (VMR), aiming to identify a moment semantically similar to the given query within an untrimmed video using only video-level correspondences, without relying on temporal…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Bolin Zhang , Chao Yang , Bin Jiang , Takahiro Komamizu , Ichiro Ide

Recent advances in Retrieval-Augmented Generation (RAG) have significantly improved response accuracy and relevance by incorporating external knowledge into Large Language Models (LLMs). However, existing RAG methods primarily focus on…

Machine Learning · Computer Science 2025-04-22 Qinhan Yu , Zhiyou Xiao , Binghui Li , Zhengren Wang , Chong Chen , Wentao Zhang

Comprehending long videos remains a significant challenge for Large Multi-modal Models (LMMs). Current LMMs struggle to process even minutes to hours videos due to their lack of explicit memory and retrieval mechanisms. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Sameer Malik , Moyuru Yamada , Ayush Singh , Dishank Aggarwal

Retrieval-augmented generation (RAG) systems have predominantly focused on text-based retrieval, limiting their effectiveness in handling visually-rich documents that encompass text, images, tables, and charts. To bridge this gap, we…

Information Retrieval · Computer Science 2025-05-07 Mingjun Xu , Zehui Wang , Hengxing Cai , Renxin Zhong

Building a video retrieval system that is robust and reliable, especially for the marine environment, is a challenging task due to several factors such as dealing with massive amounts of dense and repetitive data, occlusion, blurriness, low…

Computer Vision and Pattern Recognition · Computer Science 2023-06-08 Tan-Sang Ha , Hai Nguyen-Truong , Tuan-Anh Vu , Sai-Kit Yeung

Composed video retrieval (CoVR) is a challenging problem in computer vision which has recently highlighted the integration of modification text with visual queries for more sophisticated video search in large databases. Existing works…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Omkar Thawakar , Muzammal Naseer , Rao Muhammad Anwer , Salman Khan , Michael Felsberg , Mubarak Shah , Fahad Shahbaz Khan

With enhanced capabilities and widespread applications, Multimodal Large Language Models (MLLMs) are increasingly required to process and reason over multiple images simultaneously. However, existing MLLM benchmarks focus either on…

Text-Video Retrieval (TVR) aims to align and associate relevant video content with corresponding natural language queries. Most existing TVR methods are based on large-scale pre-trained vision-language models (e.g., CLIP). However, due to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Haoran Tang , Meng Cao , Jinfa Huang , Ruyang Liu , Peng Jin , Ge Li , Xiaodan Liang

Traditional dialogue retrieval aims to select the most appropriate utterance or image from recent dialogue history. However, they often fail to meet users' actual needs for revisiting semantically coherent content scattered across long-form…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Hanbo Bi , Zhiqiang Yuan , Zexi Jia , Jiapei Zhang , Chongyang Li , Peixiang Luo , Ying Deng , Xiaoyue Duan , Jinchao Zhang

In this report, we introduce the Qwen3-VL-Embedding and Qwen3-VL-Reranker model series, the latest extensions of the Qwen family built on the Qwen3-VL foundation model. Together, they provide an end-to-end pipeline for high-precision…

Computation and Language · Computer Science 2026-01-21 Mingxin Li , Yanzhao Zhang , Dingkun Long , Keqin Chen , Sibo Song , Shuai Bai , Zhibo Yang , Pengjun Xie , An Yang , Dayiheng Liu , Jingren Zhou , Junyang Lin

Video moment search, the process of finding relevant moments in a video corpus to match a user's query, is crucial for various applications. Existing solutions, however, often assume a single perfect matching moment, struggle with…

Information Retrieval · Computer Science 2025-01-10 Chongzhi Zhang , Xizhou Zhu , Aixin Sun

Video understanding in multimodal large language models requires selecting informative frames from long, redundant videos under limited visual-token budgets. Existing methods often rely on uniform sampling, point-wise relevance scoring,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Jingfeng Chen , Jiawen Qian , Wendi Deng , Yinuo Guo , Jiaqi Yu , Sicong Leng , Raghuveer Thirukovalluru , Bhuwan Dhingra

Multimodal embedding models have been crucial in enabling various downstream tasks such as semantic similarity, information retrieval, and clustering over different modalities. However, existing multimodal embeddings like VLM2Vec, E5-V, GME…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Rui Meng , Ziyan Jiang , Ye Liu , Mingyi Su , Xinyi Yang , Yuepeng Fu , Can Qin , Zeyuan Chen , Ran Xu , Caiming Xiong , Yingbo Zhou , Wenhu Chen , Semih Yavuz

Multimodal Large Language Models (MLLMs) have shown remarkable capabilities in video content understanding but still struggle with fine-grained motion comprehension. To comprehensively assess the motion understanding ability of existing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Chongjun Tu , Lin Zhang , Pengtao Chen , Peng Ye , Xianfang Zeng , Wei Cheng , Gang Yu , Tao Chen