English
Related papers

Related papers: Video Moment Retrieval via Natural Language Querie…

200 papers

Video-text retrieval has many real-world applications such as media analytics, surveillance, and robotics. This paper presents the 1st place solution to the video retrieval track of the ICCV VALUE Challenge 2021. We present a simple yet…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Aiden Seungjoon Lee , Hanseok Oh , Minjoon Seo

Video Moment Retrieval (VMR) aims to retrieve relevant moments of an untrimmed video corresponding to the query. While cross-modal interaction approaches have shown progress in filtering out query-irrelevant information in videos, they…

Artificial Intelligence · Computer Science 2024-08-26 Chenghua Gao , Min Li , Jianshuo Liu , Junxing Ren , Lin Chen , Haoyu Liu , Bo Meng , Jitao Fu , Wenwen Su

Finding relevant moments and highlights in videos according to natural language queries is a natural and highly valuable common need in the current video content explosion era. Nevertheless, jointly conducting moment retrieval and highlight…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Ye Liu , Siyuan Li , Yang Wu , Chang Wen Chen , Ying Shan , Xiaohu Qie

Video moment retrieval and highlight detection have received attention in the current era of video content proliferation, aiming to localize moments and estimate clip relevances based on user-specific queries. Given that the video content…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Henghao Zhao , Kevin Qinghong Lin , Rui Yan , Zechao Li

Video Corpus Moment Retrieval (VCMR) is a practical video retrieval task focused on identifying a specific moment within a vast corpus of untrimmed videos using the natural language query. Existing methods for VCMR typically rely on…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Danyang Hou , Liang Pang , Huawei Shen , Xueqi Cheng

We introduce the task of retrieving relevant video moments from a large corpus of untrimmed, unsegmented videos given a natural language query. Our task poses unique challenges as a system must efficiently identify both the relevant videos…

Computer Vision and Pattern Recognition · Computer Science 2022-02-24 Victor Escorcia , Mattia Soldan , Josef Sivic , Bernard Ghanem , Bryan Russell

This paper tackles a recently proposed Video Corpus Moment Retrieval task. This task is essential because advanced video retrieval applications should enable users to retrieve a precise moment from a large video corpus. We propose a novel…

Multimedia · Computer Science 2021-09-22 Zhijian Hou , Chong-Wah Ngo , Wing Kwong Chan

Video moment retrieval (VMR) identifies a specific moment in an untrimmed video for a given natural language query. This task is prone to suffer the weak alignment problem innate in video datasets. Due to the ambiguity, a query does not…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Minjoon Jung , Youwon Jang , Seongho Choi , Joochan Kim , Jin-Hwa Kim , Byoung-Tak Zhang

Evaluation measures have a crucial impact on the direction of research. Therefore, it is of utmost importance to develop appropriate and reliable evaluation measures for new applications where conventional measures are not well suited.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Riku Togashi , Mayu Otani , Yuta Nakashima , Esa Rahtu , Janne Heikkila , Tetsuya Sakai

The correlation between the vision and text is essential for video moment retrieval (VMR), however, existing methods heavily rely on separate pre-training feature extractors for visual and textual understanding. Without sufficient temporal…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Dezhao Luo , Jiabo Huang , Shaogang Gong , Hailin Jin , Yang Liu

Video summarization has become an increasingly important task in the field of computer vision due to the vast amount of video content available on the internet. In this project, we propose a new method for natural language query based joint…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Richard Luo , Austin Peng , Heidi Yap , Koby Beard

Most existing video moment retrieval methods rely on temporal sequences of frame- or clip-level features that primarily encode global visual and semantic information. However, such representations often fail to capture fine-grained object…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Zongyao Li , Yongkang Wong , Satoshi Yamazaki , Jianquan Liu , Mohan Kankanhalli

Video moment retrieval uses a text query to locate a moment from a given untrimmed video reference. Locating corresponding video moments with text queries helps people interact with videos efficiently. Current solutions for this task have…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Chaochen Wu , Guan Luo , Meiyun Zuo , Zhitao Fan

Motivated by the increasing need of saving search effort by obtaining relevant video clips instead of whole videos, we propose a new task, named Semantic Video Moments Retrieval at scale (SVMR), which aims at finding relevant videos coupled…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Na Li

With the explosion of multimedia content, video moment retrieval (VMR), which aims to detect a video moment that matches a given text query from a video, has been studied intensively as a critical problem. However, the existing VMR…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Nakyeong Yang , Minsung Kim , Seunghyun Yoon , Joongbo Shin , Kyomin Jung

Previous video salient object detection (VSOD) approaches have mainly focused on designing fancy networks to achieve their performance improvements. However, with the slow-down in development of deep learning techniques recently, it may…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Chenglizhao Chen , Jia Song , Chong Peng , Guodong Wang , Yuming Fang

Video Moment Retrieval (VMR) aims to localize temporal segments in videos that correspond to a natural language query, but typically assumes only a single matching moment for each query. This assumption does not always hold in real-world…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Yiming Ding , Siyu Cao , Luyuan Jiao , Yixuan Li , Zitong Wang , Zhiyong Liu , Lu Zhang

As an increasingly popular task in multimedia information retrieval, video moment retrieval (VMR) aims to localize the target moment from an untrimmed video according to a given language query. Most previous methods depend heavily on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Xiang Fang , Daizong Liu , Pan Zhou , Yuchong Hu

The existing state-of-the-art (SOTA) video salient object detection (VSOD) models have widely followed short-term methodology, which dynamically determines the balance between spatial and temporal saliency fusion by solely considering the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Chenglizhao Chen , Hengsen Wang , Yuming Fang , Chong Peng

Video summarization is among challenging tasks in computer vision, which aims at identifying highlight frames or shots over a lengthy video input. In this paper, we propose an novel attention-based framework for video summarization with…

Computer Vision and Pattern Recognition · Computer Science 2020-06-04 Yen-Ting Liu , Yu-Jhe Li , Yu-Chiang Frank Wang