English
Related papers

Related papers: Faster Video Moment Retrieval with Point-Level Sup…

200 papers

Video Moment Retrieval (VMR) aims to retrieve temporal segments in untrimmed videos corresponding to a given language query by constructing cross-modal alignment strategies. However, these existing strategies are often sub-optimal since…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Zhihang Liu , Jun Li , Hongtao Xie , Pandeng Li , Jiannan Ge , Sun-Ao Liu , Guoqing Jin

With the explosion of multimedia content, video moment retrieval (VMR), which aims to detect a video moment that matches a given text query from a video, has been studied intensively as a critical problem. However, the existing VMR…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Nakyeong Yang , Minsung Kim , Seunghyun Yoon , Joongbo Shin , Kyomin Jung

Current methods for Video Moment Retrieval (VMR) struggle to align complex situations involving specific environmental details, character descriptions, and action narratives. To tackle this issue, we propose a Large Language Model-guided…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Weijia Liu , Bo Miao , Jiuxin Cao , Xuelin Zhu , Bo Liu , Mehwish Nasim , Ajmal Mian

Existing Video Corpus Moment Retrieval (VCMR) is limited to coarse-grained understanding, which hinders precise video moment localization when given fine-grained queries. In this paper, we propose a more challenging fine-grained VCMR…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Houlun Chen , Xin Wang , Hong Chen , Zeyang Zhang , Wei Feng , Bin Huang , Jia Jia , Wenwu Zhu

Motivated by the increasing need of saving search effort by obtaining relevant video clips instead of whole videos, we propose a new task, named Semantic Video Moments Retrieval at scale (SVMR), which aims at finding relevant videos coupled…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Na Li

Video moment retrieval aims at finding the start and end timestamps of a moment (part of a video) described by a given natural language query. Fully supervised methods need complete temporal boundary annotations to achieve promising…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Ran Cui , Tianwen Qian , Pai Peng , Elena Daskalaki , Jingjing Chen , Xiaowei Guo , Huyang Sun , Yu-Gang Jiang

Video Moment Retrieval is a task in video understanding that aims to localize a specific temporal segment in an untrimmed video based on a natural language query. Despite recent progress in moment retrieval from videos using both…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 An Yu , Weiheng Lu , Jian Li , Zhenfei Zhang , Yunhang Shen , Felix X. -F. Ye , Ming-Ching Chang

Online video web content is richly multimodal: a single video blends vision, speech, ambient audio, and on-screen text. Retrieval systems typically treat these modalities as independent retrieval sources, which can lead to noisy and subpar…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 David Wan , Han Wang , Elias Stengel-Eskin , Jaemin Cho , Mohit Bansal

Moment retrieval aims to locate the most relevant moment in an untrimmed video based on a given natural language query. Existing solutions can be roughly categorized into moment-based and clip-based methods. The former often involves heavy…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Jiajun He , Tomoki Toda

Given a collection of untrimmed and unsegmented videos, video corpus moment retrieval (VCMR) is to retrieve a temporal moment (i.e., a fraction of a video) that semantically corresponds to a given text query. As video and text are from two…

Computation and Language · Computer Science 2021-05-14 Hao Zhang , Aixin Sun , Wei Jing , Guoshun Nan , Liangli Zhen , Joey Tianyi Zhou , Rick Siow Mong Goh

Video moment retrieval (VMR) identifies a specific moment in an untrimmed video for a given natural language query. This task is prone to suffer the weak alignment problem innate in video datasets. Due to the ambiguity, a query does not…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Minjoon Jung , Youwon Jang , Seongho Choi , Joochan Kim , Jin-Hwa Kim , Byoung-Tak Zhang

The current state-of-the-art methods for video corpus moment retrieval (VCMR) often use similarity-based feature alignment approach for the sake of convenience and speed. However, late fusion methods like cosine similarity alignment are…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Zijian Gao , Huanyu Liu , Jingyu Liu

Video moment retrieval (VMR) aims to locate the most likely video moment(s) corresponding to a text query in untrimmed videos. Training of existing methods is limited by the lack of diverse and generalisable VMR datasets, hindering their…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Dezhao Luo , Shaogang Gong , Jiabo Huang , Hailin Jin , Yang Liu

Recent advances in Multimodal Large Language Models (MLLMs) have improved image recognition and reasoning, but video-related tasks remain challenging due to memory constraints from dense frame processing. Existing Video Moment Retrieval…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Mingyu Jeon , Sungjin Han , Jinkwon Hwang , Minchol Kwon , Jonghee Kim , Junyeong Kim

Given a natural language query, video moment retrieval aims to localize the described temporal moment in an untrimmed video. A major challenge of this task is its heavy dependence on labor-intensive annotations for training. Unlike existing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Peijun Bao , Chenqi Kong , Zihao Shao , Boon Poh Ng , Meng Hwa Er , Alex C. Kot

Video Moment Retrieval (VMR) aims to localize a specific temporal segment within an untrimmed long video given a natural language query. Existing methods often suffer from inadequate training annotations, i.e., the sentence typically…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Weitong Cai , Jiabo Huang , Shaogang Gong , Hailin Jin , Yang Liu

The target of video moment retrieval (VMR) is predicting temporal spans within a video that semantically match a given linguistic query. Existing VMR methods based on multimodal large language models (MLLMs) overly rely on expensive…

Multimedia · Computer Science 2025-01-15 Yifang Xu , Yunzhuo Sun , Benxiang Zhai , Ming Li , Wenxin Liang , Yang Li , Sidan Du

Video moment retrieval is to identify the target moment according to the given sentence in an untrimmed video. Due to temporal boundary annotations of the video are extremely time-consuming to acquire, modeling in the weakly-supervised…

Multimedia · Computer Science 2023-11-27 Haoyuan Li , Zhou Zhao , Zhu Zhang , Zhijie Lin

Video Moment Retrieval (VMR) targets to retrieve the specific moment corresponding to a sentence query from an untrimmed video. Although recent works have made remarkable progress in this task, they implicitly are rooted in the closed-set…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Xiang Fang , Wanlong Fang , Daizong Liu , Xiaoye Qu , Jianfeng Dong , Pan Zhou , Renfu Li , Zichuan Xu , Lixing Chen , Panpan Zheng , Yu Cheng

Video corpus moment retrieval (VCMR) is the task to retrieve the most relevant video moment from a large video corpus using a natural language query. For narrative videos, e.g., dramas or movies, the holistic understanding of temporal…

Computation and Language · Computer Science 2022-10-25 Minjoon Jung , Seongho Choi , Joochan Kim , Jin-Hwa Kim , Byoung-Tak Zhang