English
Related papers

Related papers: Video sentence grounding with temporally global te…

200 papers

Temporal sentence grounding in videos(TSGV), which aims to localize one target segment from an untrimmed video with respect to a given sentence query, has drawn increasing attentions in the research community over the past few years.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-20 Xiaohan Lan , Yitian Yuan , Xin Wang , Zhi Wang , Wenwu Zhu

Video Temporal Grounding (VTG) aims to identify visual frames in a video clip that match text queries. Recent studies in VTG employ cross-attention to correlate visual frames and text queries as individual token sequences. However, these…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Jongbhin Woo , Hyeonggon Ryu , Youngjoon Jang , Jae Won Cho , Joon Son Chung

The task of video grounding, which temporally localizes a natural language description in a video, plays an important role in understanding videos. Existing studies have adopted strategies of sliding window over the entire video or…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Dongliang He , Xiang Zhao , Jizhou Huang , Fu Li , Xiao Liu , Shilei Wen

The task of temporally grounding language queries in videos is to temporally localize the best matched video segment corresponding to a given language (sentence). It requires certain models to simultaneously perform visual and linguistic…

Computer Vision and Pattern Recognition · Computer Science 2019-12-19 Jingwen Wang , Lin Ma , Wenhao Jiang

This paper presents a new task, the grounding of spatio-temporal identifying descriptions in videos. Previous work suggests potential bias in existing datasets and emphasizes the need for a new data creation schema to better model…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Peratham Wiriyathammabhum , Abhinav Shrivastava , Vlad I. Morariu , Larry S. Davis

Temporal Video Grounding (TVG) aims to localize the temporal boundary of a specific segment in an untrimmed video based on a given language query. Since datasets in this domain are often gathered from limited video scenes, models tend to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Haifeng Huang , Yang Zhao , Zehan Wang , Yan Xia , Zhou Zhao

This paper addresses the challenging task of weakly-supervised video temporal grounding. Existing approaches are generally based on the moment proposal selection framework that utilizes contrastive learning and reconstruction paradigm for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Xiang Fang , Zeyu Xiong , Wanlong Fang , Xiaoye Qu , Chen Chen , Jianfeng Dong , Keke Tang , Pan Zhou , Yu Cheng , Daizong Liu

Video-Language Pre-training models have recently significantly improved various multi-modal downstream tasks. Previous dominant works mainly adopt contrastive learning to achieve global feature alignment across modalities. However, the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-19 Fan Ma , Xiaojie Jin , Heng Wang , Jingjia Huang , Linchao Zhu , Jiashi Feng , Yi Yang

The task of temporally grounding textual queries in videos is to localize one video segment that semantically corresponds to the given query. Most of the existing approaches rely on segment-sentence pairs (temporal annotations) for…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Yijun Song , Jingwen Wang , Lin Ma , Zhou Yu , Jun Yu

The onset of long-form egocentric datasets such as Ego4D and EPIC-Kitchens presents a new challenge for the task of Temporal Sentence Grounding (TSG). Compared to traditional benchmarks on which this task is evaluated, these datasets offer…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Kevin Flanagan , Dima Damen , Michael Wray

This paper addresses the problem of temporal sentence grounding (TSG), which aims to identify the temporal boundary of a specific segment from an untrimmed video by a sentence query. Previous works either compare pre-defined candidate…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Daizong Liu , Xiaoye Qu , Jianfeng Dong , Pan Zhou , Yu Cheng , Wei Wei , Zichuan Xu , Yulai Xie

Temporal language grounding in videos aims to localize the temporal span relevant to the given query sentence. Previous methods treat it either as a boundary regression task or a span extraction task. This paper will formulate temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Jialin Gao , Xin Sun , Mengmeng Xu , Xi Zhou , Bernard Ghanem

Temporal sentence grounding in videos (TSGV), \aka natural language video localization (NLVL) or video moment retrieval (VMR), aims to retrieve a temporal moment that semantically corresponds to a language query from an untrimmed video.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Hao Zhang , Aixin Sun , Wei Jing , Joey Tianyi Zhou

Given an untrimmed video, temporal sentence grounding (TSG) aims to locate a target moment semantically according to a sentence query. Although previous respectable works have made decent success, they only focus on high-level visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Xiang Fang , Daizong Liu , Pan Zhou , Guoshun Nan

Temporal grounding is the task of locating a specific segment from an untrimmed video according to a query sentence. This task has achieved significant momentum in the computer vision community as it enables activity grounding beyond…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Juncheng Li , Siliang Tang , Linchao Zhu , Wenqiao Zhang , Yi Yang , Tat-Seng Chua , Fei Wu , Yueting Zhuang

This paper studies the multimedia problem of temporal sentence grounding (TSG), which aims to accurately determine the specific video segment in an untrimmed video according to a given sentence query. Traditional TSG methods mainly follow…

Multimedia · Computer Science 2026-05-26 Xiang Fang , Daizong Liu , Pan Zhou , Zichuan Xu , Ruixuan Li

Temporal sentence grounding aims to identify exact moments in a video that correspond to a given textual query, typically addressed with detection transformer (DETR) solutions. However, we find that typical strategies designed to enhance…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Jiajin Tang , Zhengxuan Wei , Yuchen Zhu , Cheng Shi , Guanbin Li , Liang Lin , Sibei Yang

Prior works on text-based video moment localization focus on temporally grounding the textual query in an untrimmed video. These works assume that the relevant video is already known and attempt to localize the moment on that relevant video…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Sudipta Paul , Niluthpol Chowdhury Mithun , Amit K. Roy-Chowdhury

This paper addresses temporal sentence grounding. Previous works typically solve this task by learning frame-level video features and align them with the textual information. A major limitation of these works is that they fail to…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Daizong Liu , Xiaoye Qu , Pan Zhou , Yang Liu

Temporal language grounding (TLG) aims to localize a video segment in an untrimmed video based on a natural language description. To alleviate the expensive cost of manual annotations for temporal boundary labels, we are dedicated to the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Yuechen Wang , Wengang Zhou , Houqiang Li