English
Related papers

Related papers: Towards Debiasing Temporal Sentence Grounding in V…

200 papers

Given an untrimmed video, temporal sentence grounding (TSG) aims to locate a target moment semantically according to a sentence query. Although previous respectable works have made decent success, they only focus on high-level visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Xiang Fang , Daizong Liu , Pan Zhou , Guoshun Nan

This paper addresses the problem of text-to-video temporal grounding, which aims to identify the time interval in a video semantically relevant to a text query. We tackle this problem using a novel regression-based model that learns to…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Jonghwan Mun , Minsu Cho , Bohyung Han

In this paper, we study the problem of weakly-supervised temporal grounding of sentence in video. Specifically, given an untrimmed video and a query sentence, our goal is to localize a temporal segment in the video that semantically…

Computer Vision and Pattern Recognition · Computer Science 2020-01-28 Zhenfang Chen , Lin Ma , Wenhan Luo , Peng Tang , Kwan-Yee K. Wong

Temporal sentence grounding in videos aims to detect and localize one target video segment, which semantically corresponds to a given sentence. Existing methods mainly tackle this task via matching and aligning semantics between a sentence…

Computer Vision and Pattern Recognition · Computer Science 2019-11-01 Yitian Yuan , Lin Ma , Jingwen Wang , Wei Liu , Wenwu Zhu

Temporal Sentence Grounding in Videos (TSGV) aims to detect the event timestamps described by the natural language query from untrimmed videos. This paper discusses the challenge of achieving efficient computation in TSGV models while…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Renjie Liang , Yiming Yang , Hui Lu , Li Li

The task of language-guided video temporal grounding is to localize the particular video clip corresponding to a query sentence in an untrimmed video. Though progress has been made continuously in this field, some issues still need to be…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Binjie Zhang , Yu Li , Chun Yuan , Dejing Xu , Pin Jiang , Ying Shan

Temporal grounding in videos aims to localize one target video segment that semantically corresponds to a given query sentence. Thanks to the semantic diversity of natural language descriptions, temporal grounding allows activity grounding…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Juncheng Li , Junlin Xie , Long Qian , Linchao Zhu , Siliang Tang , Fei Wu , Yi Yang , Yueting Zhuang , Xin Eric Wang

Video grounding aims to localize the corresponding video moment in an untrimmed video given a language query. Existing methods often address this task in an indirect way, by casting it as a proposal-and-match or fusion-and-detection…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Fengyuan Shi , Weilin Huang , Limin Wang

A key solution to temporal sentence grounding (TSG) exists in how to learn effective alignment between vision and language features extracted from an untrimmed video and a sentence description. Existing methods mainly leverage vanilla soft…

Computer Vision and Pattern Recognition · Computer Science 2021-09-15 Daizong Liu , Xiaoye Qu , Pan Zhou

Video Temporal Grounding (VTG) aims to identify visual frames in a video clip that match text queries. Recent studies in VTG employ cross-attention to correlate visual frames and text queries as individual token sequences. However, these…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Jongbhin Woo , Hyeonggon Ryu , Youngjoon Jang , Jae Won Cho , Joon Son Chung

Video Temporal Grounding (VTG), which aims to ground target clips from videos (such as consecutive intervals or disjoint shots) according to custom language queries (e.g., sentences or words), is key for video browsing on social media. Most…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Kevin Qinghong Lin , Pengchuan Zhang , Joya Chen , Shraman Pramanick , Difei Gao , Alex Jinpeng Wang , Rui Yan , Mike Zheng Shou

Temporal Sentence Grounding (TSG), which aims to localize moments from videos based on the given natural language queries, has attracted widespread attention. Existing works are mainly designed for short videos, failing to handle TSG in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Houlun Chen , Xin Wang , Hong Chen , Zihan Song , Jia Jia , Wenwu Zhu

Video grounding aims to localize a moment from an untrimmed video for a given textual query. Existing approaches focus more on the alignment of visual and language stimuli with various likelihood-based matching or regression strategies,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Guoshun Nan , Rui Qiao , Yao Xiao , Jun Liu , Sicong Leng , Hao Zhang , Wei Lu

Grounding language queries in videos aims at identifying the time interval (or moment) semantically relevant to a language query. The solution to this challenging task demands understanding videos' and queries' semantic content and the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Mattia Soldan , Mengmeng Xu , Sisi Qu , Jesper Tegner , Bernard Ghanem

This paper addresses the problem of temporal sentence grounding (TSG), which aims to identify the temporal boundary of a specific segment from an untrimmed video by a sentence query. Previous works either compare pre-defined candidate…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Daizong Liu , Xiaoye Qu , Jianfeng Dong , Pan Zhou , Yu Cheng , Wei Wei , Zichuan Xu , Yulai Xie

In the realm of video dialog response generation, the understanding of video content and the temporal nuances of conversation history are paramount. While a segment of current research leans heavily on large-scale pretrained visual-language…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 You Qin , Wei Ji , Xinze Lan , Hao Fei , Xun Yang , Dan Guo , Roger Zimmermann , Lizi Liao

Video temporal grounding aims to identify video segments within untrimmed videos that are most relevant to a given natural language query. Existing video temporal localization models rely on specific datasets for training and have high data…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Minghang Zheng , Xinhao Cai , Qingchao Chen , Yuxin Peng , Yang Liu

Temporal Language Grounding seeks to localize video moments that semantically correspond to a natural language query. Recent advances employ the attention mechanism to learn the relations between video moments and the text query. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Thong Nguyen , Xiaobao Wu , Xinshuai Dong , Cong-Duy Nguyen , See-Kiong Ng , Luu Anh Tuan

Temporal sentence grounding (TSG) aims to locate a specific moment from an untrimmed video with a given natural language query. Recently, weakly supervised methods still have a large performance gap compared to fully supervised ones, while…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Hanjun Li , Xiujun Shu , Sunan He , Ruizhi Qiao , Wei Wen , Taian Guo , Bei Gan , Xing Sun

Temporal grounding aims to localize temporal boundaries within untrimmed videos by language queries, but it faces the challenge of two types of inevitable human uncertainties: query uncertainty and label uncertainty. The two uncertainties…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Hao Zhou , Chongyang Zhang , Yan Luo , Yanjun Chen , Chuanping Hu