中文
相关论文

相关论文: Video sentence grounding with temporally global te…

200 篇论文

Temporal sentence grounding in videos(TSGV), which aims to localize one target segment from an untrimmed video with respect to a given sentence query, has drawn increasing attentions in the research community over the past few years.…

计算机视觉与模式识别 · 计算机科学 2021-09-20 Xiaohan Lan , Yitian Yuan , Xin Wang , Zhi Wang , Wenwu Zhu

Video Temporal Grounding (VTG) aims to identify visual frames in a video clip that match text queries. Recent studies in VTG employ cross-attention to correlate visual frames and text queries as individual token sequences. However, these…

计算机视觉与模式识别 · 计算机科学 2024-10-18 Jongbhin Woo , Hyeonggon Ryu , Youngjoon Jang , Jae Won Cho , Joon Son Chung

The task of video grounding, which temporally localizes a natural language description in a video, plays an important role in understanding videos. Existing studies have adopted strategies of sliding window over the entire video or…

计算机视觉与模式识别 · 计算机科学 2019-01-23 Dongliang He , Xiang Zhao , Jizhou Huang , Fu Li , Xiao Liu , Shilei Wen

The task of temporally grounding language queries in videos is to temporally localize the best matched video segment corresponding to a given language (sentence). It requires certain models to simultaneously perform visual and linguistic…

计算机视觉与模式识别 · 计算机科学 2019-12-19 Jingwen Wang , Lin Ma , Wenhao Jiang

This paper presents a new task, the grounding of spatio-temporal identifying descriptions in videos. Previous work suggests potential bias in existing datasets and emphasizes the need for a new data creation schema to better model…

计算机视觉与模式识别 · 计算机科学 2019-04-09 Peratham Wiriyathammabhum , Abhinav Shrivastava , Vlad I. Morariu , Larry S. Davis

Temporal Video Grounding (TVG) aims to localize the temporal boundary of a specific segment in an untrimmed video based on a given language query. Since datasets in this domain are often gathered from limited video scenes, models tend to…

计算机视觉与模式识别 · 计算机科学 2023-12-22 Haifeng Huang , Yang Zhao , Zehan Wang , Yan Xia , Zhou Zhao

This paper addresses the challenging task of weakly-supervised video temporal grounding. Existing approaches are generally based on the moment proposal selection framework that utilizes contrastive learning and reconstruction paradigm for…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Xiang Fang , Zeyu Xiong , Wanlong Fang , Xiaoye Qu , Chen Chen , Jianfeng Dong , Keke Tang , Pan Zhou , Yu Cheng , Daizong Liu

Video-Language Pre-training models have recently significantly improved various multi-modal downstream tasks. Previous dominant works mainly adopt contrastive learning to achieve global feature alignment across modalities. However, the…

计算机视觉与模式识别 · 计算机科学 2023-01-19 Fan Ma , Xiaojie Jin , Heng Wang , Jingjia Huang , Linchao Zhu , Jiashi Feng , Yi Yang

The task of temporally grounding textual queries in videos is to localize one video segment that semantically corresponds to the given query. Most of the existing approaches rely on segment-sentence pairs (temporal annotations) for…

计算机视觉与模式识别 · 计算机科学 2020-03-17 Yijun Song , Jingwen Wang , Lin Ma , Zhou Yu , Jun Yu

The onset of long-form egocentric datasets such as Ego4D and EPIC-Kitchens presents a new challenge for the task of Temporal Sentence Grounding (TSG). Compared to traditional benchmarks on which this task is evaluated, these datasets offer…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Kevin Flanagan , Dima Damen , Michael Wray

This paper addresses the problem of temporal sentence grounding (TSG), which aims to identify the temporal boundary of a specific segment from an untrimmed video by a sentence query. Previous works either compare pre-defined candidate…

计算机视觉与模式识别 · 计算机科学 2021-03-23 Daizong Liu , Xiaoye Qu , Jianfeng Dong , Pan Zhou , Yu Cheng , Wei Wei , Zichuan Xu , Yulai Xie

Temporal language grounding in videos aims to localize the temporal span relevant to the given query sentence. Previous methods treat it either as a boundary regression task or a span extraction task. This paper will formulate temporal…

计算机视觉与模式识别 · 计算机科学 2021-12-02 Jialin Gao , Xin Sun , Mengmeng Xu , Xi Zhou , Bernard Ghanem

Temporal sentence grounding in videos (TSGV), \aka natural language video localization (NLVL) or video moment retrieval (VMR), aims to retrieve a temporal moment that semantically corresponds to a language query from an untrimmed video.…

计算机视觉与模式识别 · 计算机科学 2023-04-26 Hao Zhang , Aixin Sun , Wei Jing , Joey Tianyi Zhou

Given an untrimmed video, temporal sentence grounding (TSG) aims to locate a target moment semantically according to a sentence query. Although previous respectable works have made decent success, they only focus on high-level visual…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Xiang Fang , Daizong Liu , Pan Zhou , Guoshun Nan

Temporal grounding is the task of locating a specific segment from an untrimmed video according to a query sentence. This task has achieved significant momentum in the computer vision community as it enables activity grounding beyond…

计算机视觉与模式识别 · 计算机科学 2023-05-16 Juncheng Li , Siliang Tang , Linchao Zhu , Wenqiao Zhang , Yi Yang , Tat-Seng Chua , Fei Wu , Yueting Zhuang

This paper studies the multimedia problem of temporal sentence grounding (TSG), which aims to accurately determine the specific video segment in an untrimmed video according to a given sentence query. Traditional TSG methods mainly follow…

多媒体 · 计算机科学 2026-05-26 Xiang Fang , Daizong Liu , Pan Zhou , Zichuan Xu , Ruixuan Li

Temporal sentence grounding aims to identify exact moments in a video that correspond to a given textual query, typically addressed with detection transformer (DETR) solutions. However, we find that typical strategies designed to enhance…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Jiajin Tang , Zhengxuan Wei , Yuchen Zhu , Cheng Shi , Guanbin Li , Liang Lin , Sibei Yang

Prior works on text-based video moment localization focus on temporally grounding the textual query in an untrimmed video. These works assume that the relevant video is already known and attempt to localize the moment on that relevant video…

计算机视觉与模式识别 · 计算机科学 2021-11-10 Sudipta Paul , Niluthpol Chowdhury Mithun , Amit K. Roy-Chowdhury

This paper addresses temporal sentence grounding. Previous works typically solve this task by learning frame-level video features and align them with the textual information. A major limitation of these works is that they fail to…

计算机视觉与模式识别 · 计算机科学 2022-01-04 Daizong Liu , Xiaoye Qu , Pan Zhou , Yang Liu

Temporal language grounding (TLG) aims to localize a video segment in an untrimmed video based on a natural language description. To alleviate the expensive cost of manual annotations for temporal boundary labels, we are dedicated to the…

计算机视觉与模式识别 · 计算机科学 2022-10-24 Yuechen Wang , Wengang Zhou , Houqiang Li