English
Related papers

Related papers: Progressive Localization Networks for Language-bas…

200 papers

We address the challenging task of cross-modal moment retrieval, which aims to localize a temporal segment from an untrimmed video described by a natural language query. It poses great challenges over the proper semantic alignment between…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Kun Liu , Huadong Ma , Chuang Gan

Localizing moments in a longer video via natural language queries is a new, challenging task at the intersection of language and video understanding. Though moment localization with natural language is similar to other language and vision…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Lisa Anne Hendricks , Oliver Wang , Eli Shechtman , Josef Sivic , Trevor Darrell , Bryan Russell

Given an untrimmed video and a natural language query, Natural Language Video Localization (NLVL) aims to identify the video moment described by the query. To address this task, existing methods can be roughly grouped into two groups: 1)…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Shaoning Xiao , Long Chen , Jian Shao , Yueting Zhuang , Jun Xiao

Natural language video localization (NLVL), which aims to locate a target moment from a video that semantically corresponds to a text query, is a novel and challenging task. Toward this end, in this paper, we present a comprehensive survey…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Xinfang Liu , Xiushan Nie , Zhifang Tan , Jie Guo , Yilong Yin

The task of moment localization is to localize a temporal moment in an untrimmed video for a given natural language query. Since untrimmed video contains highly redundant contents, the quality of the query is crucial for accurately…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Wenfeng Yan , Shaoxiang Chen , Zuxuan Wu , Yu-Gang Jiang

Video moment localization, also known as video moment retrieval, aiming to search a target segment within a video described by a given natural language query. Beyond the task of temporal action localization whereby the target actions are…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Meng Liu , Liqiang Nie , Yunxiao Wang , Meng Wang , Yong Rui

The key to successful grounding for video surveillance is to understand a semantic phrase corresponding to important actors and objects. Conventional methods ignore comprehensive contexts for the phrase or require heavy computation for…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Sunoh Kim , Kimin Yun , Jin Young Choi

This paper focuses on tackling the problem of temporal language localization in videos, which aims to identify the start and end points of a moment described by a natural language sentence in an untrimmed video. However, it is non-trivial…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Zongmeng Zhang , Xianjing Han , Xuemeng Song , Yan Yan , Liqiang Nie

Point-Level temporal action localization (PTAL) aims to localize actions in untrimmed videos with only one timestamp annotation for each action instance. Existing methods adopt the frame-level prediction paradigm to learn from the sparse…

Computer Vision and Pattern Recognition · Computer Science 2020-12-16 Chen Ju , Peisen Zhao , Ya Zhang , Yanfeng Wang , Qi Tian

This paper studies the problem of temporal moment localization in a long untrimmed video using natural language as the query. Given an untrimmed video and a sentence as the query, the goal is to determine the starting, and the ending, of…

Computer Vision and Pattern Recognition · Computer Science 2020-03-13 Cristian Rodriguez-Opazo , Edison Marrese-Taylor , Fatemeh Sadat Saleh , Hongdong Li , Stephen Gould

Current methods for Video Moment Retrieval (VMR) struggle to align complex situations involving specific environmental details, character descriptions, and action narratives. To tackle this issue, we propose a Large Language Model-guided…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Weijia Liu , Bo Miao , Jiuxin Cao , Xuelin Zhu , Bo Liu , Mehwish Nasim , Ajmal Mian

We address the problem of video moment localization with natural language, i.e. localizing a video segment described by a natural language sentence. While most prior work focuses on grounding the query as a whole, temporal dependencies and…

Multimedia · Computer Science 2019-08-13 Songyang Zhang , Jinsong Su , Jiebo Luo

Video-Language Pre-training models have recently significantly improved various multi-modal downstream tasks. Previous dominant works mainly adopt contrastive learning to achieve global feature alignment across modalities. However, the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-19 Fan Ma , Xiaojie Jin , Heng Wang , Jingjia Huang , Linchao Zhu , Jiashi Feng , Yi Yang

We address the problem of temporal sentence localization in videos (TSLV). Traditional methods follow a top-down framework which localizes the target segment with pre-defined segment proposals. Although they have achieved decent…

Computer Vision and Pattern Recognition · Computer Science 2021-09-15 Daizong Liu , Xiaoye Qu , Jianfeng Dong , Pan Zhou

Temporal language grounding (TLG) aims to localize a video segment in an untrimmed video based on a natural language description. To alleviate the expensive cost of manual annotations for temporal boundary labels, we are dedicated to the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Yuechen Wang , Wengang Zhou , Houqiang Li

We aim to address the problem of Natural Language Video Localization (NLVL)-localizing the video segment corresponding to a natural language description in a long and untrimmed video. State-of-the-art NLVL methods are almost in one-stage…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Shaoning Xiao , Long Chen , Songyang Zhang , Wei Ji , Jian Shao , Lu Ye , Jun Xiao

We consider retrieving a specific temporal segment, or moment, from a video given a natural language text description. Methods designed to retrieve whole video clips with natural language determine what occurs in a video but not when. To…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Lisa Anne Hendricks , Oliver Wang , Eli Shechtman , Josef Sivic , Trevor Darrell , Bryan Russell

Prior works on text-based video moment localization focus on temporally grounding the textual query in an untrimmed video. These works assume that the relevant video is already known and attempt to localize the moment on that relevant video…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Sudipta Paul , Niluthpol Chowdhury Mithun , Amit K. Roy-Chowdhury

Point-level supervised temporal action localization (PTAL) aims at recognizing and localizing actions in untrimmed videos where only a single point (frame) within every action instance is annotated in training data. Without temporal…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Yuan Yin , Yifei Huang , Ryosuke Furuta , Yoichi Sato

This paper addresses the problem of temporal sentence grounding (TSG), which aims to identify the temporal boundary of a specific segment from an untrimmed video by a sentence query. Previous works either compare pre-defined candidate…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Daizong Liu , Xiaoye Qu , Jianfeng Dong , Pan Zhou , Yu Cheng , Wei Wei , Zichuan Xu , Yulai Xie
‹ Prev 1 2 3 10 Next ›