English
Related papers

Related papers: Proposal-free Temporal Moment Localization of a Na…

200 papers

This paper studies the task of temporal moment localization in a long untrimmed video using natural language query. Given a query sentence, the goal is to determine the start and end of the relevant segment within the video. Our key…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Cristian Rodriguez-Opazo , Edison Marrese-Taylor , Basura Fernando , Hongdong Li , Stephen Gould

Localizing moments in a longer video via natural language queries is a new, challenging task at the intersection of language and video understanding. Though moment localization with natural language is similar to other language and vision…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Lisa Anne Hendricks , Oliver Wang , Eli Shechtman , Josef Sivic , Trevor Darrell , Bryan Russell

The task of moment localization is to localize a temporal moment in an untrimmed video for a given natural language query. Since untrimmed video contains highly redundant contents, the quality of the query is crucial for accurately…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Wenfeng Yan , Shaoxiang Chen , Zuxuan Wu , Yu-Gang Jiang

We address the problem of retrieving a specific moment from an untrimmed video by a query sentence. This is a challenging problem because a target moment may take place in relations to other temporal moments in the untrimmed video. Existing…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Songyang Zhang , Houwen Peng , Jianlong Fu , Jiebo Luo

Video temporal grounding aims to identify video segments within untrimmed videos that are most relevant to a given natural language query. Existing video temporal localization models rely on specific datasets for training and have high data…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Minghang Zheng , Xinhao Cai , Qingchao Chen , Yuxin Peng , Yang Liu

Given an untrimmed video and a natural language query, Natural Language Video Localization (NLVL) aims to identify the video moment described by the query. To address this task, existing methods can be roughly grouped into two groups: 1)…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Shaoning Xiao , Long Chen , Jian Shao , Yueting Zhuang , Jun Xiao

We address the problem of video moment localization with natural language, i.e. localizing a video segment described by a natural language sentence. While most prior work focuses on grounding the query as a whole, temporal dependencies and…

Multimedia · Computer Science 2019-08-13 Songyang Zhang , Jinsong Su , Jiebo Luo

Prior works on text-based video moment localization focus on temporally grounding the textual query in an untrimmed video. These works assume that the relevant video is already known and attempt to localize the moment on that relevant video…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Sudipta Paul , Niluthpol Chowdhury Mithun , Amit K. Roy-Chowdhury

In this paper, we study the problem of weakly-supervised temporal grounding of sentence in video. Specifically, given an untrimmed video and a query sentence, our goal is to localize a temporal segment in the video that semantically…

Computer Vision and Pattern Recognition · Computer Science 2020-01-28 Zhenfang Chen , Lin Ma , Wenhan Luo , Peng Tang , Kwan-Yee K. Wong

Understanding videos to localize moments with natural language often requires large expensive annotated video regions paired with language queries. To eliminate the annotation costs, we make a first attempt to train a natural language video…

Computation and Language · Computer Science 2021-10-04 Jinwoo Nam , Daechul Ahn , Dongyeop Kang , Seong Jong Ha , Jonghyun Choi

The query-based moment retrieval is a problem of localising a specific clip from an untrimmed video according a query sentence. This is a challenging task that requires interpretation of both the natural language query and the video…

Computer Vision and Pattern Recognition · Computer Science 2020-10-08 Mayu Otani , Yuta Nakashima , Esa Rahtu , Janne Heikkilä

We address the problem of language-based temporal localization of moments in untrimmed videos. Compared to temporal localization with fixed categories, this problem is more challenging as the language-based queries have no predefined…

Computer Vision and Pattern Recognition · Computer Science 2020-06-19 Madhawa Vidanapathirana , Supriya Pandhre , Sonia Raychaudhuri , Anjali Khurana

Video moment localization, also known as video moment retrieval, aiming to search a target segment within a video described by a given natural language query. Beyond the task of temporal action localization whereby the target actions are…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Meng Liu , Liqiang Nie , Yunxiao Wang , Meng Wang , Yong Rui

We address the problem of retrieving a specific moment from an untrimmed video by natural language. It is a challenging problem because a target moment may take place in the context of other temporal moments in the untrimmed video. Existing…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Songyang Zhang , Houwen Peng , Jianlong Fu , Yijuan Lu , Jiebo Luo

Video action localization aims to find the timings of specific actions from a long video. Although existing learning-based approaches have been successful, they require annotating videos, which comes with a considerable labor cost. This…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Naoki Wake , Atsushi Kanehira , Kazuhiro Sasabuchi , Jun Takamatsu , Katsushi Ikeuchi

This paper studies the joint learning of action recognition and temporal localization in long, untrimmed videos. We employ a multi-task learning framework that performs the three highly related steps of action proposal, action recognition,…

Computer Vision and Pattern Recognition · Computer Science 2017-04-05 Yi Zhu , Shawn Newsam

We introduce the task of retrieving relevant video moments from a large corpus of untrimmed, unsegmented videos given a natural language query. Our task poses unique challenges as a system must efficiently identify both the relevant videos…

Computer Vision and Pattern Recognition · Computer Science 2022-02-24 Victor Escorcia , Mattia Soldan , Josef Sivic , Bernard Ghanem , Bryan Russell

This paper targets the task of language-based video moment localization. The language-based setting of this task allows for an open set of target activities, resulting in a large variation of the temporal lengths of video moments. Most…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Qi Zheng , Jianfeng Dong , Xiaoye Qu , Xun Yang , Yabing Wang , Pan Zhou , Baolong Liu , Xun Wang

This paper focuses on tackling the problem of temporal language localization in videos, which aims to identify the start and end points of a moment described by a natural language sentence in an untrimmed video. However, it is non-trivial…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Zongmeng Zhang , Xianjing Han , Xuemeng Song , Yan Yan , Liqiang Nie

Given an untrimmed video and a sentence description, temporal sentence localization aims to automatically determine the start and end points of the described sentence within the video. The problem is challenging as it needs the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Yitian Yuan , Tao Mei , Wenwu Zhu
‹ Prev 1 2 3 10 Next ›