中文
相关论文

相关论文: Progressive Localization Networks for Language-bas…

200 篇论文

We address the challenging task of cross-modal moment retrieval, which aims to localize a temporal segment from an untrimmed video described by a natural language query. It poses great challenges over the proper semantic alignment between…

计算机视觉与模式识别 · 计算机科学 2022-08-22 Kun Liu , Huadong Ma , Chuang Gan

Localizing moments in a longer video via natural language queries is a new, challenging task at the intersection of language and video understanding. Though moment localization with natural language is similar to other language and vision…

计算机视觉与模式识别 · 计算机科学 2018-09-06 Lisa Anne Hendricks , Oliver Wang , Eli Shechtman , Josef Sivic , Trevor Darrell , Bryan Russell

Given an untrimmed video and a natural language query, Natural Language Video Localization (NLVL) aims to identify the video moment described by the query. To address this task, existing methods can be roughly grouped into two groups: 1)…

计算机视觉与模式识别 · 计算机科学 2022-11-02 Shaoning Xiao , Long Chen , Jian Shao , Yueting Zhuang , Jun Xiao

Natural language video localization (NLVL), which aims to locate a target moment from a video that semantically corresponds to a text query, is a novel and challenging task. Toward this end, in this paper, we present a comprehensive survey…

计算机视觉与模式识别 · 计算机科学 2021-04-02 Xinfang Liu , Xiushan Nie , Zhifang Tan , Jie Guo , Yilong Yin

The task of moment localization is to localize a temporal moment in an untrimmed video for a given natural language query. Since untrimmed video contains highly redundant contents, the quality of the query is crucial for accurately…

计算机视觉与模式识别 · 计算机科学 2023-06-07 Wenfeng Yan , Shaoxiang Chen , Zuxuan Wu , Yu-Gang Jiang

Video moment localization, also known as video moment retrieval, aiming to search a target segment within a video described by a given natural language query. Beyond the task of temporal action localization whereby the target actions are…

计算机视觉与模式识别 · 计算机科学 2023-06-14 Meng Liu , Liqiang Nie , Yunxiao Wang , Meng Wang , Yong Rui

The key to successful grounding for video surveillance is to understand a semantic phrase corresponding to important actors and objects. Conventional methods ignore comprehensive contexts for the phrase or require heavy computation for…

计算机视觉与模式识别 · 计算机科学 2022-04-13 Sunoh Kim , Kimin Yun , Jin Young Choi

This paper focuses on tackling the problem of temporal language localization in videos, which aims to identify the start and end points of a moment described by a natural language sentence in an untrimmed video. However, it is non-trivial…

计算机视觉与模式识别 · 计算机科学 2021-10-13 Zongmeng Zhang , Xianjing Han , Xuemeng Song , Yan Yan , Liqiang Nie

Point-Level temporal action localization (PTAL) aims to localize actions in untrimmed videos with only one timestamp annotation for each action instance. Existing methods adopt the frame-level prediction paradigm to learn from the sparse…

计算机视觉与模式识别 · 计算机科学 2020-12-16 Chen Ju , Peisen Zhao , Ya Zhang , Yanfeng Wang , Qi Tian

This paper studies the problem of temporal moment localization in a long untrimmed video using natural language as the query. Given an untrimmed video and a sentence as the query, the goal is to determine the starting, and the ending, of…

计算机视觉与模式识别 · 计算机科学 2020-03-13 Cristian Rodriguez-Opazo , Edison Marrese-Taylor , Fatemeh Sadat Saleh , Hongdong Li , Stephen Gould

Current methods for Video Moment Retrieval (VMR) struggle to align complex situations involving specific environmental details, character descriptions, and action narratives. To tackle this issue, we propose a Large Language Model-guided…

计算机视觉与模式识别 · 计算机科学 2024-05-22 Weijia Liu , Bo Miao , Jiuxin Cao , Xuelin Zhu , Bo Liu , Mehwish Nasim , Ajmal Mian

We address the problem of video moment localization with natural language, i.e. localizing a video segment described by a natural language sentence. While most prior work focuses on grounding the query as a whole, temporal dependencies and…

多媒体 · 计算机科学 2019-08-13 Songyang Zhang , Jinsong Su , Jiebo Luo

Video-Language Pre-training models have recently significantly improved various multi-modal downstream tasks. Previous dominant works mainly adopt contrastive learning to achieve global feature alignment across modalities. However, the…

计算机视觉与模式识别 · 计算机科学 2023-01-19 Fan Ma , Xiaojie Jin , Heng Wang , Jingjia Huang , Linchao Zhu , Jiashi Feng , Yi Yang

We address the problem of temporal sentence localization in videos (TSLV). Traditional methods follow a top-down framework which localizes the target segment with pre-defined segment proposals. Although they have achieved decent…

计算机视觉与模式识别 · 计算机科学 2021-09-15 Daizong Liu , Xiaoye Qu , Jianfeng Dong , Pan Zhou

Temporal language grounding (TLG) aims to localize a video segment in an untrimmed video based on a natural language description. To alleviate the expensive cost of manual annotations for temporal boundary labels, we are dedicated to the…

计算机视觉与模式识别 · 计算机科学 2022-10-24 Yuechen Wang , Wengang Zhou , Houqiang Li

We aim to address the problem of Natural Language Video Localization (NLVL)-localizing the video segment corresponding to a natural language description in a long and untrimmed video. State-of-the-art NLVL methods are almost in one-stage…

计算机视觉与模式识别 · 计算机科学 2022-11-03 Shaoning Xiao , Long Chen , Songyang Zhang , Wei Ji , Jian Shao , Lu Ye , Jun Xiao

We consider retrieving a specific temporal segment, or moment, from a video given a natural language text description. Methods designed to retrieve whole video clips with natural language determine what occurs in a video but not when. To…

计算机视觉与模式识别 · 计算机科学 2017-08-08 Lisa Anne Hendricks , Oliver Wang , Eli Shechtman , Josef Sivic , Trevor Darrell , Bryan Russell

Prior works on text-based video moment localization focus on temporally grounding the textual query in an untrimmed video. These works assume that the relevant video is already known and attempt to localize the moment on that relevant video…

计算机视觉与模式识别 · 计算机科学 2021-11-10 Sudipta Paul , Niluthpol Chowdhury Mithun , Amit K. Roy-Chowdhury

Point-level supervised temporal action localization (PTAL) aims at recognizing and localizing actions in untrimmed videos where only a single point (frame) within every action instance is annotated in training data. Without temporal…

计算机视觉与模式识别 · 计算机科学 2023-10-10 Yuan Yin , Yifei Huang , Ryosuke Furuta , Yoichi Sato

This paper addresses the problem of temporal sentence grounding (TSG), which aims to identify the temporal boundary of a specific segment from an untrimmed video by a sentence query. Previous works either compare pre-defined candidate…

计算机视觉与模式识别 · 计算机科学 2021-03-23 Daizong Liu , Xiaoye Qu , Jianfeng Dong , Pan Zhou , Yu Cheng , Wei Wei , Zichuan Xu , Yulai Xie
‹ 上一页 1 2 3 10 下一页 ›