中文
相关论文

相关论文: Enabling Weakly-Supervised Temporal Action Localiz…

200 篇论文

Despite the recent advances in video classification, progress in spatio-temporal action recognition has lagged behind. A major contributing factor has been the prohibitive cost of annotating videos frame-by-frame. In this paper, we present…

计算机视觉与模式识别 · 计算机科学 2020-07-22 Anurag Arnab , Chen Sun , Arsha Nagrani , Cordelia Schmid

Weakly-supervised temporal action localization (WTAL) aims to recognize and localize action instances with only video-level labels. Despite the significant progress, existing methods suffer from severe performance degradation when…

计算机视觉与模式识别 · 计算机科学 2024-04-23 Yangcen Liu , Ziyi Liu , Yuanhao Zhai , Wen Li , David Doerman , Junsong Yuan

Understanding the structure of complex activities in untrimmed videos is a challenging task in the area of action recognition. One problem here is that this task usually requires a large amount of hand-annotated minute- or even hour-long…

计算机视觉与模式识别 · 计算机科学 2020-10-01 Rosaura G. VidalMata , Walter J. Scheirer , Anna Kukleva , David Cox , Hilde Kuehne

We address the problem of fine-grained action localization from temporally untrimmed web videos. We assume that only weak video-level annotations are available for training. The goal is to use these weak labels to identify temporal segments…

计算机视觉与模式识别 · 计算机科学 2015-08-05 Chen Sun , Sanketh Shetty , Rahul Sukthankar , Ram Nevatia

Weakly-supervised temporal action localization aims to localize and recognize actions in untrimmed videos with only video-level category labels during training. Without instance-level annotations, most existing methods follow the…

计算机视觉与模式识别 · 计算机科学 2023-05-30 Huan Ren , Wenfei Yang , Tianzhu Zhang , Yongdong Zhang

Weakly supervised temporal action localization aims at learning the instance-level action pattern from the video-level labels, where a significant challenge is action-context confusion. To overcome this challenge, one recent work builds an…

计算机视觉与模式识别 · 计算机科学 2021-11-25 Le Yang , Junwei Han , Tao Zhao , Tianwei Lin , Dingwen Zhang , Jianxin Chen

Weakly supervised temporal action detection is a Herculean task in understanding untrimmed videos, since no supervisory signal except the video-level category label is available on training data. Under the supervision of category labels,…

计算机视觉与模式识别 · 计算机科学 2018-07-19 Jia-Xing Zhong , Nannan Li , Weijie Kong , Tao Zhang , Thomas H. Li , Ge Li

We propose a weakly supervised temporal action localization algorithm on untrimmed videos using convolutional neural networks. Our algorithm learns from video-level class labels and predicts temporal intervals of human actions with no…

计算机视觉与模式识别 · 计算机科学 2018-04-04 Phuc Nguyen , Ting Liu , Gautam Prasad , Bohyung Han

With video-level labels, weakly supervised temporal action localization (WTAL) applies a localization-by-classification paradigm to detect and classify the action in untrimmed videos. Due to the characteristic of classification,…

计算机视觉与模式识别 · 计算机科学 2022-07-15 Ziqiang Li , Yongxin Ge , Jiaruo Yu , Zhongming Chen

We present an approach for weakly supervised learning of human actions from video transcriptions. Our system is based on the idea that, given a sequence of input data and a transcript, i.e. a list of the order the actions occur in the…

计算机视觉与模式识别 · 计算机科学 2017-06-20 Hilde Kuehne , Alexander Richard , Juergen Gall

The vocabulary size in temporal action localization (TAL) is limited by the scarcity of large-scale annotated datasets. To overcome this, recent works integrate vision-language models (VLMs), such as CLIP, for open-vocabulary TAL (OV-TAL).…

计算机视觉与模式识别 · 计算机科学 2024-12-20 Jeongseok Hyun , Su Ho Han , Hyolim Kang , Joon-Young Lee , Seon Joo Kim

Temporal Action Localization (TAL) aims to detect the start and end timestamps of actions in a video. However, the training of TAL models requires a substantial amount of manually annotated data. Data programming is an efficient method to…

人机交互 · 计算机科学 2025-05-26 Yuchen He , Jianbing Lv , Liqi Cheng , Lingyu Meng , Dazhen Deng , Yingcai Wu

Developing end-to-end action recognition models on long videos is fundamental and crucial for long-video action understanding. Due to the unaffordable cost of end-to-end training on the whole long videos, existing works generally train…

计算机视觉与模式识别 · 计算机科学 2024-05-27 Jiaming Zhou , Hanjun Li , Kun-Yu Lin , Junwei Liang

Online temporal action localization (On-TAL) is the task of identifying multiple action instances given a streaming video. Since existing methods take as input only a video segment of fixed size per iteration, they are limited in…

计算机视觉与模式识别 · 计算机科学 2024-08-07 Youngkil Song , Dongkeun Kim , Minsu Cho , Suha Kwak

Weakly-supervised action localization requires training a model to localize the action segments in the video given only video level action label. It can be solved under the Multiple Instance Learning (MIL) framework, where a bag (video)…

计算机视觉与模式识别 · 计算机科学 2020-12-23 Zhekun Luo , Devin Guillory , Baifeng Shi , Wei Ke , Fang Wan , Trevor Darrell , Huijuan Xu

Action detection and temporal segmentation of actions in videos are topics of increasing interest. While fully supervised systems have gained much attention lately, full annotation of each action within the video is costly and impractical…

计算机视觉与模式识别 · 计算机科学 2018-05-18 Alexander Richard , Hilde Kuehne , Juergen Gall

Weakly supervised temporal action localization (WTAL) aims to detect action instances in untrimmed videos using only video-level annotations. Since many existing works optimize WTAL models based on action classification labels, they…

计算机视觉与模式识别 · 计算机科学 2024-08-13 Geuntaek Lim , Hyunwoo Kim , Joonsoo Kim , Yukyung Choi

Learning to recognize actions from only a handful of labeled videos is a challenging problem due to the scarcity of tediously collected activity labels. We approach this problem by learning a two-pathway temporal contrastive model using…

计算机视觉与模式识别 · 计算机科学 2021-03-30 Ankit Singh , Omprakash Chakraborty , Ashutosh Varshney , Rameswar Panda , Rogerio Feris , Kate Saenko , Abir Das

The present few-shot temporal action localization model can't handle the situation where videos contain multiple action instances. So the purpose of this paper is to achieve manifold action instances localization in a lengthy untrimmed…

计算机视觉与模式识别 · 计算机科学 2024-08-27 Fengshun Wang , Qiurui Wang , Yuting Wang

As of today, state-of-the-art activity recognition from wearable sensors relies on algorithms being trained to classify fixed windows of data. In contrast, video-based Human Activity Recognition, known as Temporal Action Localization (TAL),…

机器学习 · 计算机科学 2024-10-15 Marius Bock , Michael Moeller , Kristof Van Laerhoven