English
Related papers

Related papers: Decoupling Localization and Classification in Sing…

200 papers

Traditional temporal action detection (TAD) usually handles untrimmed videos with small number of action instances from a single label (e.g., ActivityNet, THUMOS). However, this setting might be unrealistic as different classes of actions…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Jing Tan , Xiaotong Zhao , Xintian Shi , Bin Kang , Limin Wang

Weakly supervised temporal action localization aims to localize temporal boundaries of actions and simultaneously identify their categories with only video-level category labels. Many existing methods seek to generate pseudo labels for…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Linjiang Huang , Liang Wang , Hongsheng Li

In this work, we address the problem of spatio-temporal action detection in temporally untrimmed videos. It is an important and challenging task as finding accurate human actions in both temporal and spatial space is important for analyzing…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Zhenheng Yang , Jiyang Gao , Ram Nevatia

Existing approaches for spatio-temporal action detection in videos are limited by the spatial extent and temporal duration of the actions. In this paper, we present a modular system for spatio-temporal action detection in untrimmed security…

Computer Vision and Pattern Recognition · Computer Science 2018-11-26 Joshua Gleason , Rajeev Ranjan , Steven Schwarcz , Carlos D. Castillo , Jun-Chen Cheng , Rama Chellappa

An integral part of video analysis and surveillance is temporal activity detection, which means to simultaneously recognize and localize activities in long untrimmed videos. Currently, the most effective methods of temporal activity…

Computer Vision and Pattern Recognition · Computer Science 2020-03-13 Lingling Zhang , Xiaojun Chang , Jun Liu , Minnan Luo , Sen Wang , Zongyuan Ge , Alexander Hauptmann

Temporal action detection (TAD) involves the localization and classification of action instances within untrimmed videos. While standard TAD follows fully supervised learning with closed-set setting on large training data, recent zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Thinh Phan , Khoa Vo , Duy Le , Gianfranco Doretto , Donald Adjeroh , Ngan Le

Open-Vocabulary Temporal Action Detection (OV-TAD) aims to classify and localize action segments in untrimmed videos for unseen categories. Previous methods rely solely on global alignment between label-level semantics and visual features,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Sa Zhu , Wanqian Zhang , Lin Wang , Xiaohua Chen , Chenxu Cui , Jinchao Zhang , Bo Li

Spatio-temporal action detection (STAD) aims to classify the actions present in a video and localize them in space and time. It has become a particularly active area of research in computer vision because of its explosively emerging…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Peng Wang , Fanwei Zeng , Yuntao Qian

Existing temporal action detection (TAD) methods rely on a large number of training data with segment-level annotations. Collecting and annotating such a training set is thus highly expensive and unscalable. Semi-supervised TAD (SS-TAD)…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Sauradip Nag , Xiatian Zhu , Yi-Zhe Song , Tao Xiang

Temporal Action Detection (TAD) requires precise localization of action boundaries within long, untrimmed video sequences. While current high-performing methods achieve strong accuracy, they are often characterized by excessive parameter…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Zepeng Sun , Naichuan Zheng , Hailun Xia , Junjie Wu , Liwei Bao , Xiaotai Zhang

Designing a technique for the automatic analysis of different actions in videos in order to detect the presence of interested activities is of high significance nowadays. In this paper, we explore a robust and dynamic appearance technique…

Computer Vision and Pattern Recognition · Computer Science 2019-02-21 Abdul Basit

Weakly supervised temporal action detection is a Herculean task in understanding untrimmed videos, since no supervisory signal except the video-level category label is available on training data. Under the supervision of category labels,…

Computer Vision and Pattern Recognition · Computer Science 2018-07-19 Jia-Xing Zhong , Nannan Li , Weijie Kong , Tao Zhang , Thomas H. Li , Ge Li

Temporal action localization aims to identify the boundaries and categories of actions in videos, such as scoring a goal in a football match. Single-frame supervision has emerged as a labor-efficient way to train action localizers as it…

Human-Computer Interaction · Computer Science 2023-12-11 Changjian Chen , Jiashu Chen , Weikai Yang , Haoze Wang , Johannes Knittel , Xibin Zhao , Steffen Koch , Thomas Ertl , Shixia Liu

The dominant paradigm for video-based action segmentation is composed of two steps: first, for each frame, compute low-level features using Dense Trajectories or a Convolutional Neural Network that encode spatiotemporal information locally,…

Computer Vision and Pattern Recognition · Computer Science 2016-08-31 Colin Lea , Rene Vidal , Austin Reiter , Gregory D. Hager

Long-term complex activity recognition and localisation can be crucial for decision making in autonomous systems such as smart cars and surgical robots. Here we address the problem via a novel deformable, spatiotemporal scene graph…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Salman Khan , Fabio Cuzzolin

Temporal action segmentation in untrimmed videos has gained increased attention recently. However, annotating action classes and frame-wise boundaries is extremely time consuming and cost intensive, especially on large-scale datasets. To…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Wei Lin , Anna Kukleva , Horst Possegger , Hilde Kuehne , Horst Bischof

Weakly-supervised temporal action localization aims to locate action regions and identify action categories in untrimmed videos simultaneously by taking only video-level labels as the supervision. Pseudo label generation is a promising…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Wulian Yun , Mengshi Qi , Chuanming Wang , Huadong Ma

Open-vocabulary Temporal Action Detection (Open-vocab TAD) is an advanced video analysis approach that expands Closed-vocabulary Temporal Action Detection (Closed-vocab TAD) capabilities. Closed-vocab TAD is typically confined to localizing…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Trung Thanh Nguyen , Yasutomo Kawanishi , Takahiro Komamizu , Ichiro Ide

Single shot detectors that are potentially faster and simpler than two-stage detectors tend to be more applicable to object detection in videos. Nevertheless, the extension of such object detectors from image to video is not trivial…

Computer Vision and Pattern Recognition · Computer Science 2020-07-08 Jiajun Deng , Yingwei Pan , Ting Yao , Wengang Zhou , Houqiang Li , Tao Mei

To balance the annotation labor and the granularity of supervision, single-frame annotation has been introduced in temporal action localization. It provides a rough temporal location for an action but implicitly overstates the supervision…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Bin Wang , Yan Song , Fanming Wang , Yang Zhao , Xiangbo Shu , Yan Rui