English
Related papers

Related papers: Exploring Feature Representation and Training stra…

200 papers

We propose TAL-Net, an improved approach to temporal action localization in video that is inspired by the Faster R-CNN object detection framework. TAL-Net addresses three key shortcomings of existing approaches: (1) we improve receptive…

Computer Vision and Pattern Recognition · Computer Science 2018-04-23 Yu-Wei Chao , Sudheendra Vijayanarasimhan , Bryan Seybold , David A. Ross , Jia Deng , Rahul Sukthankar

Temporal Action Detection (TAD), the task of localizing and classifying actions in untrimmed video, remains challenging due to action overlaps and variable action durations. Recent findings suggest that TAD performance is dependent on the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Aglind Reka , Diana Laura Borza , Dominick Reilly , Michal Balazia , Francois Bremond

Temporal Action Proposal (TAP) generation is an important problem, as fast and accurate extraction of semantically important (e.g. human actions) segments from untrimmed videos is an important step for large-scale video analysis. We propose…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Jiyang Gao , Zhenheng Yang , Chen Sun , Kan Chen , Ram Nevatia

Weakly supervised temporal action localization aims to detect and localize actions in untrimmed videos with only video-level labels during training. However, without frame-level annotations, it is challenging to achieve localization…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Wang Luo , Tianzhu Zhang , Wenfei Yang , Jingen Liu , Tao Mei , Feng Wu , Yongdong Zhang

The main challenge of Temporal Action Localization is to retrieve subtle human actions from various co-occurring ingredients, e.g., context and background, in an untrimmed video. While prior approaches have achieved substantial progress…

Computer Vision and Pattern Recognition · Computer Science 2022-06-24 Kun Xia , Le Wang , Sanping Zhou , Nanning Zheng , Wei Tang

Deep learning models have enjoyed great success for image related computer vision tasks like image classification and object detection. For video related tasks like human action recognition, however, the advancements are not as significant…

Computer Vision and Pattern Recognition · Computer Science 2018-09-12 Xiaolin Song , Cuiling Lan , Wenjun Zeng , Junliang Xing , Jingyu Yang , Xiaoyan Sun

Temporal action detection (TAD) aims to determine the semantic label and the temporal interval of every action instance in an untrimmed video. It is a fundamental and challenging task in video understanding. Previous methods tackle this…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Xiaolong Liu , Qimeng Wang , Yao Hu , Xu Tang , Shiwei Zhang , Song Bai , Xiang Bai

Automatically recognizing and localizing wide ranges of human actions has crucial importance for video understanding. Towards this goal, the THUMOS challenge was introduced in 2013 to serve as a benchmark for action recognition. Until then,…

Computer Vision and Pattern Recognition · Computer Science 2016-12-06 Haroon Idrees , Amir R. Zamir , Yu-Gang Jiang , Alex Gorban , Ivan Laptev , Rahul Sukthankar , Mubarak Shah

Temporal Action Localization (TAL) is a critical task in video analysis, identifying precise start and end times of actions. Existing methods like CNNs, RNNs, GCNs, and Transformers have limitations in capturing long-range dependencies and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Sangyoun Lee , Juho Jung , Changdae Oh , Sunghee Yun

We present a method for weakly-supervised action localization based on graph convolutions. In order to find and classify video time segments that correspond to relevant action classes, a system must be able to both identify discriminative…

Computer Vision and Pattern Recognition · Computer Science 2020-02-05 Maheen Rashid , Hedvig Kjellström , Yong Jae Lee

In this paper, we consider the problem of temporal action localization under low-shot (zero-shot & few-shot) scenario, with the goal of detecting and classifying the action instances from arbitrary categories within some untrimmed videos,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Chen Ju , Zeqian Li , Peisen Zhao , Ya Zhang , Xiaopeng Zhang , Qi Tian , Yanfeng Wang , Weidi Xie

Recently, Weakly-supervised Temporal Action Localization (WTAL) has been densely studied but there is still a large gap between weakly-supervised models and fully-supervised models. It is practical and intuitive to annotate temporal…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Xudong Lin , Zheng Shou , Shih-Fu Chang

Temporal action detection in long videos is an important problem. State-of-the-art methods address this problem by applying action classifiers on sliding windows. Although sliding windows may contain an identifiable portion of the actions,…

Computer Vision and Pattern Recognition · Computer Science 2017-05-04 Jiyang Gao , Zhenheng Yang , Ram Nevatia

Current state-of-the-art human action recognition is focused on the classification of temporally trimmed videos in which only one action occurs per frame. In this work we address the problem of action localisation and instance segmentation…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Suman Saha , Gurkirt Singh , Michael Sapienza , Philip H. S. Torr , Fabio Cuzzolin

Temporal action localization (TAL), which involves recognizing and locating action instances, is a challenging task in video understanding. Most existing approaches directly predict action classes and regress offsets to boundaries, while…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Jiayi Shao , Xiaohan Wang , Ruijie Quan , Junjun Zheng , Jiang Yang , Yi Yang

Summarizing video content is an important task in many applications. This task can be defined as the computation of the ordered list of actions present in a video. Such a list could be extracted using action detection algorithms. However,…

Machine Learning · Computer Science 2020-11-11 Guillaume Vaudaux-Ruth , Adrien Chan-Hon-Tong , Catherine Achard

Temporal action detection (TAD) aims to locate action positions and recognize action categories in long-term untrimmed videos. Although many methods have achieved promising results, their robustness has not been thoroughly studied. In…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Runhao Zeng , Xiaoyong Chen , Jiaming Liang , Huisi Wu , Guangzhong Cao , Yong Guo

Temporal action localization is a challenging computer vision problem with numerous real-world applications. Most existing methods require laborious frame-level supervision to train action localization models. In this work, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Sanath Narayan , Hisham Cholakkal , Fahad Shahbaz Khan , Ling Shao

The task of action detection aims at deducing both the action category and localization of the start and end moment for each action instance in a long, untrimmed video. While vision Transformers have driven the recent advances in video…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Yuetian Weng , Zizheng Pan , Mingfei Han , Xiaojun Chang , Bohan Zhuang

Current state-of-the-art approaches for spatio-temporal action localization rely on detections at the frame level that are then linked or tracked across time. In this paper, we leverage the temporal continuity of videos instead of operating…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Vicky Kalogeiton , Philippe Weinzaepfel , Vittorio Ferrari , Cordelia Schmid