English
Related papers

Related papers: Action Shuffling for Weakly Supervised Temporal Lo…

200 papers

Visual event perception tasks such as action localization have primarily focused on supervised learning settings under a static observer, i.e., the camera is static and cannot be controlled by an algorithm. They are often restricted by the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-11 Shubham Trehan , Sathyanarayanan N. Aakur

Due to their architecture and how they are trained, artificial neural networks are typically not robust toward pruning or shuffling layers at test time. However, such properties would be desirable for different applications, such as…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Matthias Freiberger , Peter Kun , Anders Sundnes Løvlie , Sebastian Risi

Recently, video-based action recognition methods using convolutional neural networks (CNNs) achieve remarkable recognition performance. However, there is still lack of understanding about the generalization mechanism of action recognition…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Jaehui Hwang , Huan Zhang , Jun-Ho Choi , Cho-Jui Hsieh , Jong-Seok Lee

The problem of action recognition involves locating the action in the video, both over time and spatially in the image. The dominant current approaches use supervised learning to solve this problem, and require large amounts of annotated…

Computer Vision and Pattern Recognition · Computer Science 2020-03-30 Sathyanarayanan N. Aakur , Sudeep Sarkar

Weakly-supervised action localization requires training a model to localize the action segments in the video given only video level action label. It can be solved under the Multiple Instance Learning (MIL) framework, where a bag (video)…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Zhekun Luo , Devin Guillory , Baifeng Shi , Wei Ke , Fang Wan , Trevor Darrell , Huijuan Xu

In the task of temporal action localization of ActivityNet-1.3 datasets, we propose to locate the temporal boundaries of each action and predict action class in untrimmed videos. We first apply VideoSwinTransformer as feature extractor to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Shimin Chen , Wei Li , Jianyang Gu , Chen Chen , Yandong Guo

Weakly supervised object localization is a challenging task in which the object of interest should be localized while learning its appearance. State-of-the-art methods recycle the architecture of a standard CNN by using the activation maps…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Akhil Meethal , Marco Pedersoli , Soufiane Belharbi , Eric Granger

Temporally localizing activities within untrimmed videos has been extensively studied in recent years. Despite recent advances, existing methods for weakly-supervised temporal activity localization struggle to recognize when an activity is…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Kyle Min , Jason J. Corso

There has been a remarkable progress in learning a model which could recognise novel classes with only a few labeled examples in the last few years. Few-shot learning (FSL) for action recognition is a challenging task of recognising novel…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Neeraj Kumar , Siddhansh Narang

This paper strives for spatio-temporal localization of human actions in videos. In the literature, the consensus is to achieve localization by training on bounding box annotations provided for each frame of each training video. As…

Computer Vision and Pattern Recognition · Computer Science 2018-10-02 Pascal Mettes , Cees G. M. Snoek

Few-shot learning aims to recognize instances from novel classes with few labeled samples, which has great value in research and application. Although there has been a lot of work in this area recently, most of the existing work is based on…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Congqi Cao , Yajuan Li , Qinyi Lv , Peng Wang , Yanning Zhang

Action recognition is a fundamental problem in computer vision with a lot of potential applications such as video surveillance, human computer interaction, and robot learning. Given pre-segmented videos, the task is to recognize actions…

Computer Vision and Pattern Recognition · Computer Science 2017-06-28 Ahsan Iqbal , Alexander Richard , Hilde Kuehne , Juergen Gall

Current action recognition methods heavily rely on trimmed videos for model training. However, it is expensive and time-consuming to acquire a large-scale trimmed video dataset. This paper presents a new weakly supervised architecture,…

Computer Vision and Pattern Recognition · Computer Science 2017-05-23 Limin Wang , Yuanjun Xiong , Dahua Lin , Luc Van Gool

Temporal action localization in untrimmed videos is an important but difficult task. Difficulties are encountered in the application of existing methods when modeling temporal structures of videos. In the present study, we developed a novel…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Yuan Zhou , Hongru Li , Sun-Yuan Kung

Weakly-Supervised Temporal Action Localization (WS-TAL) task aims to recognize and localize temporal starts and ends of action instances in an untrimmed video with only video-level label supervision. Due to lack of negative samples of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Xiang Wang , Zhiwu Qing , Ziyuan Huang , Yutong Feng , Shiwei Zhang , Jianwen Jiang , Mingqian Tang , Yuanjie Shao , Nong Sang

We introduce the Action Transformer model for recognizing and localizing human actions in video clips. We repurpose a Transformer-style architecture to aggregate features from the spatiotemporal context around the person whose actions we…

Computer Vision and Pattern Recognition · Computer Science 2019-05-20 Rohit Girdhar , João Carreira , Carl Doersch , Andrew Zisserman

This paper studies the joint learning of action recognition and temporal localization in long, untrimmed videos. We employ a multi-task learning framework that performs the three highly related steps of action proposal, action recognition,…

Computer Vision and Pattern Recognition · Computer Science 2017-04-05 Yi Zhu , Shawn Newsam

Weakly supervised temporal action localization (WTAL) aims to detect action instances in untrimmed videos using only video-level annotations. Since many existing works optimize WTAL models based on action classification labels, they…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Geuntaek Lim , Hyunwoo Kim , Joonsoo Kim , Yukyung Choi

Temporal action localization aims to identify the boundaries and categories of actions in videos, such as scoring a goal in a football match. Single-frame supervision has emerged as a labor-efficient way to train action localizers as it…

Human-Computer Interaction · Computer Science 2023-12-11 Changjian Chen , Jiashu Chen , Weikai Yang , Haoze Wang , Johannes Knittel , Xibin Zhao , Steffen Koch , Thomas Ertl , Shixia Liu

Temporal Action Localization (TAL) in untrimmed video is important for many applications. But it is very expensive to annotate the segment-level ground truth (action class and temporal boundary). This raises the interest of addressing TAL…

Computer Vision and Pattern Recognition · Computer Science 2018-12-18 Zheng Shou , Hang Gao , Lei Zhang , Kazuyuki Miyazawa , Shih-Fu Chang