English
Related papers

Related papers: ActionSpotter: Deep Reinforcement Learning Framewo…

200 papers

Automatically recognizing and localizing wide ranges of human actions has crucial importance for video understanding. Towards this goal, the THUMOS challenge was introduced in 2013 to serve as a benchmark for action recognition. Until then,…

Computer Vision and Pattern Recognition · Computer Science 2016-12-06 Haroon Idrees , Amir R. Zamir , Yu-Gang Jiang , Alex Gorban , Ivan Laptev , Rahul Sukthankar , Mubarak Shah

Temporal action localization is an important yet challenging task in video understanding. Typically, such a task aims at inferring both the action category and localization of the start and end frame for each action instance in a long,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Chuming Lin , Chengming Xu , Donghao Luo , Yabiao Wang , Ying Tai , Chengjie Wang , Jilin Li , Feiyue Huang , Yanwei Fu

We propose a soft attention based model for the task of action recognition in videos. We use multi-layered Recurrent Neural Networks (RNNs) with Long Short-Term Memory (LSTM) units which are deep both spatially and temporally. Our model…

Machine Learning · Computer Science 2016-02-16 Shikhar Sharma , Ryan Kiros , Ruslan Salakhutdinov

Despite the recent progress in video understanding and the continuous rate of improvement in temporal action localization throughout the years, it is still unclear how far (or close?) we are to solving the problem. To this end, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Humam Alwassel , Fabian Caba Heilbron , Victor Escorcia , Bernard Ghanem

In this paper, we address the problem of searching action proposals in unconstrained video clips. Our approach starts from actionness estimation on frame-level bounding boxes, and then aggregates the bounding boxes belonging to the same…

Computer Vision and Pattern Recognition · Computer Science 2016-08-24 Nannan Li , Dan Xu , Zhenqiang Ying , Zhihao Li , Ge Li

Identifying unusual driving behaviors exhibited by drivers during driving is essential for understanding driver behavior and the underlying causes of crashes. Previous studies have primarily approached this problem as a classification task,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Armstrong Aboah , Ulas Bagci , Abdul Rashid Mussah , Neema Jakisa Owor , Yaw Adu-Gyamfi

Video action detectors are usually trained using datasets with fully-supervised temporal annotations. Building such datasets is an expensive task. To alleviate this problem, recent methods have tried to leverage weak labeling, where videos…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Alejandro Pardo , Humam Alwassel , Fabian Caba Heilbron , Ali Thabet , Bernard Ghanem

Learning to localize actions in long, cluttered, and untrimmed videos is a hard task, that in the literature has typically been addressed assuming the availability of large amounts of annotated training samples for each class -- either in a…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Ting-Ting Xie , Christos Tzelepis , Fan Fu , Ioannis Patras

The task of action detection aims at deducing both the action category and localization of the start and end moment for each action instance in a long, untrimmed video. While vision Transformers have driven the recent advances in video…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Yuetian Weng , Zizheng Pan , Mingfei Han , Xiaojun Chang , Bohan Zhuang

In this paper, we address the challenging problem of spatial and temporal action detection in videos. We first develop an effective approach to localize frame-level action regions through integrating static and kinematic information by the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Yuancheng Ye , Xiaodong Yang , Yingli Tian

The task of action spotting consists in both identifying actions and precisely localizing them in time with a single timestamp in long, untrimmed video streams. Automatically extracting those actions is crucial for many sports applications,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Silvio Giancola , Anthony Cioppa , Bernard Ghanem , Marc Van Droogenbroeck

In temporal action localization, given an input video, the goal is to predict which actions it contains, where they begin, and where they end. Training and testing current state-of-the-art deep learning models requires access to large…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Jan Warchocki , Teodor Oprescu , Yunhan Wang , Alexandru Damacus , Paul Misterka , Robert-Jan Bruintjes , Attila Lengyel , Ombretta Strafforello , Jan van Gemert

Video activity localization aims at understanding the semantic content in long untrimmed videos and retrieving actions of interest. The retrieved action with its start and end locations can be used for highlight generation, temporal action…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Mengmeng Xu , Mattia Soldan , Jialin Gao , Shuming Liu , Juan-Manuel Pérez-Rúa , Bernard Ghanem

Dominant approaches to action detection can only provide sub-optimal solutions to the problem, as they rely on seeking frame-level detections, to later compose them into "action tubes" in a post-processing step. With this paper we radically…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Suman Saha , Gurkirt Singh , Fabio Cuzzolin

Current methods for action recognition primarily rely on deep convolutional networks to derive feature embeddings of visual and motion features. While these methods have demonstrated remarkable performance on standard benchmarks, we are…

Computer Vision and Pattern Recognition · Computer Science 2020-05-21 Dian Shao , Yue Zhao , Bo Dai , Dahua Lin

In contrast to the widely studied problem of recognizing an action given a complete sequence, action anticipation aims to identify the action from only partially available videos. As such, it is therefore key to the success of computer…

Computer Vision and Pattern Recognition · Computer Science 2017-08-16 Mohammad Sadegh Aliakbarian , Fatemeh Sadat Saleh , Mathieu Salzmann , Basura Fernando , Lars Petersson , Lars Andersson

Video object segmentation is challenging yet important in a wide variety of applications for video analysis. Recent works formulate video object segmentation as a prediction task using deep nets to achieve appealing state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Yuan-Ting Hu , Jia-Bin Huang , Alexander G. Schwing

In video understanding, action spotting consists in temporally localizing human-induced events annotated with single timestamps. In this paper, we propose a novel loss function that specifically considers the temporal context naturally…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Anthony Cioppa , Adrien Deliège , Silvio Giancola , Bernard Ghanem , Marc Van Droogenbroeck , Rikke Gade , Thomas B. Moeslund

Zero-shot action recognition, which recognizes actions in videos without having received any training examples, is gaining wide attention considering it can save labor costs and training time. Nevertheless, the performance of zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Nan Wu , Hiroshi Kera , Kazuhiko Kawamoto

This paper addresses the problem of real-time action recognition in trimmed videos, for which deep neural networks have defined the state-of-the-art performance in the recent literature. For attaining higher recognition accuracies with…

Computer Vision and Pattern Recognition · Computer Science 2018-10-30 Marian K. Y. Boktor , Ahmad Al-Kabbany , Radwa Khalil , Said El-Khamy