English
Related papers

Related papers: Structured Attention Composition for Temporal Acti…

200 papers

Existing action detection algorithms usually generate action proposals through an extensive search over the video at multiple temporal scales, which brings about huge computational overhead and deviates from the human perception procedure.…

Computer Vision and Pattern Recognition · Computer Science 2017-06-23 Jingjia Huang , Nannan Li , Tao Zhang , Ge Li

Identifying unusual driving behaviors exhibited by drivers during driving is essential for understanding driver behavior and the underlying causes of crashes. Previous studies have primarily approached this problem as a classification task,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Armstrong Aboah , Ulas Bagci , Abdul Rashid Mussah , Neema Jakisa Owor , Yaw Adu-Gyamfi

This paper addresses spatio-temporal localization of human actions in video. In order to localize actions in time, we propose a recurrent localization network (RecLNet) designed to model the temporal structure of actions on the level of…

Computer Vision and Pattern Recognition · Computer Science 2018-06-29 Guilhem Chéron , Anton Osokin , Ivan Laptev , Cordelia Schmid

Weakly-supervised temporal action localization is a problem of learning an action localization model with only video-level action labeling available. The general framework largely relies on the classification activation, which employs an…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Baifeng Shi , Qi Dai , Yadong Mu , Jingdong Wang

This technical report presents an overview of our solution used in the submission to ActivityNet Challenge 2020 Task 1 (\textbf{temporal action localization/detection}). Temporal action localization requires to not only precisely locate the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-27 Haisheng Su , Jinyuan Feng , Hao Shao , Zhenyu Jiang , Manyuan Zhang , Wei Wu , Yu Liu , Hongsheng Li , Junjie Yan

Skeleton-based action segmentation requires recognizing composable actions in untrimmed videos. Current approaches decouple this problem by first extracting local visual features from skeleton sequences and then processing them by a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Di Yang , Yaohui Wang , Antitza Dantcheva , Quan Kong , Lorenzo Garattoni , Gianpiero Francesca , Francois Bremond

Real-time video analysis remains a challenging problem in computer vision, requiring efficient processing of both spatial and temporal information while maintaining computational efficiency. Existing approaches often struggle to balance…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Shahla John

Recent video recognition models utilize Transformer models for long-range spatio-temporal context modeling. Video transformer designs are based on self-attention that can model global context at a high computational cost. In comparison,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Syed Talal Wasim , Muhammad Uzair Khattak , Muzammal Naseer , Salman Khan , Mubarak Shah , Fahad Shahbaz Khan

Advancements in attention mechanisms have led to significant performance improvements in a variety of areas in machine learning due to its ability to enable the dynamic modeling of temporal sequences. A particular area in computer vision…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Brennan Gebotys , Alexander Wong , David A. Clausi

Capturing contextual dependencies has proven useful to improve the representational power of deep neural networks. Recent approaches that focus on modeling global context, such as self-attention and non-local operation, achieve this goal by…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Shenao Zhang , Li Shen , Zhifeng Li , Wei Liu

This paper presents a new task, the grounding of spatio-temporal identifying descriptions in videos. Previous work suggests potential bias in existing datasets and emphasizes the need for a new data creation schema to better model…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Peratham Wiriyathammabhum , Abhinav Shrivastava , Vlad I. Morariu , Larry S. Davis

Weakly-supervised temporal action localization aims to localize actions in untrimmed videos with only video-level action category labels. Most of previous methods ignore the incompleteness issue of Class Activation Sequences (CAS),…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Chen Ju , Peisen Zhao , Siheng Chen , Ya Zhang , Xiaoyun Zhang , Qi Tian

While observing complex events with multiple actors, humans do not assess each actor separately, but infer from the context. The surrounding context provides essential information for understanding actions. To this end, we propose to…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Oytun Ulutan , Swati Rallapalli , Mudhakar Srivatsa , Carlos Torres , B. S. Manjunath

Video temporal action detection aims to temporally localize and recognize the action in untrimmed videos. Existing one-stage approaches mostly focus on unifying two subtasks, i.e., localization of action proposals and classification of each…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Yupan Huang , Qi Dai , Yutong Lu

Literature on self-assessment in machine learning mainly focuses on the production of well-calibrated algorithms through consensus frameworks i.e. calibration is seen as a problem. Yet, we observe that learning to be properly confident…

Machine Learning · Computer Science 2020-11-16 Guillaume Vaudaux-Ruth , Adrien Chan-Hon-Tong , Catherine Achard

Video action recognition, which is topical in computer vision and video analysis, aims to allocate a short video clip to a pre-defined category such as brushing hair or climbing stairs. Recent works focus on action recognition with deep…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Yuqi Huo , Xiaoli Xu , Yao Lu , Yulei Niu , Zhiwu Lu , Ji-Rong Wen

As a challenging task of high-level video understanding, weakly supervised temporal action localization has been attracting increasing attention. With only video annotations, most existing methods seek to handle this task with a…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Linjiang Huang , Liang Wang , Hongsheng Li

Temporal action detection (TAD) aims to locate and recognize the actions in an untrimmed video. Anchor-free methods have made remarkable progress which mainly formulate TAD into two tasks: classification and localization using two separate…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Junshan Hu , Chaoxu guo , Liansheng Zhuang , Biao Wang , Tiezheng Ge , Yuning Jiang , Houqiang Li

Video action analysis is a foundational technology within the realm of intelligent video comprehension, particularly concerning its application in Internet of Things(IoT). However, existing methodologies overlook feature semantics in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Guiqin Wang , Peng Zhao , Cong Zhao , Jing Huang , Siyan Guo , Shusen Yang

Deep learning models have enjoyed great success for image related computer vision tasks like image classification and object detection. For video related tasks like human action recognition, however, the advancements are not as significant…

Computer Vision and Pattern Recognition · Computer Science 2018-09-12 Xiaolin Song , Cuiling Lan , Wenjun Zeng , Junliang Xing , Jingyu Yang , Xiaoyan Sun