English
Related papers

Related papers: SoGAR: Self-supervised Spatiotemporal Attention-ba…

200 papers

Deep neural networks based purely on attention have been successful across several domains, relying on minimal architectural priors from the designer. In Human Action Recognition (HAR), attention mechanisms have been primarily adopted on…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Vittorio Mazzia , Simone Angarano , Francesco Salvetti , Federico Angelini , Marcello Chiaberge

The success of deep neural networks generally requires a vast amount of training data to be labeled, which is expensive and unfeasible in scale, especially for video collections. To alleviate this problem, in this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2019-04-05 Longlong Jing , Xiaodong Yang , Jingen Liu , Yingli Tian

Capturing the dependencies between joints is critical in skeleton-based action recognition task. Transformer shows great potential to model the correlation of important joints. However, the existing Transformer-based methods cannot capture…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Helei Qiu , Biao Hou , Bo Ren , Xiaohua Zhang

Group Activity Understanding is predominantly studied as Group Activity Recognition (GAR) task. However, existing GAR benchmarks suffer from coarse-grained activity vocabularies and the only data form in single-view, which hinder the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yuchen Yang , Wei Wang , Yifei Liu , Linfeng Dong , Hao Wu , Mingxin Zhang , Zhihang Zhong , Xiao Sun

Like many team sports, basketball involves two groups of players who engage in collaborative and adversarial activities to win a game. Players and teams are executing various complex strategies to gain an advantage over their opponents.…

Machine Learning · Computer Science 2022-09-02 Sandro Hauri , Slobodan Vucetic

We propose a novel semi-supervised, Multi-Level Sequential Generative Adversarial Network (MLS-GAN) architecture for group activity recognition. In contrast to previous works which utilise manually annotated individual human action…

Computer Vision and Pattern Recognition · Computer Science 2018-12-19 Harshala Gammulle , Simon Denman , Sridha Sridharan , Clinton Fookes

Recognizing human actions in video sequences, known as Human Action Recognition (HAR), is a challenging task in pattern recognition. While Convolutional Neural Networks (ConvNets) have shown remarkable success in image recognition, they are…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Nguyen Huu Phong , Bernardete Ribeiro

Self-attention has been successfully applied to video representation learning due to the effectiveness of modeling long range dependencies. Existing approaches build the dependencies merely by computing the pairwise correlations along…

Computer Vision and Pattern Recognition · Computer Science 2021-05-28 Xudong Guo , Xun Guo , Yan Lu

Spatio-temporal feature learning is of central importance for action recognition in videos. Existing deep neural network models either learn spatial and temporal features independently (C2D) or jointly with unconstrained parameters (C3D).…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Chao Li , Qiaoyong Zhong , Di Xie , Shiliang Pu

We propose TubeR: a simple solution for spatio-temporal video action detection. Different from existing methods that depend on either an off-line actor detector or hand-designed actor-positional hypotheses like proposals or anchors, we…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Jiaojiao Zhao , Yanyi Zhang , Xinyu Li , Hao Chen , Shuai Bing , Mingze Xu , Chunhui Liu , Kaustav Kundu , Yuanjun Xiong , Davide Modolo , Ivan Marsic , Cees G. M. Snoek , Joseph Tighe

Understanding temporal dynamics of video is an essential aspect of learning better video representations. Recently, transformer-based architectural designs have been extensively explored for video tasks due to their capability to capture…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Sukmin Yun , Jaehyung Kim , Dongyoon Han , Hwanjun Song , Jung-Woo Ha , Jinwoo Shin

Semi-supervised video action recognition tends to enable deep neural networks to achieve remarkable performance even with very limited labeled data. However, existing methods are mainly transferred from current image-based methods (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Junfei Xiao , Longlong Jing , Lin Zhang , Ju He , Qi She , Zongwei Zhou , Alan Yuille , Yingwei Li

Video person re-identification attracts much attention in recent years. It aims to match image sequences of pedestrians from different camera views. Previous approaches usually improve this task from three aspects, including a) selecting…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Ruimao Zhang , Hongbin Sun , Jingyu Li , Yuying Ge , Liang Lin , Ping Luo , Xiaogang Wang

Traffic forecasting has emerged as a crucial research area in the development of smart cities. Although various neural networks with intricate architectures have been developed to address this problem, they still face two key challenges: i)…

Machine Learning · Computer Science 2024-08-27 Jianxiang Zhou , Erdong Liu , Wei Chen , Siru Zhong , Yuxuan Liang

Video anomaly detection has proved to be a challenging task owing to its unsupervised training procedure and high spatio-temporal complexity existing in real-world scenarios. In the absence of anomalous training samples, state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Masoud Pourreza , Mohammadreza Salehi , Mohammad Sabokrou

Existing methods of privacy-preserving action recognition (PPAR) mainly focus on frame-level (spatial) privacy removal through 2D CNNs. Unfortunately, they have two major drawbacks. First, they may compromise temporal dynamics in input…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Ming Li , Xiangyu Xu , Hehe Fan , Pan Zhou , Jun Liu , Jia-Wei Liu , Jiahe Li , Jussi Keppo , Mike Zheng Shou , Shuicheng Yan

Robust video scene classification models should capture the spatial (pixel-wise) and temporal (frame-wise) characteristics of a video effectively. Transformer models with self-attention which are designed to get contextualized…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Saurabh Sahu , Palash Goyal

Human Activity Recognition (HAR) has recently witnessed advancements with Transformer-based models. Especially, ActionFormer shows us a new perspectives for HAR in the sense that this approach gives us additional outputs which detect the…

Machine Learning · Computer Science 2025-05-28 Kunpeng Zhao , Asahi Miyazaki , Tsuyoshi Okita

This paper strives for spatio-temporal localization of human actions in videos. In the literature, the consensus is to achieve localization by training on bounding box annotations provided for each frame of each training video. As…

Computer Vision and Pattern Recognition · Computer Science 2018-10-02 Pascal Mettes , Cees G. M. Snoek

This paper addresses the task of segmenting class-agnostic objects in semi-supervised setting. Although previous detection based methods achieve relatively good performance, these approaches extract the best proposal by a greedy strategy,…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Daizong Liu , Shuangjie Xu , Xiao-Yang Liu , Zichuan Xu , Wei Wei , Pan Zhou