English
Related papers

Related papers: SPARTAN: Self-supervised Spatiotemporal Transforme…

200 papers

Dynamic scene graph generation aims at generating a scene graph of the given video. Compared to the task of scene graph generation from images, it is more challenging because of the dynamic relationships between objects and the temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Yuren Cong , Wentong Liao , Hanno Ackermann , Bodo Rosenhahn , Michael Ying Yang

Group Activity Understanding is predominantly studied as Group Activity Recognition (GAR) task. However, existing GAR benchmarks suffer from coarse-grained activity vocabularies and the only data form in single-view, which hinder the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yuchen Yang , Wei Wang , Yifei Liu , Linfeng Dong , Hao Wu , Mingxin Zhang , Zhihang Zhong , Xiao Sun

Self-supervised video representation learning aimed at maximizing similarity between different temporal segments of one video, in order to enforce feature persistence over time. This leads to loss of pertinent information related to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Di Yang , Yaohui Wang , Quan Kong , Antitza Dantcheva , Lorenzo Garattoni , Gianpiero Francesca , Francois Bremond

This paper studies how to introduce viewpoint-invariant feature representations that can help action recognition and detection. Although we have witnessed great progress of action recognition in the past decade, it remains challenging yet…

Computer Vision and Pattern Recognition · Computer Science 2020-12-07 Junwei Liang , Liangliang Cao , Xuehan Xiong , Ting Yu , Alexander Hauptmann

Existing methods of privacy-preserving action recognition (PPAR) mainly focus on frame-level (spatial) privacy removal through 2D CNNs. Unfortunately, they have two major drawbacks. First, they may compromise temporal dynamics in input…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Ming Li , Xiangyu Xu , Hehe Fan , Pan Zhou , Jun Liu , Jia-Wei Liu , Jiahe Li , Jussi Keppo , Mike Zheng Shou , Shuicheng Yan

Self-attention has been successfully applied to video representation learning due to the effectiveness of modeling long range dependencies. Existing approaches build the dependencies merely by computing the pairwise correlations along…

Computer Vision and Pattern Recognition · Computer Science 2021-05-28 Xudong Guo , Xun Guo , Yan Lu

Point-supervised Temporal Action Localization (PTAL) adopts a lightly frame-annotated paradigm (\textit{i.e.}, labeling only a single frame per action instance) to train a model to effectively locate action instances within untrimmed…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Yunchuan Ma , Laiyun Qing , Guorong Li , Yuqing Liu , Yuankai Qi , Qingming Huang

We address the problem of video representation learning without human-annotated labels. While previous efforts address the problem by designing novel self-supervised tasks using video data, the learned features are merely on a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Jiangliu Wang , Jianbo Jiao , Linchao Bao , Shengfeng He , Yunhui Liu , Wei Liu

Multi-view action recognition aims to recognize human actions using multiple camera views and deals with occlusion caused by obstacles or crowds. In this task, cooperation among views, which generates a joint representation by combining…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Taiga Yamane , Satoshi Suzuki , Ryo Masumura , Shotaro Tora

Self-supervised learning presents a remarkable performance to utilize unlabeled data for various video tasks. In this paper, we focus on applying the power of self-supervised methods to improve semi-supervised action proposal generation.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Xiang Wang , Shiwei Zhang , Zhiwu Qing , Yuanjie Shao , Changxin Gao , Nong Sang

Group Activity Recognition (GAR) is a fundamental problem in computer vision, with diverse applications in sports video analysis, video surveillance, and social scene understanding. Unlike conventional action recognition, GAR aims to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Naga VS Raviteja Chappa , Pha Nguyen , Page Daniel Dobbs , Khoa Luu

Recognition of human actions and associated interactions with objects and the environment is an important problem in computer vision due to its potential applications in a variety of domains. The most versatile methods can generalize to…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Behnoosh Parsa , Athma Narayanan , Behzad Dariush

Human activity recognition (HAR) with wearables is one of the serviceable technologies in ubiquitous and mobile computing applications. The sliding-window scheme is widely adopted while suffering from the multi-class windows problem. As a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Songpengcheng Xia , Lei Chu , Ling Pei , Jiarui Yang , Wenxian Yu , Robert C. Qiu

Human action recognition (HAR) in videos is a fundamental research topic in computer vision. It consists mainly in understanding actions performed by humans based on a sequence of visual observations. In recent years, HAR have witnessed…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Soufiane Lamghari , Guillaume-Alexandre Bilodeau , Nicolas Saunier

This paper strives to recognize individual actions and group activities from videos. While existing solutions for this challenging problem explicitly model spatial and temporal relationships based on location of individual actors, we…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Kirill Gavrilyuk , Ryan Sanford , Mehrsan Javan , Cees G. M. Snoek

We propose a novel semi-supervised, Multi-Level Sequential Generative Adversarial Network (MLS-GAN) architecture for group activity recognition. In contrast to previous works which utilise manually annotated individual human action…

Computer Vision and Pattern Recognition · Computer Science 2018-12-19 Harshala Gammulle , Simon Denman , Sridha Sridharan , Clinton Fookes

Learning descriptive spatio-temporal object models from data is paramount for the task of semi-supervised video object segmentation. Most existing approaches mainly rely on models that estimate the segmentation mask based on a reference…

Computer Vision and Pattern Recognition · Computer Science 2019-03-29 Sergi Caelles , Albert Pumarola , Francesc Moreno-Noguer , Alberto Sanfeliu , Luc Van Gool

We present COMEDIAN, a novel pipeline to initialize spatiotemporal transformers for action spotting, which involves self-supervised learning and knowledge distillation. Action spotting is a timestamp-level temporal action detection task.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Julien Denize , Mykola Liashuha , Jaonary Rabarisoa , Astrid Orcesi , Romain Hérault

This study introduces an enhanced approach to video super-resolution by extending ordinary Single-Image Super-Resolution (SISR) Super-Resolution Generative Adversarial Network (SRGAN) structure to handle spatio-temporal data. While SRGAN…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Kağan Çetin , Hacer Akça , Ömer Nezih Gerek

Skeleton-based action recognition, which classifies human actions based on the coordinates of joints and their connectivity within skeleton data, is widely utilized in various scenarios. While Graph Convolutional Networks (GCNs) have been…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Jeonghyeok Do , Munchurl Kim