English
Related papers

Related papers: Actor-Transformers for Group Activity Recognition

200 papers

This paper proposes a novel multi-modal transformer network for detecting actions in untrimmed videos. To enrich the action features, our transformer network utilizes a new multi-modal attention mechanism that computes the correlations…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Matthew Korban , Scott T. Acton , Peter Youngs

In this paper we discuss several forms of spatiotemporal convolutions for video analysis and study their effects on action recognition. Our motivation stems from the observation that 2D CNNs applied to individual frames of the video have…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Du Tran , Heng Wang , Lorenzo Torresani , Jamie Ray , Yann LeCun , Manohar Paluri

Localizing persons and recognizing their actions from videos is a challenging task towards high-level video understanding. Recent advances have been achieved by modeling direct pairwise relations between entities. In this paper, we take one…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Junting Pan , Siyu Chen , Mike Zheng Shou , Yu Liu , Jing Shao , Hongsheng Li

Action recognition is a critical task for social robots to meaningfully engage with their environment. 3D human skeleton-based action recognition is an attractive research area in recent years. Although, the existing approaches are good at…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Hui Feng , Shanshan Wang , Shuzhi Sam Ge

Motion is a salient cue to recognize actions in video. Modern action recognition models leverage motion information either explicitly by using optical flow as input or implicitly by means of 3D convolutional filters that simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Heng Wang , Du Tran , Lorenzo Torresani , Matt Feiszli

Action recognition, which is formulated as a task to identify various human actions in a video, has attracted increasing interest from computer vision researchers due to its importance in various applications. Recently, appearance-based…

Computer Vision and Pattern Recognition · Computer Science 2020-11-26 Jack Humphreys , Zhe Chen , Dacheng Tao

This work addresses the problem of Social Activity Recognition (SAR), a critical component in real-world tasks like surveillance and assistive robotics. Unlike traditional event understanding approaches, SAR necessitates modeling individual…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Shubham Trehan , Sathyanarayanan N. Aakur

Online action recognition is an important task for human centered intelligent services, which is still difficult to achieve due to the varieties and uncertainties of spatial and temporal scales of human actions. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2020-11-04 Guoliang Liu , Qinghui Zhang , Yichao Cao , Junwei Li , Hao Wu , Guohui Tian

Human activity recognition is an emerging and important area in computer vision which seeks to determine the activity an individual or group of individuals are performing. The applications of this field ranges from generating highlight…

Computer Vision and Pattern Recognition · Computer Science 2022-08-26 James Wensel , Hayat Ullah , Arslan Munir

Action Detection is a complex task that aims to detect and classify human actions in video clips. Typically, it has been addressed by processing fine-grained features extracted from a video classification backbone. Recently, thanks to the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Matteo Tomei , Lorenzo Baraldi , Simone Calderara , Simone Bronzin , Rita Cucchiara

Rather than simply recognizing the action of a person individually, collective activity recognition aims to find out what a group of people is acting in a collective scene. Previ- ous state-of-the-art methods using hand-crafted potentials…

Computer Vision and Pattern Recognition · Computer Science 2017-09-21 Yongyi Tang , Peizhen Zhang , Jian-Fang Hu , Wei-Shi Zheng

As a fundamental aspect of human life, two-person interactions contain meaningful information about people's activities, relationships, and social settings. Human action recognition serves as the foundation for many smart applications, with…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Yao Liu , Gangfeng Cui , Jiahui Luo , Xiaojun Chang , Lina Yao

Human activity, which usually consists of several actions, generally covers interactions among persons and or objects. In particular, human actions involve certain spatial and temporal relationships, are the components of more complicated…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Zhenyu Liu , Yaqiang Yao , Yan Liu , Yuening Zhu , Zhenchao Tao , Lei Wang , Yuhong Feng

We propose an approach for forecasting video of complex human activity involving multiple people. Direct pixel-level prediction is too simple to handle the appearance variability in complex activities. Hence, we develop novel intermediate…

Computer Vision and Pattern Recognition · Computer Science 2017-12-07 Mengyao Zhai , Jiacheng Chen , Ruizhi Deng , Lei Chen , Ligeng Zhu , Greg Mori

Video action recognition, a critical problem in video understanding, has been gaining increasing attention. To identify actions induced by complex object-object interactions, we need to consider not only spatial relations among objects in a…

Computer Vision and Pattern Recognition · Computer Science 2019-05-08 Hao Huang , Luowei Zhou , Wei Zhang , Jason J. Corso , Chenliang Xu

Temporal convolutions have been the paradigm of choice in action segmentation, which enhances long-term receptive fields by increasing convolution layers. However, high layers cause the loss of local information necessary for frame…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Jiahui Wang , Zhenyou Wang , Shanna Zhuang , Hui Wang

The aim of this research is to recognize human actions performed on stage to aid visually impaired and blind individuals. To achieve this, we have created a theatre human action recognition system that uses skeleton data captured by depth…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Leyla Benhamida , Slimane Larabi

Deep neural networks based purely on attention have been successful across several domains, relying on minimal architectural priors from the designer. In Human Action Recognition (HAR), attention mechanisms have been primarily adopted on…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Vittorio Mazzia , Simone Angarano , Francesco Salvetti , Federico Angelini , Marcello Chiaberge

Recent advances in deep learning have enabled the generation of videos from textual descriptions as well as the prediction of future sequences from input videos. Similarly, in human motion modeling, motions can be generated from text or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Masato Soga , Ryuki Takebayashi

Anticipating human actions in front of autonomous vehicles is a challenging task. Several papers have recently proposed model architectures to address this problem by combining multiple input features to predict pedestrian crossing actions.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Lina Achaji , Julien Moreau , François Aioun , François Charpillet