English
Related papers

Related papers: Spatio-Temporal Fusion Networks for Action Recogni…

200 papers

Temporal reasoning is an important aspect of video analysis. 3D CNN shows good performance by exploring spatial-temporal features jointly in an unconstrained way, but it also increases the computational cost a lot. Previous works try to…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Chenxu Luo , Alan Yuille

Recent video recognition models utilize Transformer models for long-range spatio-temporal context modeling. Video transformer designs are based on self-attention that can model global context at a high computational cost. In comparison,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Syed Talal Wasim , Muhammad Uzair Khattak , Muzammal Naseer , Salman Khan , Mubarak Shah , Fahad Shahbaz Khan

Detecting breast lesion in videos is crucial for computer-aided diagnosis. Existing video-based breast lesion detection approaches typically perform temporal feature aggregation of deep backbone features based on the self-attention…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Chao Qin , Jiale Cao , Huazhu Fu , Rao Muhammad Anwer , Fahad Shahbaz Khan

Video-based behavior recognition is essential in fields such as public safety, intelligent surveillance, and human-computer interaction. Traditional 3D Convolutional Neural Network (3D CNN) effectively capture local spatiotemporal features…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Xiuliang Zhang , Tadiwa Elisha Nyamasvisva , Chuntao Liu

Many road accidents occur due to distracted drivers. Today, driver monitoring is essential even for the latest autonomous vehicles to alert distracted drivers in order to take over control of the vehicle in case of emergency. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2019-07-19 Neslihan Kose , Okan Kopuklu , Alexander Unnervik , Gerhard Rigoll

State-of-the-art methods for video action recognition commonly use an ensemble of two networks: the spatial stream, which takes RGB frames as input, and the temporal stream, which takes optical flow as input. In recent work, both of these…

Computer Vision and Pattern Recognition · Computer Science 2019-02-07 Jonathan C. Stroud , David A. Ross , Chen Sun , Jia Deng , Rahul Sukthankar

Conventional 3D convolutional neural networks (CNNs) are computationally expensive, memory intensive, prone to overfitting, and most importantly, there is a need to improve their feature learning capabilities. To address these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2021-05-05 Sudhakar Kumawat , Manisha Verma , Yuta Nakashima , Shanmuganathan Raman

Explosive growth in spatio-temporal data and its wide range of applications have attracted increasing interests of researchers in the statistical and machine learning fields. The spatio-temporal regression problem is of paramount importance…

Machine Learning · Computer Science 2020-09-15 Aniruddha Rajendra Rao , Qiyao Wang , Haiyan Wang , Hamed Khorasgani , Chetan Gupta

In recent years, a number of approaches based on 2D or 3D convolutional neural networks (CNN) have emerged for video action recognition, achieving state-of-the-art results on several large-scale benchmark datasets. In this paper, we carry…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Chun-Fu Chen , Rameswar Panda , Kandan Ramakrishnan , Rogerio Feris , John Cohn , Aude Oliva , Quanfu Fan

Convolutional Neural Networks (CNN) have been regarded as a powerful class of models for visual recognition problems. Nevertheless, the convolutional filters in these networks are local operations while ignoring the large-range dependency.…

Computer Vision and Pattern Recognition · Computer Science 2019-06-14 Zhaofan Qiu , Ting Yao , Chong-Wah Ngo , Xinmei Tian , Tao Mei

Dynamic scene graph generation aims at generating a scene graph of the given video. Compared to the task of scene graph generation from images, it is more challenging because of the dynamic relationships between objects and the temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Yuren Cong , Wentong Liao , Hanno Ackermann , Bodo Rosenhahn , Michael Ying Yang

Early detection of anxiety is crucial for reducing the suffering of individuals with mental disorders and improving treatment outcomes. Utilizing an mHealth platform for anxiety screening can be particularly practical in improving screening…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Haimiao Mo , Yuchen Li , Shanlin Yang , Wei Zhang , Shuai Ding

In videos, the human's actions are of three-dimensional (3D) signals. These videos investigate the spatiotemporal knowledge of human behavior. The promising ability is investigated using 3D convolution neural networks (CNNs). The 3D CNNs…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Arslan Syed , Eman A. Aldhahri , Muhammad Munawar Iqbal , Abid Ali , Ammar Muthanna , Harun Jamil , Faisal Jamil

Skeleton-based action recognition has attracted considerable attention due to its compact representation of the human body's skeletal sructure. Many recent methods have achieved remarkable performance using graph convolutional networks…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Jungho Lee , Minhyeok Lee , Suhwan Cho , Sungmin Woo , Sungjun Jang , Sangyoun Lee

Video analysis is a major computer vision task that has received a lot of attention in recent years. The current state-of-the-art performance for video analysis is achieved with Deep Neural Networks (DNNs) that have high computational costs…

Computer Vision and Pattern Recognition · Computer Science 2023-09-25 Mireille El-Assal , Pierre Tirilly , Ioan Marius Bilasco

Efficiency is an important issue in designing video architectures for action recognition. 3D CNNs have witnessed remarkable progress in action recognition from videos. However, compared with their 2D counterparts, 3D convolutions often…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Zhaoyang Liu , Donghao Luo , Yabiao Wang , Limin Wang , Ying Tai , Chengjie Wang , Jilin Li , Feiyue Huang , Tong Lu

We present a 3D Convolutional Neural Networks (CNNs) based single shot detector for spatial-temporal action detection tasks. Our model includes: (1) two short-term appearance and motion streams, with single RGB and optical flow image input…

Computer Vision and Pattern Recognition · Computer Science 2019-08-23 Pengfei Zhang , Yu Cao , Benyuan Liu

Most existing Convolutional Neural Networks(CNNs) used for action recognition are either difficult to optimize or underuse crucial temporal information. Inspired by the fact that the recurrent model consistently makes breakthroughs in the…

Computer Vision and Pattern Recognition · Computer Science 2018-01-04 Zhenxing Zheng , Gaoyun An , Qiuqi Ruan

The proliferation of generative video models has made detecting AI-generated and manipulated videos an urgent challenge. Existing detection approaches often fail to generalize across diverse manipulation types due to their reliance on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Haoyu Liu , Chaoyu Gong , Mengke He , Jiate Li , Kai Han , Siqiang Luo

Biological spiking neurons with intrinsic dynamics underlie the powerful representation and learning capabilities of the brain for processing multimodal information in complex environments. Despite recent tremendous progress in spiking…

Neural and Evolutionary Computing · Computer Science 2021-07-15 Mingkun Xu , Yujie Wu , Lei Deng , Faqiang Liu , Guoqi Li , Jing Pei