English
Related papers

Related papers: Spatiotemporal Residual Networks for Video Action …

200 papers

Person re-identification aims at identifying a certain pedestrian across non-overlapping camera networks. Video-based re-identification approaches have gained significant attention recently, expanding image-based approaches by learning…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Jiawei Liu , Zheng-Jun Zha , Xierong Zhu , Na Jiang

We propose a methodology to extend the concept of Two-Stream Convolutional Networks to perform end-to-end learning for self-driving cars with temporal cues. The system has the ability to learn spatiotemporal features by simultaneously…

Machine Learning · Computer Science 2018-12-18 Nelson Fernandez

Spatio-Temporal graph convolutional networks were originally introduced with CNNs as temporal blocks for feature extraction. Since then LSTM temporal blocks have been proposed and shown to have promising results. We propose a novel…

Machine Learning · Computer Science 2025-01-22 Edward Turner

Effective extraction of temporal patterns is crucial for the recognition of temporally varying actions in video. We argue that the fixed-sized spatio-temporal convolution kernels used in convolutional neural networks (CNNs) can be improved…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Alexandros Stergiou , Ronald Poppe

Recent video recognition models utilize Transformer models for long-range spatio-temporal context modeling. Video transformer designs are based on self-attention that can model global context at a high computational cost. In comparison,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Syed Talal Wasim , Muhammad Uzair Khattak , Muzammal Naseer , Salman Khan , Mubarak Shah , Fahad Shahbaz Khan

The work in this paper is driven by the question if spatio-temporal correlations are enough for 3D convolutional neural networks (CNN)? Most of the traditional 3D networks use local spatio-temporal features. We introduce a new block that…

Computer Vision and Pattern Recognition · Computer Science 2019-02-08 Ali Diba , Mohsen Fayyaz , Vivek Sharma , M. Mahdi Arzani , Rahman Yousefzadeh , Juergen Gall , Luc Van Gool

Spatial-wise dynamic convolution has become a promising approach to improving the inference efficiency of deep networks. By allocating more computation to the most informative pixels, such an adaptive inference paradigm reduces the spatial…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Yizeng Han , Zhihang Yuan , Yifan Pu , Chenhao Xue , Shiji Song , Guangyu Sun , Gao Huang

In this paper, we address the challenging problem of spatial and temporal action detection in videos. We first develop an effective approach to localize frame-level action regions through integrating static and kinematic information by the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Yuancheng Ye , Xiaodong Yang , Yingli Tian

ResNets and its variants play an important role in various fields of image recognition. This paper gives another variant of ResNets, a kind of cross-residual learning networks called C-ResNets, which has less computation and parameters than…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Jun Liang , Songsen Yu , Huan Yang

Various powerful deep neural network architectures have made great contribution to the exciting successes of deep learning in the past two decades. Among them, deep Residual Networks (ResNets) are of particular importance because they…

Machine Learning · Computer Science 2022-05-16 Wentao Huang , Haizhang Zhang

Residual connections remain ubiquitous in modern neural network architectures nearly a decade after their introduction. Their widespread adoption is often credited to their dramatically improved trainability: residual networks train faster,…

Machine Learning · Computer Science 2025-06-18 Christian H. X. Ali Mehmeti-Göpel , Michael Wand

Learning the spatial-temporal representation of motion information is crucial to human action recognition. Nevertheless, most of the existing features or descriptors cannot capture motion information effectively, especially for long-term…

Computer Vision and Pattern Recognition · Computer Science 2017-02-13 Yemin Shi , Yonghong Tian , Yaowei Wang , Tiejun Huang

Deep residual learning (ResNet) is a new method for training very deep neural networks using identity map-ping for shortcut connections. ResNet has won the ImageNet ILSVRC 2015 classification task, and achieved state-of-the-art performances…

Computation and Language · Computer Science 2017-07-28 Yi Yao Huang , William Yang Wang

The work in this paper is driven by the question how to exploit the temporal cues available in videos for their accurate classification, and for human action recognition in particular? Thus far, the vision community has focused on…

Computer Vision and Pattern Recognition · Computer Science 2017-11-23 Ali Diba , Mohsen Fayyaz , Vivek Sharma , Amir Hossein Karami , Mohammad Mahdi Arzani , Rahman Yousefzadeh , Luc Van Gool

After the incredible success of deep learning in the computer vision domain, there has been much interest in applying Convolutional Network (ConvNet) features in robotic fields such as visual navigation and SLAM. Unfortunately, there are…

Robotics · Computer Science 2015-07-30 Niko Sünderhauf , Feras Dayoub , Sareh Shirazi , Ben Upcroft , Michael Milford

Recognizing human actions in video sequences, known as Human Action Recognition (HAR), is a challenging task in pattern recognition. While Convolutional Neural Networks (ConvNets) have shown remarkable success in image recognition, they are…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Nguyen Huu Phong , Bernardete Ribeiro

A collection of approaches based on graph convolutional networks have proven success in skeleton-based action recognition by exploring neighborhood information and dense dependencies between intra-frame joints. However, these approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Jialin Gao , Tong He , Xi Zhou , Shiming Ge

While depth cameras and inertial sensors have been frequently leveraged for human action recognition, these sensing modalities are impractical in many scenarios where cost or environmental constraints prohibit their use. As such, there has…

Computer Vision and Pattern Recognition · Computer Science 2019-02-27 William McNally , Alexander Wong , John McPhee

In this paper, we propose Two-Stream AMTnet, which leverages recent advances in video-based action representation[1] and incremental action tube generation[2]. Majority of the present action detectors follow a frame-based representation, a…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Suman Saha , Gurkirt Singh , Fabio Cuzzolin

Semantic image segmentation is an essential component of modern autonomous driving systems, as an accurate understanding of the surrounding scene is crucial to navigation and action planning. Current state-of-the-art approaches in semantic…

Computer Vision and Pattern Recognition · Computer Science 2016-12-07 Tobias Pohlen , Alexander Hermans , Markus Mathias , Bastian Leibe