English
Related papers

Related papers: Spatiotemporal Fusion in 3D CNNs: A Probabilistic …

200 papers

3D convolution neural networks (CNNs) have been the prevailing option for video recognition. To capture the temporal information, 3D convolutions are computed along the sequences, leading to cubically growing and expensive computations. To…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Junyan Wang , Zhenhong Sun , Yichen Qian , Dong Gong , Xiuyu Sun , Ming Lin , Maurice Pagnucco , Yang Song

Explosive growth in spatio-temporal data and its wide range of applications have attracted increasing interests of researchers in the statistical and machine learning fields. The spatio-temporal regression problem is of paramount importance…

Machine Learning · Computer Science 2020-09-15 Aniruddha Rajendra Rao , Qiyao Wang , Haiyan Wang , Hamed Khorasgani , Chetan Gupta

Neural Processes combine the strengths of neural networks and Gaussian processes to achieve both flexible learning and fast prediction in stochastic processes. However, a large class of problems comprises underlying temporal dependency…

Machine Learning · Computer Science 2019-10-29 Gautam Singh , Jaesik Yoon , Youngsung Son , Sungjin Ahn

Spatial-temporal data forecasting of traffic flow is a challenging task because of complicated spatial dependencies and dynamical trends of temporal pattern between different roads. Existing frameworks typically utilize given spatial…

Machine Learning · Computer Science 2021-03-09 Mengzhang Li , Zhanxing Zhu

Learning the dynamics of spatiotemporal events is a fundamental problem. Neural point processes enhance the expressivity of point process models with deep neural networks. However, most existing methods only consider temporal dynamics…

Machine Learning · Computer Science 2024-12-10 Zihao Zhou , Xingyi Yang , Ryan Rossi , Handong Zhao , Rose Yu

We propose a novel scheme for human action recognition in videos, using a 3-dimensional Convolutional Neural Network (3D CNN) based classifier. Traditionally in deep learning based human activity recognition approaches, either a few random…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 S. H. Shabbeer Basha , Viswanath Pulabaigari , Snehasis Mukherjee

Recently, the recognition task of spontaneous facial micro-expressions has attracted much attention with its various real-world applications. Plenty of handcrafted or learned features have been employed for a variety of classifiers and…

Computer Vision and Pattern Recognition · Computer Science 2019-01-16 Zhaoqiang Xia , Xiaopeng Hong , Xingyu Gao , Xiaoyi Feng , Guoying Zhao

The purpose of this study is to determine whether current video datasets have sufficient data for training very deep convolutional neural networks (CNNs) with spatio-temporal three-dimensional (3D) kernels. Recently, the performance levels…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Kensho Hara , Hirokatsu Kataoka , Yutaka Satoh

Convolutional Neural Networks (CNN) possess many positive qualities when it comes to spatial raster data. Translation invariance enables CNNs to detect features regardless of their position in the scene. However, in some domains, like…

Machine Learning · Computer Science 2020-07-13 Arnas Uselis , Mantas Lukoševičius , Lukas Stasytis

Video-based behavior recognition is essential in fields such as public safety, intelligent surveillance, and human-computer interaction. Traditional 3D Convolutional Neural Network (3D CNN) effectively capture local spatiotemporal features…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Xiuliang Zhang , Tadiwa Elisha Nyamasvisva , Chuntao Liu

The modeling, computational cost, and accuracy of traditional Spatio-temporal networks are the three most concentrated research topics in video action recognition. The traditional 2D convolution has a low computational cost, but it cannot…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Zhaoqilin Yang , Gaoyun An

In this report, our approach to tackling the task of ActivityNet 2018 Kinetics-600 challenge is described in detail. Though spatial-temporal modelling methods, which adopt either such end-to-end framework as I3D \cite{i3d} or two-stage…

Computer Vision and Pattern Recognition · Computer Science 2018-06-28 Dongliang He , Fu Li , Qijie Zhao , Xiang Long , Yi Fu , Shilei Wen

Many methods for learning from video sequences involve temporally processing 2D CNN features from the individual frames or directly utilizing 3D convolutions within high-performing 2D CNN architectures. The focus typically remains on how to…

Computer Vision and Pattern Recognition · Computer Science 2020-09-17 Logan Courtney , Ramavarapu Sreenivas

3D convolutional neural networks have achieved promising results for video tasks in computer vision, including video saliency prediction that is explored in this paper. However, 3D convolution encodes visual representation merely on fixed…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Ziqiang Wang , Zhi Liu , Gongyang Li , Yang Wang , Tianhong Zhang , Lihua Xu , Jijun Wang

Recently, convolutional neural networks (CNN) have been successfully applied to many remote sensing problems. However, deep learning techniques for multi-image super-resolution from multitemporal unregistered imagery have received little…

Image and Video Processing · Electrical Eng. & Systems 2020-01-16 Andrea Bordone Molini , Diego Valsesia , Giulia Fracastoro , Enrico Magli

How can we collect and use a video dataset to further improve spatiotemporal 3D Convolutional Neural Networks (3D CNNs)? In order to positively answer this open question in video recognition, we have conducted an exploration study using a…

Computer Vision and Pattern Recognition · Computer Science 2020-04-13 Hirokatsu Kataoka , Tenga Wakamiya , Kensho Hara , Yutaka Satoh

Classification of EEG signals using shallow Convolutional Neural Networks (CNNs) is a prevalent and successful approach across a variety of fields. Most of these models use independent one-dimensional (1D) convolutional layers along the…

Machine Learning · Computer Science 2026-05-06 Laurits Dixen , Stefan Heinrich , Paolo Burelli

Action recognition with 3D skeleton sequences is becoming popular due to its speed and robustness. The recently proposed Convolutional Neural Networks (CNN) based methods have shown good performance in learning spatio-temporal…

Computer Vision and Pattern Recognition · Computer Science 2018-04-12 Zhengyuan Yang , Yuncheng Li , Jianchao Yang , Jiebo Luo

In medical-data driven learning, 3D convolutional neural networks (CNNs) have started to show superior performance to 2D CNNs in numerous deep learning tasks, proving the added value of 3D spatial information in feature representation.…

Image and Video Processing · Electrical Eng. & Systems 2024-01-24 Xin Wang , Ruisheng Su , Weiyi Xie , Wenjin Wang , Yi Xu , Ritse Mann , Jungong Han , Tao Tan

Spiking Neural Networks (SNNs), as one of the algorithmic models in neuromorphic computing, have gained a great deal of research attention owing to temporal information processing capability, low power consumption, and high biological…

Neural and Evolutionary Computing · Computer Science 2023-06-07 Chengting Yu , Zheming Gu , Da Li , Gaoang Wang , Aili Wang , Erping Li