English
Related papers

Related papers: Recurrent Convolutions for Causal 3D CNNs

200 papers

We propose a novel scheme for human action recognition in videos, using a 3-dimensional Convolutional Neural Network (3D CNN) based classifier. Traditionally in deep learning based human activity recognition approaches, either a few random…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 S. H. Shabbeer Basha , Viswanath Pulabaigari , Snehasis Mukherjee

3D Convolutional Neural Network (3D CNN) captures spatial and temporal information on 3D data such as video sequences. However, due to the convolution and pooling mechanism, the information loss seems unavoidable. To improve the visual…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Novanto Yudistira , Muthu Subash Kavitha , Takio Kurita

We introduce a class of convolutional neural networks (CNNs) that utilize recurrent neural networks (RNNs) as convolution filters. A convolution filter is typically implemented as a linear affine transformation followed by a non-linear…

Computation and Language · Computer Science 2018-08-29 Yi Yang

Human action recognition has become an important research focus in computer vision due to the wide range of applications where it is used. 3D Resnet-based CNN models, particularly MC3, R3D, and R(2+1)D, have different convolutional filters…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Mohammad Rasras , Iuliana Marin , Serban Radu , Irina Mocanu

The dominant paradigm for video-based action segmentation is composed of two steps: first, for each frame, compute low-level features using Dense Trajectories or a Convolutional Neural Network that encode spatiotemporal information locally,…

Computer Vision and Pattern Recognition · Computer Science 2016-08-31 Colin Lea , Rene Vidal , Austin Reiter , Gregory D. Hager

Facial expressions are one of the most powerful ways for depicting specific patterns in human behavior and describing human emotional state. Despite the impressive advances of affective computing over the last decade, automatic video-based…

Computer Vision and Pattern Recognition · Computer Science 2021-01-18 Thomas Teixeira , Eric Granger , Alessandro Lameiras Koerich

In today's digital age, Convolutional Neural Networks (CNNs), a subset of Deep Learning (DL), are widely used for various computer vision tasks such as image classification, object detection, and image segmentation. There are numerous types…

Machine Learning · Computer Science 2024-02-29 Abolfazl Younesi , Mohsen Ansari , MohammadAmin Fazli , Alireza Ejlali , Muhammad Shafique , Jörg Henkel

Despite the success of deep learning for static image understanding, it remains unclear what are the most effective network architectures for the spatial-temporal modeling in videos. In this paper, in contrast to the existing CNN+RNN or…

Computer Vision and Pattern Recognition · Computer Science 2018-12-12 Dongliang He , Zhichao Zhou , Chuang Gan , Fu Li , Xiao Liu , Yandong Li , Limin Wang , Shilei Wen

Silent speech interfaces (SSI) aim to reconstruct the speech signal from a recording of the articulatory movement, such as an ultrasound video of the tongue. Currently, deep neural networks are the most successful technology for this task.…

Sound · Computer Science 2021-04-26 László Tóth , Amin Honarmandi Shandiz

Over the last decade, Convolutional Neural Network (CNN) models have been highly successful in solving complex vision problems. However, these deep models are perceived as "black box" methods considering the lack of understanding of their…

Computer Vision and Pattern Recognition · Computer Science 2018-11-13 Aditya Chattopadhyay , Anirban Sarkar , Prantik Howlader , Vineeth N Balasubramanian

Spatiotemporal representations learned using 3D convolutional neural networks (CNN) are currently used in state-of-the-art approaches for action related tasks. However, 3D-CNN are notorious for being memory and compute resource intensive as…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Paritosh Parmar , Brendan Morris

Convolutional neural network (CNN) is widely used in computer vision applications. In the networks that deal with images, CNNs are the most time-consuming layer of the networks. Usually, the solution to address the computation cost is to…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Meisam Rakhshanfar

In medical-data driven learning, 3D convolutional neural networks (CNNs) have started to show superior performance to 2D CNNs in numerous deep learning tasks, proving the added value of 3D spatial information in feature representation.…

Image and Video Processing · Electrical Eng. & Systems 2024-01-24 Xin Wang , Ruisheng Su , Weiyi Xie , Wenjin Wang , Yi Xu , Ritse Mann , Jungong Han , Tao Tan

Motivation: Recognizing human actions in a video is a challenging task which has applications in various fields. Previous works in this area have either used images from a 2D or 3D camera. Few have used the idea that human actions can be…

Computer Vision and Pattern Recognition · Computer Science 2016-12-21 Adhavan Jayabalan , Harish Karunakaran , Shravan Murlidharan , Tesia Shizume

The task of object segmentation in videos is usually accomplished by processing appearance and motion information separately using standard 2D convolutional networks, followed by a learned fusion of the two sources of information. On the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Sabarinath Mahadevan , Ali Athar , Aljoša Ošep , Sebastian Hennen , Laura Leal-Taixé , Bastian Leibe

This paper explores the capabilities of convolutional neural networks to deal with a task that is easily manageable for humans: perceiving 3D pose of a human body from varying angles. However, in our approach, we are restricted to using a…

Computer Vision and Pattern Recognition · Computer Science 2017-07-21 Agne Grinciunaite , Amogh Gudi , Emrah Tasli , Marten den Uyl

This thesis explore different approaches using Convolutional and Recurrent Neural Networks to classify and temporally localize activities on videos, furthermore an implementation to achieve it has been proposed. As the first step, features…

Computer Vision and Pattern Recognition · Computer Science 2017-03-06 Alberto Montes , Amaia Salvador , Santiago Pascual , Xavier Giro-i-Nieto

We present a simple and effective deep convolutional neural network (CNN) model for video deblurring. The proposed algorithm mainly consists of optical flow estimation from intermediate latent frames and latent frame restoration steps. It…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Jinshan Pan , Haoran Bai , Jinhui Tang

Action recognition is a fundamental problem in computer vision with a lot of potential applications such as video surveillance, human computer interaction, and robot learning. Given pre-segmented videos, the task is to recognize actions…

Computer Vision and Pattern Recognition · Computer Science 2017-06-28 Ahsan Iqbal , Alexander Richard , Hilde Kuehne , Juergen Gall

Reconstruction tasks in computer vision aim fundamentally to recover an undetermined signal from a set of noisy measurements. Examples include super-resolution, image denoising, and non-rigid structure from motion, all of which have seen…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Nathaniel Chodosh , Simon Lucey