中文
相关论文

相关论文: A Closer Look at Spatiotemporal Convolutions for A…

200 篇论文

We investigate video classification via a two-stream convolutional neural network (CNN) design that directly ingests information extracted from compressed video bitstreams. Our approach begins with the observation that all modern video…

计算机视觉与模式识别 · 计算机科学 2017-12-21 Aaron Chadha , Alhabib Abbas , Yiannis Andreopoulos

For action recognition learning, 2D CNN-based methods are efficient but may yield redundant features due to applying the same 2D convolution kernel to each frame. Recent efforts attempt to capture motion information by establishing…

计算机视觉与模式识别 · 计算机科学 2021-03-24 Mingyu Wu , Boyuan Jiang , Donghao Luo , Junchi Yan , Yabiao Wang , Ying Tai , Chengjie Wang , Jilin Li , Feiyue Huang , Xiaokang Yang

Dynamic imaging is a recently proposed action description paradigm for simultaneously capturing motion and temporal evolution information, particularly in the context of deep convolutional neural networks (CNNs). Compared with optical flow…

计算机视觉与模式识别 · 计算机科学 2018-12-31 Yang Xiao , Jun Chen , Yancheng Wang , Zhiguo Cao , Joey Tianyi Zhou , Xiang Bai

Convolutional operations have two limitations: (1) do not explicitly model where to focus as the same filter is applied to all the positions, and (2) are unsuitable for modeling long-range dependencies as they only operate on a small…

计算机视觉与模式识别 · 计算机科学 2020-08-03 Xiaofang Wang , Xuehan Xiong , Maxim Neumann , AJ Piergiovanni , Michael S. Ryoo , Anelia Angelova , Kris M. Kitani , Wei Hua

Most action recognition methods base on a) a late aggregation of frame level CNN features using average pooling, max pooling, or RNN, among others, or b) spatio-temporal aggregation via 3D convolutions. The first assume independence among…

计算机视觉与模式识别 · 计算机科学 2019-05-30 Swathikiran Sudhakaran , Sergio Escalera , Oswald Lanz

This paper provides a review on representation learning for videos. We classify recent spatiotemporal feature learning methods for sequential visual data and compare their pros and cons for general video analysis. Building effective…

计算机视觉与模式识别 · 计算机科学 2024-05-13 Elham Ravanbakhsh , Yongqing Liang , J. Ramanujam , Xin Li

The video and action classification have extremely evolved by deep neural networks specially with two stream CNN using RGB and optical flow as inputs and they present outstanding performance in terms of video analysis. One of the…

计算机视觉与模式识别 · 计算机科学 2016-09-05 Ali Diba , Ali Mohammad Pazandeh , Luc Van Gool

We address the problem of action detection in videos. Driven by the latest progress in object detection from 2D images, we build action models using rich feature hierarchies derived from shape and kinematic cues. We incorporate appearance…

计算机视觉与模式识别 · 计算机科学 2014-11-25 Georgia Gkioxari , Jitendra Malik

Understanding actions and gestures in video streams requires temporal reasoning of the spatial content from different time instants, i.e., spatiotemporal (ST) modeling. In this survey paper, we have made a comparative analysis of different…

计算机视觉与模式识别 · 计算机科学 2021-01-12 Okan Köpüklü , Fabian Herzog , Gerhard Rigoll

Spatiotemporal representations learned using 3D convolutional neural networks (CNN) are currently used in state-of-the-art approaches for action related tasks. However, 3D-CNN are notorious for being memory and compute resource intensive as…

计算机视觉与模式识别 · 计算机科学 2020-10-22 Paritosh Parmar , Brendan Morris

The Transformer architecture has gained significant popularity in computer vision tasks due to its capacity to generalize and capture long-range dependencies. This characteristic makes it well-suited for generating spatiotemporal tokens…

计算机视觉与模式识别 · 计算机科学 2023-10-24 Rachid Reda Dokkar , Faten Chaieb , Hassen Drira , Arezki Aberkane

Effective and Efficient spatio-temporal modeling is essential for action recognition. Existing methods suffer from the trade-off between model performance and model complexity. In this paper, we present a novel Spatio-Temporal Hybrid…

计算机视觉与模式识别 · 计算机科学 2020-03-19 Xu Li , Jingwen Wang , Lin Ma , Kaihao Zhang , Fengzong Lian , Zhanhui Kang , Jinjun Wang

The recognition of actions from video sequences has many applications in health monitoring, assisted living, surveillance, and smart homes. Despite advances in sensing, in particular related to 3D video, the methodologies to process the…

计算机视觉与模式识别 · 计算机科学 2018-10-03 Rui Zhao , Haider Ali , Patrick van der Smagt

Human activity recognition is one of the most important tasks in computer vision and has proved useful in different fields such as healthcare, sports training and security. There are a number of approaches that have been explored to solve…

计算机视觉与模式识别 · 计算机科学 2023-05-01 Sheryl Mathew , Annapoorani Subramanian , Pooja , Balamurugan MS , Manoj Kumar Rajagopal

This paper presents a new framework for human action recognition from a 3D skeleton sequence. Previous studies do not fully utilize the temporal relationships between video segments in a human action. Some studies successfully used very…

计算机视觉与模式识别 · 计算机科学 2018-08-21 Thao Minh Le , Nakamasa Inoue , Koichi Shinoda

Recently, video-based action recognition methods using convolutional neural networks (CNNs) achieve remarkable recognition performance. However, there is still lack of understanding about the generalization mechanism of action recognition…

计算机视觉与模式识别 · 计算机科学 2023-12-08 Jaehui Hwang , Huan Zhang , Jun-Ho Choi , Cho-Jui Hsieh , Jong-Seok Lee

In this paper, we address the challenging problem of action recognition, using event-based cameras. To recognise most gestural actions, often higher temporal precision is required for sampling visual information. Actions are defined by…

计算机视觉与模式识别 · 计算机科学 2019-03-19 Rohan Ghosh , Anupam Gupta , Andrei Nakagawa , Alcimar Soares , Nitish Thakor

Most of human actions consist of complex temporal compositions of more simple actions. Action recognition tasks usually relies on complex handcrafted structures as features to represent the human action model. Convolutional Neural Nets…

计算机视觉与模式识别 · 计算机科学 2015-12-15 Mahdyar Ravanbakhsh , Hossein Mousavi , Mohammad Rastegari , Vittorio Murino , Larry S. Davis

In this work, we introduce a new video representation for action classification that aggregates local convolutional features across the entire spatio-temporal extent of the video. We do so by integrating state-of-the-art two-stream networks…

计算机视觉与模式识别 · 计算机科学 2017-04-11 Rohit Girdhar , Deva Ramanan , Abhinav Gupta , Josef Sivic , Bryan Russell

Spatio-temporal representations in frame sequences play an important role in the task of action recognition. Previously, a method of using optical flow as a temporal information in combination with a set of RGB images that contain spatial…

计算机视觉与模式识别 · 计算机科学 2018-08-02 Myunggi Lee , Seungeui Lee , Sungjoon Son , Gyutae Park , Nojun Kwak