English
Related papers

Related papers: Learning Efficient Video Representation with Video…

200 papers

This paper addresses fast semantic segmentation on video.Video segmentation often calls for real-time, or even fasterthan real-time, processing. One common recipe for conserving computation arising from feature extraction is to propagate…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Shih-Po Lee , Si-Cun Chen , Wen-Hsiao Peng

This paper presents a deep learning framework for medical video segmentation. Convolution neural network (CNN) and transformer-based methods have achieved great milestones in medical image segmentation tasks due to their incredible semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Chengxi Zeng , Xinyu Yang , David Smithard , Majid Mirmehdi , Alberto M Gambaruto , Tilo Burghardt

The recent success in deep learning has lead to various effective representation learning methods for videos. However, the current approaches for video representation require large amount of human labeled datasets for effective learning. We…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Shruti Vyas , Yogesh S Rawat , Mubarak Shah

We present a new method for finding video CNN architectures that capture rich spatio-temporal information in videos. Previous work, taking advantage of 3D convolutions, obtained promising results by manually designing video CNN…

Computer Vision and Pattern Recognition · Computer Science 2019-08-22 AJ Piergiovanni , Anelia Angelova , Alexander Toshev , Michael S. Ryoo

We address the problem of capturing temporal information for video classification in 2D networks, without increasing their computational cost. Existing approaches focus on modifying the architecture of 2D networks (e.g. by including filters…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Kiyoon Kim , Shreyank N Gowda , Oisin Mac Aodha , Laura Sevilla-Lara

Despite that convolution neural networks (CNN) have recently demonstrated high-quality reconstruction for video super-resolution (VSR), efficiently training competitive VSR models remains a challenging problem. It usually takes an order of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-18 Lijian Lin , Xintao Wang , Zhongang Qi , Ying Shan

Despite recent advances in multi-scale deep representations, their limitations are attributed to expensive parameters and weak fusion modules. Hence, we propose an efficient approach to fuse multi-scale deep representations, called…

Computer Vision and Pattern Recognition · Computer Science 2016-11-18 Yu Liu , Yanming Guo , Michael S. Lew

In recent years, 2D Convolutional Networks-based video action recognition has encouragingly gained wide popularity; However, constrained by the lack of long-range non-linear temporal relation modeling and reverse motion information…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Yongkang Zhang , Jun Li , Guoming Wu , Han Zhang , Zhiping Shi , Zhaoxun Liu , Zizhang Wu

The Transformer architecture has gained significant popularity in computer vision tasks due to its capacity to generalize and capture long-range dependencies. This characteristic makes it well-suited for generating spatiotemporal tokens…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Rachid Reda Dokkar , Faten Chaieb , Hassen Drira , Arezki Aberkane

Convolutional Neural Network (CNN) based image segmentation has made great progress in recent years. However, video object segmentation remains a challenging task due to its high computational complexity. Most of the previous methods employ…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Rui Hou , Chen Chen , Rahul Sukthankar , Mubarak Shah

Training deep learning models for accurate spatiotemporal recognition of facial expressions in videos requires significant computational resources. For practical reasons, 3D Convolutional Neural Networks (3D CNNs) are usually trained with…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Théo Ayral , Marco Pedersoli , Simon Bacon , Eric Granger

Group convolution has been shown to offer great computational savings in various 2D convolutional architectures for image classification. It is natural to ask: 1) if group convolution can help to alleviate the high computational cost of…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Du Tran , Heng Wang , Lorenzo Torresani , Matt Feiszli

It remains a challenge to efficiently extract spatialtemporal information from skeleton sequences for 3D human action recognition. Although most recent action recognition methods are based on Recurrent Neural Networks which present…

Computer Vision and Pattern Recognition · Computer Science 2017-06-08 Hong Liu , Juanhui Tu , Mengyuan Liu

The recent advances in Convolutional Neural Networks (CNNs) and Vision Transformers have convincingly demonstrated high learning capability for video action recognition on large datasets. Nevertheless, deep models often suffer from the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Yi Tan , Zhaofan Qiu , Yanbin Hao , Ting Yao , Tao Mei

We propose a new way of incorporating temporal information present in videos into Spatial Convolutional Neural Networks (ConvNets) trained on images, that avoids training Spatio-Temporal ConvNets from scratch. We describe several…

Computer Vision and Pattern Recognition · Computer Science 2015-03-26 Elman Mansimov , Nitish Srivastava , Ruslan Salakhutdinov

This paper proposes a two-stream convolution network to extract spatial and temporal cues for video based person Re-Identification (ReID). A temporal stream in this network is constructed by inserting several Multi-scale 3D (M3D)…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Jianing Li , Shiliang Zhang , Tiejun Huang

3D convolution is powerful for video classification but often computationally expensive, recent studies mainly focus on decomposing it on spatial-temporal and/or channel dimensions. Unfortunately, most approaches fail to achieve a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-04 Kunchang Li , Xianhang Li , Yali Wang , Jun Wang , Yu Qiao

Most video based action recognition approaches create the video-level representation by temporally pooling the features extracted at each frame. The pooling methods that they adopt, however, usually completely or partially neglect the…

Computer Vision and Pattern Recognition · Computer Science 2016-02-02 Peng Wang , Lingqiao Liu , Chunhua Shen , Heng Tao Shen

We investigate video classification via a two-stream convolutional neural network (CNN) design that directly ingests information extracted from compressed video bitstreams. Our approach begins with the observation that all modern video…

Computer Vision and Pattern Recognition · Computer Science 2017-12-21 Aaron Chadha , Alhabib Abbas , Yiannis Andreopoulos

Spatio-temporal representational learning has been widely adopted in various fields such as action recognition, video object segmentation, and action anticipation. Previous spatio-temporal representational learning approaches primarily…

Computer Vision and Pattern Recognition · Computer Science 2021-11-01 Xuefan Zha , Wentao Zhu , Tingxun Lv , Sen Yang , Ji Liu