English
Related papers

Related papers: Initialization Strategies of Spatio-Temporal Convo…

200 papers

Classification of EEG signals using shallow Convolutional Neural Networks (CNNs) is a prevalent and successful approach across a variety of fields. Most of these models use independent one-dimensional (1D) convolutional layers along the…

Machine Learning · Computer Science 2026-05-06 Laurits Dixen , Stefan Heinrich , Paolo Burelli

Traditional 3D convolutions are computationally expensive, memory intensive, and due to large number of parameters, they often tend to overfit. On the other hand, 2D CNNs are less computationally expensive and less memory intensive than 3D…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Gagan Kanojia , Sudhakar Kumawat , Shanmuganathan Raman

In this work we address the challenging problem of unsupervised learning from videos. Existing methods utilize the spatio-temporal continuity in contiguous video frames as regularization for the learning process. Typically, this temporal…

Computer Vision and Pattern Recognition · Computer Science 2018-10-12 Carolina Redondo-Cabrera , Roberto J. López-Sastre

Temporal convolution has been widely used for video classification. However, it is performed on spatio-temporal contexts in a limited view, which often weakens its capacity of learning video representation. To alleviate this problem, we…

Computer Vision and Pattern Recognition · Computer Science 2020-06-26 Xianhang Li , Yali Wang , Zhipeng Zhou , Yu Qiao

The work in this paper is driven by the question if spatio-temporal correlations are enough for 3D convolutional neural networks (CNN)? Most of the traditional 3D networks use local spatio-temporal features. We introduce a new block that…

Computer Vision and Pattern Recognition · Computer Science 2019-02-08 Ali Diba , Mohsen Fayyaz , Vivek Sharma , M. Mahdi Arzani , Rahman Yousefzadeh , Juergen Gall , Luc Van Gool

Convolutional Neural Networks (CNN) have been regarded as a powerful class of models for visual recognition problems. Nevertheless, the convolutional filters in these networks are local operations while ignoring the large-range dependency.…

Computer Vision and Pattern Recognition · Computer Science 2019-06-14 Zhaofan Qiu , Ting Yao , Chong-Wah Ngo , Xinmei Tian , Tao Mei

Temporal action localization is an important task of computer vision. Though a variety of methods have been proposed, it still remains an open question how to predict the temporal boundaries of action segments precisely. Most works use…

Computer Vision and Pattern Recognition · Computer Science 2017-09-12 Ke Yang , Peng Qiao , Dongsheng Li , Shaohe Lv , Yong Dou

This work introduces the Topological CNN (TCNN), which encompasses several topologically defined convolutional methods. Manifolds with important relationships to the natural image space are used to parameterize image filters which are used…

Machine Learning · Computer Science 2021-03-05 Ephy R. Love , Benjamin Filippenko , Vasileios Maroulas , Gunnar Carlsson

3D convolutional neural networks are difficult to train because they are parameter-expensive and data-hungry. To solve these problems we propose a simple technique for learning 3D convolutional kernels efficiently requiring less training…

Machine Learning · Computer Science 2019-12-19 Gabriëlle Ras , Luca Ambrogioni , Umut Güçlü , Marcel A. J. van Gerven

Compression has been an important research topic for many decades, to produce a significant impact on data transmission and storage. Recent advances have shown a great potential of learning image and video compression. Inspired from related…

Image and Video Processing · Electrical Eng. & Systems 2019-07-01 Zhengxue Cheng , Heming Sun , Masaru Takeuchi , Jiro Katto

Self-supervised tasks such as colorization, inpainting and zigsaw puzzle have been utilized for visual representation learning for still images, when the number of labeled images is limited or absent at all. Recently, this worthwhile stream…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Dahun Kim , Donghyeon Cho , In So Kweon

This paper presents a novel method to involve both spatial and temporal features for semantic video segmentation. Current work on convolutional neural networks(CNNs) has shown that CNNs provide advanced spatial features supporting a very…

Computer Vision and Pattern Recognition · Computer Science 2016-09-05 Mohsen Fayyaz , Mohammad Hajizadeh Saffar , Mohammad Sabokrou , Mahmood Fathy , Reinhard Klette , Fay Huang

Convolutional neural networks (CNNs) have been extensively applied for image recognition problems giving state-of-the-art results on recognition, detection, segmentation and retrieval. In this work we propose and evaluate several deep…

Computer Vision and Pattern Recognition · Computer Science 2015-04-14 Joe Yue-Hei Ng , Matthew Hausknecht , Sudheendra Vijayanarasimhan , Oriol Vinyals , Rajat Monga , George Toderici

Convolutional Neural Networks (CNNs) inherently encode strong inductive biases, enabling effective generalization on small-scale datasets. In this paper, we propose integrating this inductive bias into ViTs, not through an architectural…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Jianqiao Zheng , Xueqian Li , Hemanth Saratchandran , Simon Lucey

In this contribution, a novel spatio-temporal prediction algorithm for video coding is introduced. This algorithm exploits temporal as well as spatial redundancies for effectively predicting the signal to be encoded. To achieve this, the…

Image and Video Processing · Electrical Eng. & Systems 2022-07-05 Jürgen Seiler , André Kaup

By converting low-frame-rate, low-resolution videos into high-frame-rate, high-resolution ones, space-time video super-resolution techniques can enhance visual experiences and facilitate more efficient information dissemination. We propose…

Image and Video Processing · Electrical Eng. & Systems 2024-07-12 Congrui Fu , Hui Yuan , Shiqi Jiang , Guanghui Zhang , Liquan Shen , Raouf Hamzaoui

We introduce a novel self-supervised contrastive learning method to learn representations from unlabelled videos. Existing approaches ignore the specifics of input distortions, e.g., by learning invariance to temporal transformations.…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Simon Jenni , Hailin Jin

Intelligent video summarization algorithms allow to quickly convey the most relevant information in videos through the identification of the most essential and explanatory content while removing redundant video frames. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-02-16 Tianrui Liu , Qingjie Meng , Jun-Jie Huang , Athanasios Vlontzos , Daniel Rueckert , Bernhard Kainz

The purpose of this contribution is to introduce a new method of signal prediction in video coding. Unlike most existent prediction methods that either use temporal or use spatial correlations to generate the prediction signal, the proposed…

Image and Video Processing · Electrical Eng. & Systems 2022-07-11 Jürgen Seiler , André Kaup

In this paper, we investigate the challenge of spatio-temporal video prediction task, which involves generating future video frames based on historical spatio-temporal observation streams. Existing approaches typically utilize external…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Hao Wu , Fan Xu , Chong Chen , Xian-Sheng Hua , Xiao Luo , Haixin Wang