English
Related papers

Related papers: Compressing CNN Kernels for Videos Using Tucker De…

200 papers

This paper presents a study on the use of Convolutional Neural Networks for camera relocalisation and its application to map compression. We follow state of the art visual relocalisation results and evaluate response to different data…

Computer Vision and Pattern Recognition · Computer Science 2017-03-03 Luis Contreras , Walterio Mayol-Cuevas

Deep convolutional neural networks (CNNs) have achieved remarkable success in various fields. However, training an excellent CNN is practically a trial-and-error process that consumes a tremendous amount of time and computer resources. To…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Dongyu Liu , Weiwei Cui , Kai Jin , Yuxiao Guo , Huamin Qu

Recent research shows that for training with $\ell_2$ loss, convolutional neural networks (CNNs) whose width (number of channels in convolutional layers) goes to infinity correspond to regression with respect to the CNN Gaussian Process…

Machine Learning · Computer Science 2019-11-05 Zhiyuan Li , Ruosong Wang , Dingli Yu , Simon S. Du , Wei Hu , Ruslan Salakhutdinov , Sanjeev Arora

This paper considers a convolutional neural network transformation that reduces computation complexity and thus speedups neural network processing. Usage of convolutional neural networks (CNN) is the standard approach to image recognition…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Elena Limonova , Alexander Sheshkus , Dmitry Nikolaev

Light-weight convolutional neural networks (CNNs) suffer performance degradation as their low computational budgets constrain both the depth (number of convolution layers) and the width (number of channels) of CNNs, resulting in limited…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Yinpeng Chen , Xiyang Dai , Mengchen Liu , Dongdong Chen , Lu Yuan , Zicheng Liu

Convolutional neural networks (CNNs), inspired by biological visual cortex systems, are a powerful category of artificial neural networks that can extract the hierarchical features of raw data to greatly reduce the network parametric…

Emerging Technologies · Computer Science 2021-05-14 Mengxi Tan , Xingyuan Xu , David J. Moss

Most state of the art deep neural networks are overparameterized and exhibit a high computational cost. A straightforward approach to this problem is to replace convolutional kernels with its low-rank tensor approximations, whereas the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Anh-Huy Phan , Konstantin Sobolev , Konstantin Sozykin , Dmitry Ermilov , Julia Gusak , Petr Tichavsky , Valeriy Glukhov , Ivan Oseledets , Andrzej Cichocki

Compressing convolutional neural networks (CNNs) has received ever-increasing research focus. However, most existing CNN compression methods do not interpret their inherent structures to distinguish the implicit redundancy. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Yuchao Li , Shaohui Lin , Baochang Zhang , Jianzhuang Liu , David Doermann , Yongjian Wu , Feiyue Huang , Rongrong Ji

Convolution is a central operation in Convolutional Neural Networks (CNNs), which applies a kernel to overlapping regions shifted across the image. However, because of the strong correlations in real-world image data, convolutional kernels…

The ability to automatically detect certain types of cells or cellular subunits in microscopy images is of significant interest to a wide range of biomedical research and clinical practices. Cell detection methods have evolved from…

Computer Vision and Pattern Recognition · Computer Science 2018-02-22 Yao Xue , Nilanjan Ray

The sensitivity of thin-film materials and devices to defects motivates extensive research into the optimization of film morphology. This research could be accelerated by automated experiments that characterize the response of film…

Temporal convolutional networks (TCNs) are a commonly used architecture for temporal video segmentation. TCNs however, tend to suffer from over-segmentation errors and require additional refinement modules to ensure smoothness and temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Dipika Singhania , Rahul Rahaman , Angela Yao

In recent decades, digital image processing has gained enormous popularity. Consequently, a number of data compression strategies have been put forth, with the goal of minimizing the amount of information required to represent images. Among…

Image and Video Processing · Electrical Eng. & Systems 2023-07-04 Suman Kunwar

Convolutional Neural Networks (CNNs) have become indispensable for solving machine learning tasks in speech recognition, computer vision, and other areas that involve high-dimensional data. A CNN filters the input feature using a network…

Machine Learning · Computer Science 2020-02-13 Jonathan Ephrath , Moshe Eliasof , Lars Ruthotto , Eldad Haber , Eran Treister

Despite the steady progress in video analysis led by the adoption of convolutional neural networks (CNNs), the relative improvement has been less drastic as that in 2D static image classification. Three main challenges exist including…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Saining Xie , Chen Sun , Jonathan Huang , Zhuowen Tu , Kevin Murphy

Convolutional Neural Networks (CNNs) have proven to be a powerful state-of-the-art method for image classification tasks. One drawback however is the high computational complexity and high memory consumption of CNNs which makes them…

Computer Vision and Pattern Recognition · Computer Science 2021-02-04 Rishabh Goyal , Joaquin Vanschoren , Victor van Acht , Stephan Nijssen

Model pruning has become a useful technique that improves the computational efficiency of deep learning, making it possible to deploy solutions in resource-limited scenarios. A widely-used practice in relevant work assumes that a…

Machine Learning · Computer Science 2018-02-06 Jianbo Ye , Xin Lu , Zhe Lin , James Z. Wang

Recurrent neural networks (RNNs) are powerful in the tasks oriented to sequential data, such as natural language processing and video recognition. However, since the modern RNNs, including long-short term memory (LSTM) and gated recurrent…

Computer Vision and Pattern Recognition · Computer Science 2021-09-27 Dingheng Wang , Bijiao Wu , Guangshe Zhao , Man Yao , Hengnu Chen , Lei Deng , Tianyi Yan , Guoqi Li

Convolutional Neural Network (CNN) based image segmentation has made great progress in recent years. However, video object segmentation remains a challenging task due to its high computational complexity. Most of the previous methods employ…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Rui Hou , Chen Chen , Rahul Sukthankar , Mubarak Shah

In this paper, we introduce a memory-efficient CNN (convolutional neural network), which enables resource-constrained low-end embedded and IoT devices to perform on-device vision tasks, such as image classification and object detection,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Jaewook Lee , Yoel Park , Seulki Lee