English
Related papers

Related papers: Design of Efficient Convolutional Layers using Sin…

200 papers

Traditional computer graphics rendering pipeline is designed for procedurally generating 2D quality images from 3D shapes with high performance. The non-differentiability due to discrete operations such as visibility computation makes it…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Thu Nguyen-Phuoc , Chuan Li , Stephen Balaban , Yong-Liang Yang

Conventional deep convolutional neural networks (CNNs) apply convolution operators uniformly in space across all feature maps for hundreds of layers - this incurs a high computational cost for real-time applications. For many problems such…

Computer Vision and Pattern Recognition · Computer Science 2018-06-08 Mengye Ren , Andrei Pokrovsky , Bin Yang , Raquel Urtasun

A convolutional layer in a Convolutional Neural Network (CNN) consists of many filters which apply convolution operation to the input, capture some special patterns and pass the result to the next layer. If the same patterns also occur at…

Computer Vision and Pattern Recognition · Computer Science 2019-02-04 Okan Köpüklü , Maryam Babaee , Stefan Hörmann , Gerhard Rigoll

Convolutional layers are one of the basic building blocks of modern deep neural networks. One fundamental assumption is that convolutional kernels should be shared for all examples in a dataset. We propose conditionally parameterized…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Brandon Yang , Gabriel Bender , Quoc V. Le , Jiquan Ngiam

Deep 3-dimensional (3D) Convolutional Network (ConvNet) has shown promising performance on video recognition tasks because of its powerful spatio-temporal information fusion ability. However, the extremely intensive requirements on memory…

Computer Vision and Pattern Recognition · Computer Science 2019-06-03 Haonan Wang , Jun Lin , Zhongfeng Wang

Very deep convolutional neural networks (CNNs) have been firmly established as the primary methods for many computer vision tasks. However, most state-of-the-art CNNs are large, which results in high inference latency. Recently, depth-wise…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yihui He , Jianing Qian , Jianren Wang , Cindy X. Le , Congrui Hetang , Qi Lyu , Wenping Wang , Tianwei Yue

Like other applications in computer vision, medical image segmentation has been most successfully addressed using deep learning models that rely on the convolution operation as their main building block. Convolutions enjoy important…

Image and Video Processing · Electrical Eng. & Systems 2022-04-05 Davood Karimi , Serge Vasylechko , Ali Gholipour

Modern efficient Convolutional Neural Networks(CNNs) always use Depthwise Separable Convolutions(DSCs) and Neural Architecture Search(NAS) to reduce the number of parameters and the computational complexity. But some inherent…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Liangqi Zhang , Haibo Shen , Yihao Luo , Xiang Cao , Leixilan Pan , Tianjiang Wang , Qi Feng

Model compression and acceleration are attracting increasing attentions due to the demand for embedded devices and mobile applications. Research on efficient convolutional neural networks (CNNs) aims at removing feature redundancy by…

Machine Learning · Computer Science 2020-08-21 Jinhua Liang , Tao Zhang , Guoqing Feng

The convolution operation is a central building block of neural network architectures widely used in computer vision. The size of the convolution kernels determines both the expressiveness of convolutional neural networks (CNN), as well as…

Image and Video Processing · Electrical Eng. & Systems 2022-10-10 Tianyu Ma , Adrian V. Dalca , Mert R. Sabuncu

Due to the advent of modern embedded systems and mobile devices with constrained resources, there is a great demand for incredibly efficient deep neural networks for machine learning purposes. There is also a growing concern of privacy and…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Priyank Kalgaonkar , Mohamed El-Sharkawy

Deep convolutional neural networks (CNNs) have been intensively used for multi-class segmentation of data from different modalities and achieved state-of-the-art performances. However, a common problem when dealing with large, high…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Chengjia Wang , Tom MacGillivray , Gillian Macnaught , Guang Yang , David Newby

A number of recent studies have shown that a Deep Convolutional Neural Network (DCNN) pretrained on a large dataset can be adopted as a universal image description which leads to astounding performance in many visual classification tasks.…

Computer Vision and Pattern Recognition · Computer Science 2014-12-01 Lingqiao Liu , Chunhua Shen , Anton van den Hengel

Spatial and spectral approaches are two major approaches for image processing tasks such as image classification and object recognition. Among many such algorithms, convolutional neural networks (CNNs) have recently achieved significant…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Shin Fujieda , Kohei Takayama , Toshiya Hachisuka

Traditional 3D convolutions are computationally expensive, memory intensive, and due to large number of parameters, they often tend to overfit. On the other hand, 2D CNNs are less computationally expensive and less memory intensive than 3D…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Gagan Kanojia , Sudhakar Kumawat , Shanmuganathan Raman

Deep convolutional neural networks have been successfully applied to image classification tasks. When these same networks have been applied to image retrieval, the assumption has been made that the last layers would give the best…

Computer Vision and Pattern Recognition · Computer Science 2015-05-01 Joe Yue-Hei Ng , Fan Yang , Larry S. Davis

In this paper we address three different computer vision tasks using a single basic architecture: depth prediction, surface normal estimation, and semantic labeling. We use a multiscale convolutional network that is able to adapt easily to…

Computer Vision and Pattern Recognition · Computer Science 2015-12-18 David Eigen , Rob Fergus

As a successful deep model applied in image super-resolution (SR), the Super-Resolution Convolutional Neural Network (SRCNN) has demonstrated superior performance to the previous hand-crafted models either in speed and restoration quality.…

Computer Vision and Pattern Recognition · Computer Science 2016-08-02 Chao Dong , Chen Change Loy , Xiaoou Tang

Deep Convolutional Neural Networks (CNNs) for image classification successively alternate convolutions and downsampling operations, such as pooling layers or strided convolutions, resulting in lower resolution features the deeper the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Ioannis Vezakis , Antonios Vezakis , Sofia Gourtsoyianni , Vassilis Koutoulidis , George K. Matsopoulos , Dimitrios Koutsouris

Deep learning and convolutional neural networks (ConvNets) have been successfully applied to most relevant tasks in the computer vision community. However, these networks are computationally demanding and not suitable for embedded devices…

Computer Vision and Pattern Recognition · Computer Science 2016-06-20 Jose Alvarez , Lars Petersson