English
Related papers

Related papers: Deep Fried Convnets

200 papers

The computational prediction of a protein structure from its sequence generally relies on a method to assess the quality of protein models. Most assessment methods rank candidate models using heavily engineered structural features, defined…

Biomolecules · Quantitative Biology 2018-11-26 Georgy Derevyanko , Sergei Grudinin , Yoshua Bengio , Guillaume Lamoureux

Convolutional Neural Network (CNN) has gained state-of-the-art results in many pattern recognition and computer vision tasks. However, most of the CNN structures are manually designed by experienced researchers. Therefore, auto- matically…

Neural and Evolutionary Computing · Computer Science 2018-10-26 Guoqiang Zhong , Tao Li , Wenxue Liu , Yang Chen

Deep learning has been widely used in data-intensive applications. However, training a deep neural network often requires a large data set. When there is not enough data available for training, the performance of deep learning models is…

Machine Learning · Computer Science 2020-12-02 Peng Peng , Jiugen Wang

Neural networks have achieved remarkable performance in various application domains. Nevertheless, a large number of weights in pre-trained deep neural networks prohibit them from being deployed on smartphones and embedded systems. It is…

Machine Learning · Computer Science 2023-07-19 Shibo Yao , Dantong Yu , Ioannis Koutis

Convolutional neural networks (CNNs) based solutions have achieved state-of-the-art performances for many computer vision tasks, including classification and super-resolution of images. Usually the success of these methods comes with a cost…

Computer Vision and Pattern Recognition · Computer Science 2019-12-24 Yawei Li , Shuhang Gu , Luc Van Gool , Radu Timofte

Deep Neural nets (NNs) with millions of parameters are at the heart of many state-of-the-art computer vision systems today. However, recent works have shown that much smaller models can achieve similar levels of performance. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2015-07-23 Suraj Srinivas , R. Venkatesh Babu

Learning acoustic models directly from the raw waveform data with minimal processing is challenging. Current waveform-based models have generally used very few (~2) convolutional layers, which might be insufficient for building high-level…

Sound · Computer Science 2016-10-04 Wei Dai , Chia Dai , Shuhui Qu , Juncheng Li , Samarjit Das

The computation of convolution layers in deep neural networks typically rely on high performance routines that trade space for time by using additional memory (either for packing purposes or required as part of the algorithm) to improve…

Machine Learning · Computer Science 2018-09-28 Jiyuan Zhang , Franz Franchetti , Tze Meng Low

Deep convolutional neural networks (CNN) has become the most promising method for object recognition, repeatedly demonstrating record breaking results for image classification and object detection in recent years. However, a very deep CNN…

Computer Vision and Pattern Recognition · Computer Science 2014-12-22 Yunchao Gong , Liu Liu , Ming Yang , Lubomir Bourdev

Deep Convolutional Neural Networks (CNNs) have been widely used in various domains due to their impressive capabilities. These models are typically composed of a large number of 2D convolutional (Conv2D) layers with numerous trainable…

Machine Learning · Computer Science 2022-02-01 Yinan Yu , Samuel Scheidegger , Tomas McKelvey

Deep Learning is considered to be a quite young in the area of machine learning research, found its effectiveness in dealing complex yet high dimensional dataset that includes but limited to images, text and speech etc. with multiple levels…

Computer Vision and Pattern Recognition · Computer Science 2016-10-19 Mrutyunjaya Panda

Recent work has shown that convolutional networks can be substantially deeper, more accurate, and efficient to train if they contain shorter connections between layers close to the input and those close to the output. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2018-01-30 Gao Huang , Zhuang Liu , Laurens van der Maaten , Kilian Q. Weinberger

Computational pathology tasks have some unique characterises such as multi-gigapixel images, tedious and frequently uncertain annotations, and unavailability of large number of cases [13]. To address some of these issues, we present Deep…

Image and Video Processing · Electrical Eng. & Systems 2023-01-24 Nima Hatami

The use of Convolutional Neural Networks (CNNs) is widespread in Deep Learning due to a range of desirable model properties which result in an efficient and effective machine learning framework. However, performant CNN architectures must be…

This paper describes the transformation of a traditional in-silico classification network into an optical fully convolutional neural network with high-resolution feature maps and kernels. When using the free-space 4f system to accelerate…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Riad Ibadulla , Thomas M. Chen , Constantino Carlos Reyes-Aldasoro

Typical deep convolutional architectures present an increasing number of feature maps as we go deeper in the network, whereas spatial resolution of inputs is decreased through downsampling operations. This means that most of the parameters…

Machine Learning · Computer Science 2020-07-21 Guillaume Coiffier , Ghouthi Boukli Hacene , Vincent Gripon

Extremely efficient convolutional neural network architectures are one of the most important requirements for limited-resource devices (such as embedded and mobile devices). The computing power and memory size are two important constraints…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Fahimeh Fooladgar , Shohreh Kasaei

This paper is focused on the improvement the efficiency of the sparse convolutional neural networks (CNNs) layers on graphic processing units (GPU). The Nvidia deep neural network (cuDnn) library provides the most effective implementation…

Machine Learning · Computer Science 2022-01-03 Marcin Pietroń , Dominik Żurek

One of the most promising ways of improving the performance of deep convolutional neural networks is by increasing the number of convolutional layers. However, adding layers makes training more difficult and computationally expensive. In…

Computer Vision and Pattern Recognition · Computer Science 2015-05-12 Liwei Wang , Chen-Yu Lee , Zhuowen Tu , Svetlana Lazebnik

In this work, we investigate the value of employing deep learning for the task of wireless signal modulation recognition. Recently in [1], a framework has been introduced by generating a dataset using GNU radio that mimics the imperfections…

Machine Learning · Computer Science 2018-01-08 Xiaoyu Liu , Diyu Yang , Aly El Gamal