English
Related papers

Related papers: Gabor Filter Assisted Energy Efficient Fast Learni…

200 papers

We introduce a novel scheme to train binary convolutional neural networks (CNNs) -- CNNs with weights and activations constrained to {-1,+1} at run-time. It has been known that using binary weights and activations drastically reduce memory…

Machine Learning · Computer Science 2017-12-01 Xiaofan Lin , Cong Zhao , Wei Pan

Convolutional neural network (CNN) delivers impressive achievements in computer vision and machine learning field. However, CNN incurs high computational complexity, especially for vision quality applications because of large image…

Image and Video Processing · Electrical Eng. & Systems 2019-08-07 Wei-Ting Wang , Han-Lin Li , Wei-Shiang Lin , Cheng-Ming Chiang , Yi-Min Tsai

It is well known that Convolutional Neural Networks (CNNs) have significant redundancy in their filter weights. Various methods have been proposed in the literature to compress trained CNNs. These include techniques like pruning weights,…

Machine Learning · Computer Science 2019-06-12 Muhammad Tayyab , Abhijit Mahalanobis

The excellent performance of deep neural networks has enabled us to solve several automatization problems, opening an era of autonomous devices. However, current deep net architectures are heavy with millions of parameters and require…

Computer Vision and Pattern Recognition · Computer Science 2018-07-06 Dat Thanh Tran , Alexandros Iosifidis , Moncef Gabbouj

We propose a local modelling approach using deep convolutional neural networks (CNNs) for fine-grained image classification. Recently, deep CNNs trained from large datasets have considerably improved the performance of object recognition.…

Computer Vision and Pattern Recognition · Computer Science 2015-03-02 ZongYuan Ge , Chris McCool , Conrad Sanderson , Peter Corke

Deep Neural Networks (DNNs) and Convolutional Neural Networks (CNNs) are useful for many practical tasks in machine learning. Synaptic weights, as well as neuron activation functions within the deep network are typically stored with…

Machine Learning · Computer Science 2017-11-15 Moritz B. Milde , Daniel Neil , Alessandro Aimar , Tobi Delbruck , Giacomo Indiveri

Despite the remarkable performance, modern deep neural networks are inevitably accompanied by a significant amount of computational cost for learning and deployment, which may be incompatible with their usage on edge devices. Recent efforts…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Seul-Ki Yeom , Kyung-Hwan Shim , Jee-Hyun Hwang

Convolutional Neural Networks (CNNs) have shown to be powerful classification tools in tasks that range from check reading to medical diagnosis, reaching close to human perception, and in some cases surpassing it. However, the problems to…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-12-08 Jose Marques , Gabriel Falcao , Luís A. Alexandre

We contrasted the performance of deep neural networks - Convolutional Neural Network (CNN) and Graph Neural Network (GNN) - to current state of the art energy regression methods in a finely 3D-segmented calorimeter simulated by GEANT4. This…

Instrumentation and Detectors · Physics 2022-01-05 N. Akchurin , C. Cowden , J. Damgov , A. Hussain , S. Kunori

Deep learning techniques have become prominent in modern fault diagnosis for complex processes. In particular, convolutional neural networks (CNNs) have shown an appealing capacity to deal with multivariate time-series data by converting…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Saif S. S. Al-Wahaibi , Qiugang Lu

A convolutional layer in a Convolutional Neural Network (CNN) consists of many filters which apply convolution operation to the input, capture some special patterns and pass the result to the next layer. If the same patterns also occur at…

Computer Vision and Pattern Recognition · Computer Science 2019-02-04 Okan Köpüklü , Maryam Babaee , Stefan Hörmann , Gerhard Rigoll

Convolutional Neural Networks (CNN) are widely used to face challenging tasks like speech recognition, natural language processing or computer vision. As CNN architectures get larger and more complex, their computational requirements…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Luis Balderas , Miguel Lastra , José M. Benítez

Deep learning has made significant improvements at many image processing tasks in recent years, such as image classification, object recognition and object detection. Convolutional neural networks (CNN), which is a popular deep learning…

Computer Vision and Pattern Recognition · Computer Science 2018-05-16 T. Ceren Deveci , Serdar Cakir , A. Enis Cetin

A classification algorithm that combines the components of k-nearest neighbours and multilayer neural networks has been designed and tested. With this method the computational time required for training the dataset has been reduced…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 N. Joshi

Convolutional Neural Networks (CNN) are the state-of-the-art in the field of visual computing. However, a major problem with CNNs is the large number of floating point operations (FLOPs) required to perform convolutions for large inputs.…

Machine Learning · Computer Science 2022-07-06 Tobias Engelhardt Rasmussen , Line H Clemmensen , Andreas Baum

In the last decade, Convolutional Neural Network with a multi-layer architecture has advanced rapidly. However, training its complex network is very space-consuming, since a lot of intermediate data are preserved across layers, especially…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-23 Zhigang Wang , Hangyu Yang , Ning Wang , Chuanfei Xu , Jie Nie , Zhiqiang Wei , Yu Gu , Ge Yu

Convolutional neural network (CNN) is one of the most frequently used deep learning techniques. Various forms of models have been proposed and im-proved for learning at CNN. When learning with CNN, it is necessary to determine the optimal…

Neural and Evolutionary Computing · Computer Science 2023-03-07 T. Serizawa , H. Fujita

Filters are the essential elements in convolutional neural networks (CNNs). Filters are corresponded to the feature maps and form the main part of the computational and memory requirement for the CNN processing. In filter pruning methods, a…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Morteza Mousa-Pasandi , Mohsen Hajabdollahi , Nader Karimi , Shadrokh Samavi , Shahram Shirani

Graph Convolutional Networks (GCNs) and their variants have experienced significant attention and have become the de facto methods for learning graph representations. GCNs derive inspiration primarily from recent deep learning approaches,…

Machine Learning · Computer Science 2019-06-21 Felix Wu , Tianyi Zhang , Amauri Holanda de Souza , Christopher Fifty , Tao Yu , Kilian Q. Weinberger

We revisit the benefits of merging classical vision concepts with deep learning models. In particular, we explore the effect on robustness against adversarial attacks of replacing the first layers of various deep architectures with Gabor…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Juan C. Pérez , Motasem Alfarra , Guillaume Jeanneret , Adel Bibi , Ali Thabet , Bernard Ghanem , Pablo Arbeláez