English
Related papers

Related papers: Convolutional Neural Network Quantization using Ge…

200 papers

We consider the problem of distributed feature quantization, where the goal is to enable a pretrained classifier at a central node to carry out its classification on features that are gathered from distributed nodes through communication…

Machine Learning · Computer Science 2019-11-04 Osama A. Hanna , Yahya H. Ezzeldin , Tara Sadjadpour , Christina Fragouli , Suhas Diggavi

Recent convolutional neural network (CNN) development continues to advance the state-of-the-art model accuracy for various applications. However, the enhanced accuracy comes at the cost of substantial memory bandwidth and storage…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Hsu-Hsun Chin , Ren-Song Tsay , Hsin-I Wu

The state-of-the-art performance for several real-world problems is currently reached by convolutional neural networks (CNN). Such learning models exploit recent results in the field of deep learning, typically leading to highly performing,…

Machine Learning · Computer Science 2021-08-31 Giosuè Cataldo Marinò , Alessandro Petrini , Dario Malchiodi , Marco Frasca

Quantum computing is a new computational paradigm that promises applications in several fields, including machine learning. In the last decade, deep learning, and in particular Convolutional neural networks (CNN), have become essential for…

Quantum Physics · Physics 2021-06-14 Iordanis Kerenidis , Jonas Landman , Anupam Prakash

The increasing amount of data processed on edge and the demand for reducing the energy consumption for large neural network architectures have initiated the transition from traditional von Neumann architectures towards in-memory computing…

Emerging Technologies · Computer Science 2022-09-27 O. Krestinskaya , L. Zhang , K. N. Salama

In recent years, Graph Convolutional Networks (GCNs) have achieved great success in learning from graph-structured data. With the growing tendency of graph nodes and edges, GCN training by single processor cannot meet the demand for time…

Machine Learning · Computer Science 2021-10-08 Taige Zhao , Xiangyu Song , Jianxin Li , Wei Luo , Imran Razzak

With the increasing popularity of graph-based learning, Graph Neural Networks (GNNs) win lots of attention from the research and industry field because of their high accuracy. However, existing GNNs suffer from high memory footprints (e.g.,…

Machine Learning · Computer Science 2020-09-17 Boyuan Feng , Yuke Wang , Xu Li , Shu Yang , Xueqiao Peng , Yufei Ding

Convolutional Neural Networks (CNNs) reach high accuracies in various application domains, but require large amounts of computation and incur costly data movements. One method to decrease these costs while trading accuracy is weight and/or…

Hardware Architecture · Computer Science 2022-08-10 Cecilia Latotzke , Tim Ciesielski , Tobias Gemmeke

Deep convolutional neural network (CNN) training via iterative optimization has had incredible success in finding optimal parameters. However, modern CNN architectures often contain millions of parameters. Thus, any given model for a single…

Machine Learning · Computer Science 2023-08-21 Stone Yun , Alexander Wong

Convolutional Neural Networks (CNNs) are becoming increasingly popular due to their superior performance in the domain of computer vision, in applications such as objection detection and recognition. However, they demand complex,…

Neural and Evolutionary Computing · Computer Science 2018-08-24 Ali Athar

The intensive computation and memory requirements of generative adversarial neural networks (GANs) hinder its real-world deployment on edge devices such as smartphones. Despite the success in model reduction of CNNs, neural network…

Neural and Evolutionary Computing · Computer Science 2019-01-25 Peiqi Wang , Dongsheng Wang , Yu Ji , Xinfeng Xie , Haoxuan Song , XuXin Liu , Yongqiang Lyu , Yuan Xie

Deploying neural networks on the edge has become increasingly important as deep learning is being applied in an increasing amount of applications. At the edge computing hardware typically has limited resources disallowing to run neural…

Machine Learning · Computer Science 2025-09-15 Quinten Van Baelen , Peter Karsmakers

Quantized Neural Networks (QNNs) use low bit-width fixed-point numbers for representing weight parameters and activations, and are often used in real-world applications due to their saving of computation resources and reproducibility of…

Machine Learning · Computer Science 2020-09-01 Dachao Lin , Peiqin Sun , Guangzeng Xie , Shuchang Zhou , Zhihua Zhang

The training of deep neural networks (DNNs) always requires intensive resources for both computation and data storage. Thus, DNNs cannot be efficiently applied to mobile phones and embedded devices, which severely limits their applicability…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Qigong Sun , Xiufang Li , Fanhua Shang , Hongying Liu , Kang Yang , Licheng Jiao , Zhouchen Lin

In this paper we introduce a novel method for segmentation that can benefit from general semantics of Convolutional Neural Network (CNN). Our segmentation proposes visually and semantically coherent image segments. We use binary encoding of…

Computer Vision and Pattern Recognition · Computer Science 2016-11-22 Mahdyar Ravanbakhsh , Hossein Mousavi , Moin Nabi , Lucio Marcenaro , Carlo Regazzoni

We propose a novel method for neural network quantization that casts the neural architecture search problem as one of hyperparameter search to find non-uniform bit distributions throughout the layers of a CNN. We perform the search assuming…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Marcelo Gennari do Nascimento , Theo W. Costain , Victor Adrian Prisacariu

Kernel normalization methods have been employed to improve robustness of optimization methods to reparametrization of convolution kernels, covariate shift, and to accelerate training of Convolutional Neural Networks (CNNs). However, our…

Computer Vision and Pattern Recognition · Computer Science 2016-10-25 Mete Ozay , Takayuki Okatani

Convolutional neural network (CNN) accelerators implemented on Field-Programmable Gate Arrays (FPGAs) are typically designed with a primary focus on maximizing performance, often measured in giga-operations per second (GOPS). However,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Panagiotis Mousouliotis , Georgios Keramidas

Graph Neural Networks (GNNs) are becoming a promising technique in various domains due to their excellent capabilities in modeling non-Euclidean data. Although a spectrum of accelerators has been proposed to accelerate the inference of…

Hardware Architecture · Computer Science 2023-11-17 Zeyu Zhu , Fanrong Li , Gang Li , Zejian Liu , Zitao Mo , Qinghao Hu , Xiaoyao Liang , Jian Cheng

Automated design methods for convolutional neural networks (CNNs) have recently been developed in order to increase the design productivity. We propose a neuroevolution method capable of evolving and optimizing CNNs with respect to the…

Neural and Evolutionary Computing · Computer Science 2019-10-16 Filip Badan , Lukas Sekanina