English
Related papers

Related papers: Quantized Neural Networks via {-1, +1} Encoding De…

200 papers

Deep Neural Network (DNN) has gained unprecedented performance due to its automated feature extraction capability. This high order performance leads to significant incorporation of DNN models in different Internet of Things (IoT)…

Machine Learning · Computer Science 2020-10-09 Rahul Mishra , Hari Prabhat Gupta , Tanima Dutta

A promising strategy to protect quantum information from noise-induced errors is to encode it into the low-energy states of a topological quantum memory device. However, readout errors from such memory under realistic settings is less…

Quantum Physics · Physics 2024-01-15 Weishun Zhong , Oles Shtanko , Ramis Movassagh

We introduce a method to train Binarized Neural Networks (BNNs) - neural networks with binary weights and activations at run-time. At training-time the binary weights and activations are used for computing the parameters gradients. During…

Machine Learning · Computer Science 2016-03-18 Matthieu Courbariaux , Itay Hubara , Daniel Soudry , Ran El-Yaniv , Yoshua Bengio

We introduce and analyze a novel quantum machine learning model motivated by convolutional neural networks. Our quantum convolutional neural network (QCNN) makes use of only $O(\log(N))$ variational parameters for input sizes of $N$ qubits,…

Quantum Physics · Physics 2019-10-23 Iris Cong , Soonwon Choi , Mikhail D. Lukin

We demonstrate the feasibility of framing a classically learned deep neural network as an energy based model that can be processed on a one-step quantum annealer in order to exploit fast sampling times. We propose approaches to overcome two…

Quantum Physics · Physics 2021-07-20 Catherine F. Higham , Adrian Bedford

Low-precision representation of deep neural networks (DNNs) is critical for efficient deployment of deep learning application on embedded platforms, however, converting the network to low precision degrades its performance. Crucially,…

Machine Learning · Computer Science 2019-06-10 Alexander Finkelstein , Uri Almog , Mark Grobman

Deep neural networks (DNNs) are successful in many computer vision tasks. However, the most accurate DNNs require millions of parameters and operations, making them energy, computation and memory intensive. This impedes the deployment of…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Abhinav Goel , Caleb Tung , Yung-Hsiang Lu , George K. Thiruvathukal

Quantization is essential to simplify DNN inference in edge applications. Existing uniform and non-uniform quantization methods, however, exhibit an inherent conflict between the representing range and representing resolution, and thereby…

Signal Processing · Electrical Eng. & Systems 2020-09-29 Liu Fangxin , Zhao Wenbo , Wang Yanzhi , Dai Changzhi , Jiang Li

Deep neural networks have been applied in many applications exhibiting extraordinary abilities in the field of computer vision. However, complex network architectures challenge efficient real-time deployment and require significant…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Tailin Liang , John Glossner , Lei Wang , Shaobo Shi , Xiaotong Zhang

As deep learning (DL) is being rapidly pushed to edge computing, researchers invented various ways to make inference computation more efficient on mobile/IoT devices, such as network pruning, parameter compression, and etc. Quantization, as…

Computer Vision and Pattern Recognition · Computer Science 2019-03-13 Tao Sheng , Chen Feng , Shaojie Zhuo , Xiaopeng Zhang , Liang Shen , Mickey Aleksic

Quantum neural networks are expected to be a promising application in near-term quantum computing, but face challenges such as vanishing gradients during optimization and limited expressibility by a limited number of qubits and shallow…

Quantum Physics · Physics 2026-04-06 Yoshiaki Kawase

Even if Application-Specific Integrated Circuits (ASIC) have proven to be a relevant choice for integrating inference at the edge, they are often limited in terms of applicability. In this paper, we demonstrate that an ASIC neural network…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Van Thien Nguyen , William Guicquero , Gilles Sicard

As state of the art neural networks (NNs) continue to grow in size, their resource-efficient implementation becomes ever more important. In this paper, we introduce a compression scheme that reduces the number of computations required for…

Machine Learning · Computer Science 2025-04-25 Hans Rosenberger , Rodrigo Fischer , Johanna S. Fröhlich , Ali Bereyhi , Ralf R. Müller

The sensitivity of deep neural networks to compressed images hinders their usage in many real applications, which means classification networks may fail just after taking a screenshot and saving it as a compressed file. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Li Ma , Peixi Peng , Guangyao Chen , Yifan Zhao , Siwei Dong , Yonghong Tian

Deep learning-based information processing consumes long time and requires huge computing resources, especially for dense prediction tasks which require an output for each pixel, like semantic segmentation and salient object detection.…

Machine Learning · Computer Science 2024-05-29 Xingyu Ding , Lianlei Shan , Guiqin Zhao , Meiqi Wu , Wenzhang Zhou , Wei Li

Deep neural networks (DNNs) have achieved great breakthroughs in many fields such as image classification and natural language processing. However, the execution of DNNs needs to conduct massive numbers of multiply-accumulate (MAC)…

Hardware Architecture · Computer Science 2024-11-07 Bo Liu , Grace Li Zhang , Xunzhao Yin , Ulf Schlichtmann , Bing Li

Network quantization is an effective method for the deployment of neural networks on memory and energy constrained mobile devices. In this paper, we propose a Dynamic Network Quantization (DNQ) framework which is composed of two modules: a…

Machine Learning · Computer Science 2018-12-07 Yuhui Xu , Shuai Zhang , Yingyong Qi , Jiaxian Guo , Weiyao Lin , Hongkai Xiong

Although convolutional neural networks (CNNs) are now widely used in various computer vision applications, its huge resource demanding on parameter storage and computation makes the deployment on mobile and embedded devices difficult.…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Zhe Xu , Ray C. C. Cheung

Currently, deep neural networks are deployed on low-power portable devices by first training a full-precision model using powerful hardware, and then deriving a corresponding low-precision model for efficient inference on such systems.…

Machine Learning · Computer Science 2017-11-15 Hao Li , Soham De , Zheng Xu , Christoph Studer , Hanan Samet , Tom Goldstein

Low-bit quantized neural networks are of great interest in practical applications because they significantly reduce the consumption of both memory and computational resources. Binary neural networks are memory and computationally efficient…

Machine Learning · Computer Science 2022-05-20 Anton Trusov , Elena Limonova , Dmitry Nikolaev , Vladimir V. Arlazarov