中文
相关论文

相关论文: ZOBNN: Zero-Overhead Dependable Design of Binary N…

200 篇论文

Though deep neural network models exhibit outstanding performance for various applications, their large model size and extensive floating-point operations render deployment on mobile computing platforms a major challenge, and, in…

密码学与安全 · 计算机科学 2022-08-04 Huming Qiu , Hua Ma , Zhi Zhang , Yifeng Zheng , Anmin Fu , Pan Zhou , Yansong Gao , Derek Abbott , Said F. Al-Sarawi

Convolutional neural networks have recently achieved significant breakthroughs in various image classification tasks. However, they are computationally expensive,which can make their feasible mplementation on embedded and low-power devices…

机器学习 · 计算机科学 2018-08-02 Mir Khan , Heikki Huttunen , Jani Boutellier

Effective employment of deep neural networks (DNNs) in mobile devices and embedded systems is hampered by requirements for memory and computational power. This paper presents a non-uniform quantization approach which allows for dynamic…

音频与语音处理 · 电气工程与系统科学 2019-11-05 Niccoló Nicodemo , Gaurav Naithani , Konstantinos Drossos , Tuomas Virtanen , Roberto Saletti

Binarized Neural Networks (BNNs) significantly reduce the computation and memory demands with binarized weights and activations compared to full-precision NNs. Executing a layer in a BNN on different devices of a heterogeneous…

分布式、并行与集群计算 · 计算机科学 2023-01-13 Leonard David Bereholschi , Ching-Chi Lin , Mikail Yayla , Jian-Jia Chen

Neural network binarization accelerates deep models by quantizing their weights and activations into 1-bit. However, there is still a huge performance gap between Binary Neural Networks (BNNs) and their full-precision (FP) counterparts. As…

计算机视觉与模式识别 · 计算机科学 2022-07-19 Yuzhang Shang , Dan Xu , Ziliang Zong , Liqiang Nie , Yan Yan

Quantized neural network (NN) with a reduced bit precision is an effective solution to reduces the computational and memory resource requirements and plays a vital role in machine learning. However, it is still challenging to avoid the…

机器学习 · 计算机科学 2020-10-23 Xiaobin Li , Hongxu Jiang , Shuangxi Huang , Fangzheng Tian

A key enabler of deploying convolutional neural networks on resource-constrained embedded systems is the binary neural network (BNN). BNNs save on memory and simplify computation by binarizing both features and weights. Unfortunately,…

机器学习 · 计算机科学 2023-10-19 Floran de Putter , Henk Corporaal

Binary neural network (BNN) provides a promising solution to deploy parameter-intensive deep single image super-resolution (SISR) models onto real devices with limited storage and computational resources. To achieve comparable performance…

计算机视觉与模式识别 · 计算机科学 2022-09-05 Zhiqiang Lang , Chongxing Song , Lei Zhang , Wei Wei

Quantized deep neural networks (QDNNs) are necessary for low-power, high throughput, and embedded applications. Previous studies mostly focused on developing optimization methods for the quantization of given models. However, quantization…

机器学习 · 计算机科学 2020-06-02 Yoonho Boo , Sungho Shin , Wonyong Sung

Binary Neural Network (BNN) shows its predominance in reducing the complexity of deep neural networks. However, it suffers severe performance degradation. One of the major impediments is the large quantization error between the…

计算机视觉与模式识别 · 计算机科学 2020-10-23 Mingbao Lin , Rongrong Ji , Zihan Xu , Baochang Zhang , Yan Wang , Yongjian Wu , Feiyue Huang , Chia-Wen Lin

For the efficient execution of deep convolutional neural networks (CNN) on edge devices, various approaches have been presented which reduce the bit width of the network parameters down to 1 bit. Binarization of the first layer was always…

机器学习 · 计算机科学 2018-12-11 Robert Dürichen , Thomas Rocznik , Oliver Renz , Christian Peters

Deep neural networks are gaining in popularity as they are used to generate state-of-the-art results for a variety of computer vision and machine learning applications. At the same time, these networks have grown in depth and complexity in…

神经与进化计算 · 计算机科学 2016-12-14 Soheil Hashemi , Nicholas Anthony , Hokchhay Tann , R. Iris Bahar , Sherief Reda

Deep neural networks (DNNs) have been demonstrated as effective prognostic models across various domains, e.g. natural language processing, computer vision, and genomics. However, modern-day DNNs demand high compute and memory storage for…

分布式、并行与集群计算 · 计算机科学 2019-03-27 Zachariah Carmichael , Hamed F. Langroudi , Char Khazanov , Jeffrey Lillie , John L. Gustafson , Dhireesha Kudithipudi

It is always well believed that Binary Neural Networks (BNNs) could drastically accelerate the inference efficiency by replacing the arithmetic operations in float-valued Deep Neural Networks (DNNs) with bit-wise operations. Nevertheless,…

计算机视觉与模式识别 · 计算机科学 2019-08-19 Jianhao Zhang , Yingwei Pan , Ting Yao , He Zhao , Tao Mei

Ternary Neural Networks (TNNs) have received much attention due to being potentially orders of magnitude faster in inference, as well as more power efficient, than full-precision counterparts. However, 2 bits are required to encode the…

机器学习 · 计算机科学 2021-07-30 Peng Chen , Bohan Zhuang , Chunhua Shen

For binary neural networks (BNNs) to become the mainstream on-device computer vision algorithm, they must achieve a superior speed-vs-accuracy tradeoff than 8-bit quantization and establish a similar degree of general applicability in…

计算机视觉与模式识别 · 计算机科学 2022-02-09 Guhong Nie , Lirui Xiao , Menglong Zhu , Dongliang Chu , Yue Shen , Peng Li , Kang Yang , Li Du , Bo Chen

Deep neural networks (DNNs) have been shown to tolerate "brain damage": cumulative changes to the network's parameters (e.g., pruning, numerical perturbations) typically result in a graceful degradation of classification accuracy. However,…

密码学与安全 · 计算机科学 2019-06-05 Sanghyun Hong , Pietro Frigo , Yiğitcan Kaya , Cristiano Giuffrida , Tudor Dumitraş

Deep neural networks have significantly improved performance on a range of tasks with the increasing demand for computational resources, leaving deployment on low-resource devices (with limited memory and battery power) infeasible. Binary…

机器学习 · 计算机科学 2022-06-22 Aaqib Saeed

The advent of deep learning has considerably accelerated machine learning development. The deployment of deep neural networks at the edge is however limited by their high memory and energy consumption requirements. With new memory…

Low-precision DNNs have been extensively explored in order to reduce the size of DNN models for edge devices. Recently, the posit numerical format has shown promise for DNN data representation and compute with ultra-low precision in…

机器学习 · 计算机科学 2019-08-08 Hamed F. Langroudi , Zachariah Carmichael , David Pastuch , Dhireesha Kudithipudi