中文
相关论文

相关论文: DQA: An Efficient Method for Deep Quantization of …

200 篇论文

Quantizing deep convolutional neural networks for image super-resolution substantially reduces their computational costs. However, existing works either suffer from a severe performance drop in ultra-low precision of 4 or lower bit-widths,…

计算机视觉与模式识别 · 计算机科学 2022-07-08 Cheeun Hong , Heewon Kim , Sungyong Baik , Junghun Oh , Kyoung Mu Lee

This paper aims at rapid deployment of the state-of-the-art deep neural networks (DNNs) to energy efficient accelerators without time-consuming fine tuning or the availability of the full datasets. Converting DNNs in full precision to…

神经与进化计算 · 计算机科学 2018-10-15 Jun Haeng Lee , Sangwon Ha , Saerom Choi , Won-Jo Lee , Seungwon Lee

Designing a deep neural network (DNN) with good generalization capability is a complex process especially when the weights are severely quantized. Model averaging is a promising approach for achieving the good generalization capability of…

机器学习 · 计算机科学 2020-02-04 Sungho Shin , Yoonho Boo , Wonyong Sung

The large computing and memory cost of deep neural networks (DNNs) often precludes their use in resource-constrained devices. Quantizing the parameters and operations to lower bit-precision offers substantial memory and energy savings for…

机器学习 · 计算机科学 2023-09-01 Clemens JS Schaefer , Siddharth Joshi , Shan Li , Raul Blazquez

Quantization of deep neural networks (DNN) has been proven effective for compressing and accelerating DNN models. Data-free quantization (DFQ) is a promising approach without the original datasets under privacy-sensitive and confidential…

机器学习 · 计算机科学 2022-02-16 Cong Guo , Yuxian Qiu , Jingwen Leng , Xiaotian Gao , Chen Zhang , Yunxin Liu , Fan Yang , Yuhao Zhu , Minyi Guo

Network quantization is an effective method for the deployment of neural networks on memory and energy constrained mobile devices. In this paper, we propose a Dynamic Network Quantization (DNQ) framework which is composed of two modules: a…

机器学习 · 计算机科学 2018-12-07 Yuhui Xu , Shuai Zhang , Yingyong Qi , Jiaxian Guo , Weiyao Lin , Hongkai Xiong

Quantization is essential for reducing the computational cost and memory usage of deep neural networks, enabling efficient inference on low-precision hardware. Despite the growing adoption of uniform and floating-point quantization schemes,…

机器学习 · 统计学 2026-05-19 Mehmet Aktukmak , Daniel Huang , Ke Ding

Model quantization is a widely used technique to compress and accelerate deep neural network (DNN) inference. Emergent DNN hardware accelerators begin to support mixed precision (1-8 bits) to further improve the computation efficiency,…

计算机视觉与模式识别 · 计算机科学 2020-08-14 Kuan Wang , Zhijian Liu , Yujun Lin , Ji Lin , Song Han

With unprecedented rapid development, deep neural networks (DNNs) have deeply influenced almost all fields. However, their heavy computation costs and model sizes are usually unacceptable in real-world deployment. Model quantization, an…

It has been proven that, compared to using 32-bit floating-point numbers in the training phase, Deep Convolutional Neural Networks (DCNNs) can operate with low precision during inference, thereby saving memory space and power consumption.…

人工智能 · 计算机科学 2022-10-03 Binyi Wu , Bernd Waschneck , Christian Georg Mayr

Deep neural networks have been proven to be highly effective tools in various domains, yet their computational and memory costs restrict them from being widely deployed on portable devices. The recent rapid increase of edge computing…

神经与进化计算 · 计算机科学 2023-06-01 Ayan Shymyrbay , Mohammed E. Fouda , Ahmed Eltawil

Deep neural networks (DNNs) are nowadays ubiquitous in many domains such as computer vision. However, due to their high latency, the deployment of DNNs hinges on the development of compression techniques such as quantization which consists…

计算机视觉与模式识别 · 计算机科学 2023-01-25 Edouard Yvinec , Arnaud Dapogny , Matthieu Cord , Kevin Bailly

With the tremendous success of deep learning, there exists imminent need to deploy deep learning models onto edge devices. To tackle the limited computing and storage resources in edge devices, model compression techniques have been widely…

机器学习 · 计算机科学 2020-10-20 Sung-En Chang , Yanyu Li , Mengshu Sun , Weiwen Jiang , Runbin Shi , Xue Lin , Yanzhi Wang

Quantization is commonly used in Deep Neural Networks (DNNs) to reduce the storage and computational complexity by decreasing the arithmetical precision of activations and weights, a.k.a. tensors. Efficient hardware architectures employ…

机器学习 · 计算机科学 2023-11-23 Bahareh Khabbazan , Marc Riera , Antonio González

Quantization is a technique used in deep neural networks (DNNs) to increase execution performance and hardware efficiency. Uniform post-training quantization (PTQ) methods are common, since they can be implemented efficiently in hardware…

机器学习 · 计算机科学 2021-10-29 Gil Shomron , Freddy Gabbay , Samer Kurzum , Uri Weiser

We present an overview of techniques for quantizing convolutional neural networks for inference with integer weights and activations. Per-channel quantization of weights and per-layer quantization of activations to 8-bits of precision…

机器学习 · 计算机科学 2018-06-22 Raghuraman Krishnamoorthi

Effective employment of deep neural networks (DNNs) in mobile devices and embedded systems is hampered by requirements for memory and computational power. This paper presents a non-uniform quantization approach which allows for dynamic…

音频与语音处理 · 电气工程与系统科学 2019-11-05 Niccoló Nicodemo , Gaurav Naithani , Konstantinos Drossos , Tuomas Virtanen , Roberto Saletti

Deep neural networks (DNNs) are essential for performing advanced tasks on edge or mobile devices, yet their deployment is often hindered by severe resource constraints, including limited memory, energy, and computational power. While…

机器学习 · 计算机科学 2026-03-04 Qunyou Liu , Pengbo Yu , Marina Zapater , David Atienza

Deep Convolutional Neural Networks (DCNNs) are currently popular in human activity recognition applications. However, in the face of modern artificial intelligence sensor-based games, many research achievements cannot be practically applied…

机器学习 · 计算机科学 2018-12-05 Zhan Yang , Osolo Ian Raymond , ChengYuan Zhang , Ying Wan , Jun Long

To accelerate and compress deep neural networks (DNNs), many network quantization algorithms have been proposed. Although the quantization strategy of any algorithm from the state-of-the-arts may outperform others in some network…

机器学习 · 计算机科学 2024-04-16 Lianqiang Li , Chenqian Yan , Yefei Chen