中文
相关论文

相关论文: DQA: An Efficient Method for Deep Quantization of …

200 篇论文

Model quantization is challenging due to many tedious hyper-parameters such as precision (bitwidth), dynamic range (minimum and maximum discrete values) and stepsize (interval between discrete values). Unlike prior arts that carefully tune…

机器学习 · 计算机科学 2021-07-08 Zhang Zhaoyang , Shao Wenqi , Gu Jinwei , Wang Xiaogang , Luo Ping

The deep layers of modern neural networks extract a rather rich set of features as an input propagates through the network. This paper sets out to harvest these rich intermediate representations for quantization with minimal accuracy loss…

机器学习 · 计算机科学 2020-03-04 Ahmed T. Elthakeb , Prannoy Pilligundla , Alex Cloninger , Hadi Esmaeilzadeh

Quantization of the weights and activations is one of the main methods to reduce the computational footprint of Deep Neural Networks (DNNs) training. Current methods enable 4-bit quantization of the forward phase. However, this constitutes…

机器学习 · 计算机科学 2024-06-11 Brian Chmiel , Ron Banner , Elad Hoffer , Hilla Ben Yaacov , Daniel Soudry

Processing visual data on mobile devices has many applications, e.g., emergency response and tracking. State-of-the-art computer vision techniques rely on large Deep Neural Networks (DNNs) that are usually too power-hungry to be deployed on…

计算机视觉与模式识别 · 计算机科学 2023-09-06 Ishmeet Kaur , Adwaita Janardhan Jadhav

Deep convolutional neural network (DCNN) has achieved remarkable performance on object detection and speech recognition in recent years. However, the excellent performance of a DCNN incurs high computational complexity and large memory…

计算机视觉与模式识别 · 计算机科学 2016-08-09 Fangxuan Sun , Jun Lin , Zhongfeng Wang

As Deep Neural Networks (DNNs) rapidly advance in various fields, including speech verification, they typically involve high computational costs and substantial memory consumption, which can be challenging to manage on mobile systems.…

音频与语音处理 · 电气工程与系统科学 2024-07-15 Yeona Hong , Woo-Jin Chung , Hong-Goo Kang

While neural networks have advanced the frontiers in many applications, they often come at a high computational cost. Reducing the power and latency of neural network inference is key if we want to integrate modern networks into edge…

Convolutional Neural Networks (CNNs) have proven to be a powerful state-of-the-art method for image classification tasks. One drawback however is the high computational complexity and high memory consumption of CNNs which makes them…

计算机视觉与模式识别 · 计算机科学 2021-02-04 Rishabh Goyal , Joaquin Vanschoren , Victor van Acht , Stephan Nijssen

In today's era of smart cyber-physical systems, Deep Neural Networks (DNNs) have become ubiquitous due to their state-of-the-art performance in complex real-world applications. The high computational complexity of these networks, which…

Deep convolutional networks have recently achieved great success in video recognition, yet their practical realization remains a challenge due to the large amount of computational resources required to achieve robust recognition. Motivated…

计算机视觉与模式识别 · 计算机科学 2021-08-25 Ximeng Sun , Rameswar Panda , Chun-Fu Chen , Aude Oliva , Rogerio Feris , Kate Saenko

Recent convolutional neural network (CNN) development continues to advance the state-of-the-art model accuracy for various applications. However, the enhanced accuracy comes at the cost of substantial memory bandwidth and storage…

计算机视觉与模式识别 · 计算机科学 2021-07-20 Hsu-Hsun Chin , Ren-Song Tsay , Hsin-I Wu

Deep neural networks (DNNs) are successful in many computer vision tasks. However, the most accurate DNNs require millions of parameters and operations, making them energy, computation and memory intensive. This impedes the deployment of…

计算机视觉与模式识别 · 计算机科学 2020-03-26 Abhinav Goel , Caleb Tung , Yung-Hsiang Lu , George K. Thiruvathukal

Deep neural networks are the state-of-the-art methods for many real-world tasks, such as computer vision, natural language processing and speech recognition. For all its popularity, deep neural networks are also criticized for consuming a…

机器学习 · 计算机科学 2018-12-18 Yunhui Guo

Low-precision representation of deep neural networks (DNNs) is critical for efficient deployment of deep learning application on embedded platforms, however, converting the network to low precision degrades its performance. Crucially,…

机器学习 · 计算机科学 2019-06-10 Alexander Finkelstein , Uri Almog , Mark Grobman

Dense depth prediction deep neural networks (DNN) have achieved impressive results for both monocular and binocular data, but still they are limited by high computational complexity, restricting their use on low-end devices. For better…

计算机视觉与模式识别 · 计算机科学 2025-10-21 Mykhailo Uss , Ruslan Yermolenko , Oleksii Shashko , Olena Kolodiazhna , Ivan Safonov , Volodymyr Savin , Yoonjae Yeo , Seowon Ji , Jaeyun Jeong

Deep neural networks, while achieving remarkable success across diverse tasks, demand significant resources, including computation, GPU memory, bandwidth, storage, and energy. Network quantization, as a standard compression and acceleration…

计算机视觉与模式识别 · 计算机科学 2025-07-09 Minghao Fu , Hao Yu , Jie Shao , Junjie Zhou , Ke Zhu , Jianxin Wu

This paper presents incremental network quantization (INQ), a novel method, targeting to efficiently convert any pre-trained full-precision convolutional neural network (CNN) model into a low-precision version whose weights are constrained…

计算机视觉与模式识别 · 计算机科学 2017-08-28 Aojun Zhou , Anbang Yao , Yiwen Guo , Lin Xu , Yurong Chen

This work targets the commonly used FPGA (field-programmable gate array) devices as the hardware platform for DNN edge computing. We focus on DNN quantization as the main model compression technique. The novelty of this work is: We use a…

机器学习 · 计算机科学 2021-11-02 Sung-En Chang , Yanyu Li , Mengshu Sun , Yanzhi Wang , Xue Lin

Deep neural networks (DNNs) have demonstrated their effectiveness in a wide range of computer vision tasks, with the state-of-the-art results obtained through complex and deep structures that require intensive computation and memory.…

神经与进化计算 · 计算机科学 2022-03-24 Ahmad Shawahna , Sadiq M. Sait , Aiman El-Maleh , Irfan Ahmad

The imperative to deploy Deep Neural Network (DNN) models on resource-constrained edge devices, spurred by privacy concerns, has become increasingly apparent. To facilitate the transition from cloud to edge computing, this paper introduces…

机器学习 · 计算机科学 2024-04-05 Behnam Ghavami , Amin Kamjoo , Lesley Shannon , Steve Wilton