English
Related papers

Related papers: A High-Performance Adaptive Quantization Approach …

200 papers

We present LBW-Net, an efficient optimization based method for quantization and training of the low bit-width convolutional neural networks (CNNs). Specifically, we quantize the weights to zero or powers of two by minimizing the Euclidean…

Machine Learning · Computer Science 2017-08-18 Penghang Yin , Shuai Zhang , Yingyong Qi , Jack Xin

The rise of power-efficient embedded computers based on highly-parallel accelerators opens a number of opportunities and challenges for researchers and engineers, and paved the way to the era of edge computing. At the same time, advances in…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-13 Paolo Burgio , Gianluca Brilli

Deep neural networks (DNNs) are ubiquitous in computer vision and natural language processing, but suffer from high inference cost. This problem can be addressed by quantization, which consists in converting floating point perations into a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Edouard Yvinec , Arnaud Dapogny , Kevin Bailly

Quantization is a promising method that reduces memory usage and computational intensity of Deep Neural Networks (DNNs), but it often leads to significant output error that hinder model deployment. In this paper, we propose Bias…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Cheng Gong , Haoshuai Zheng , Mengting Hu , Zheng Lin , Deng-Ping Fan , Yuzhi Zhang , Tao Li

Parameter quantization in convolutional neural networks (CNNs) can help generate efficient models with lower memory footprint and computational complexity. But, homogeneous quantization can result in significant degradation of CNN model…

Hardware Architecture · Computer Science 2022-05-24 Febin Sunny , Mahdi Nikdast , Sudeep Pasricha

As the volume of image data grows, data-oriented cloud computing in Internet of Video Things (IoVT) systems encounters latency issues. Task-oriented edge computing addresses this by shifting data analysis to the edge. However, limited…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Jiaqi Wu , Simin Chen , Zehua Wang , Wei Chen , Zijian Tian , F. Richard Yu , Victor C. M. Leung

Edge computing is promising to become one of the next hottest topics in artificial intelligence because it benefits various evolving domains such as real-time unmanned aerial systems, industrial applications, and the demand for privacy…

Machine Learning · Computer Science 2020-12-01 Wenyu Zhao , Teli Ma , Xuan Gong , Baochang Zhang , David Doermann

Model compression is vital to the deployment of deep learning on edge devices. Low precision representations, achieved via quantization of weights and activations, can reduce inference time and memory requirements. However, quantifying and…

Machine Learning · Computer Science 2022-10-18 Ben Zandonati , Adrian Alan Pol , Maurizio Pierini , Olya Sirkin , Tal Kopetz

With the rapid proliferation of Internet of Things and intelligent edge devices, there is an increasing need for implementing machine learning algorithms, including deep learning, on resource-constrained mobile embedded devices with limited…

Machine Learning · Computer Science 2017-01-05 Wenjia Meng , Zonghua Gu , Ming Zhang , Zhaohui Wu

Computer-aided diagnosis (CAD) based on histopathological imaging has progressed rapidly in recent years with the rise of machine learning based methodologies. Traditional approaches consist of training a classification model using features…

Computer Vision and Pattern Recognition · Computer Science 2019-03-29 Junaid Malik , Serkan Kiranyaz , Suchitra Kunhoth , Turker Ince , Somaya Al-Maadeed , Ridha Hamila , Moncef Gabbouj

Convolutional neural network (CNN) is widely used in computer vision applications. In the networks that deal with images, CNNs are the most time-consuming layer of the networks. Usually, the solution to address the computation cost is to…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Meisam Rakhshanfar

The `Internet of Things' has brought increased demand for AI-based edge computing in applications ranging from healthcare monitoring systems to autonomous vehicles. Quantization is a powerful tool to address the growing computational cost…

Machine Learning · Computer Science 2020-02-18 Indranil Chakraborty , Deboleena Roy , Isha Garg , Aayush Ankit , Kaushik Roy

In order to enhance the real-time performance of convolutional neural networks(CNNs), more and more researchers are focusing on improving the efficiency of CNN. Based on the analysis of some CNN architectures, such as ResNet, DenseNet,…

Computer Vision and Pattern Recognition · Computer Science 2018-03-16 Qiuyu Zhu , Ruixin Zhang

Medical image segmentation plays a vital role in various clinical applications, enabling accurate delineation and analysis of anatomical structures or pathological regions. Traditional CNNs have achieved remarkable success in this field.…

Image and Video Processing · Electrical Eng. & Systems 2024-04-18 Seyed M. R. Modaresi , Aomar Osmani , Mohammadreza Razzazi , Abdelghani Chibani

As Large Language Models (LLMs) demonstrate exceptional performance across various domains, deploying LLMs on edge devices has emerged as a new trend. Quantization techniques, which reduce the size and memory requirements of LLMs, are…

Computation and Language · Computer Science 2025-05-07 Binrui Zeng , Bin Ji , Xiaodong Liu , Jie Yu , Shasha Li , Jun Ma , Xiaopeng Li , Shangwen Wang , Xinran Hong , Yongtao Tang

Deep Neural Networks (DNNs) and Convolutional Neural Networks (CNNs) are useful for many practical tasks in machine learning. Synaptic weights, as well as neuron activation functions within the deep network are typically stored with…

Machine Learning · Computer Science 2017-11-15 Moritz B. Milde , Daniel Neil , Alessandro Aimar , Tobi Delbruck , Giacomo Indiveri

Adder Neural Network (AdderNet) provides a new way for developing energy-efficient neural networks by replacing the expensive multiplications in convolution with cheaper additions (i.e.l1-norm). To achieve higher hardware efficiency, it is…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Ying Nie , Kai Han , Haikang Diao , Chuanjian Liu , Enhua Wu , Yunhe Wang

Convolutional neural networks (CNNs) achieve remarkable performance in a wide range of fields. However, intensive memory access of activations introduces considerable energy consumption, impeding deployment of CNNs on resourceconstrained…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Yu-Shan Tai , Chieh-Fang Teng , Cheng-Yang Chang , An-Yeu Wu

Quantization for deep neural networks (DNN) have enabled developers to deploy models with less memory and more efficient low-power inference. However, not all DNN designs are friendly to quantization. For example, the popular Mobilenet…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Thu Dinh , Andrey Melnikov , Vasilios Daskalopoulos , Sek Chai

The training of deep neural networks (DNNs) always requires intensive resources for both computation and data storage. Thus, DNNs cannot be efficiently applied to mobile phones and embedded devices, which severely limits their applicability…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Qigong Sun , Xiufang Li , Fanhua Shang , Hongying Liu , Kang Yang , Licheng Jiao , Zhouchen Lin