English
Related papers

Related papers: RedBit: An End-to-End Flexible Framework for Evalu…

200 papers

Quantizing deep networks with adaptive bit-widths is a promising technique for efficient inference across many devices and resource constraints. In contrast to static methods that repeat the quantization process and train different models…

Computer Vision and Pattern Recognition · Computer Science 2021-09-20 Ximeng Sun , Rameswar Panda , Chun-Fu Chen , Naigang Wang , Bowen Pan , Kailash Gopalakrishnan , Aude Oliva , Rogerio Feris , Kate Saenko

Despite breakthrough advances in image super-resolution (SR) with convolutional neural networks (CNNs), SR has yet to enjoy ubiquitous applications due to the high computational complexity of SR networks. Quantization is one of the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Cheeun Hong , Sungyong Baik , Heewon Kim , Seungjun Nah , Kyoung Mu Lee

In recent years Deep Neural Networks (DNNs) have been rapidly developed in various applications, together with increasingly complex architectures. The performance gain of these DNNs generally comes with high computational costs and large…

Machine Learning · Computer Science 2017-12-05 Yiren Zhou , Seyed-Mohsen Moosavi-Dezfooli , Ngai-Man Cheung , Pascal Frossard

Quantized neural networks (QNNs) are among the main approaches for deploying deep neural networks on low resource edge devices. Training QNNs using different levels of precision throughout the network (dynamic quantization) typically…

Machine Learning · Computer Science 2021-02-19 Benjamin J. Bodner , Gil Ben Shalom , Eran Treister

In recent years increasingly complex architectures for deep convolution networks (DCNs) have been proposed to boost the performance on image recognition tasks. However, the gains in performance have come at a cost of substantial increase in…

Machine Learning · Computer Science 2016-06-03 Darryl D. Lin , Sachin S. Talathi , V. Sreekanth Annapureddy

Deep neural networks have been applied in many applications exhibiting extraordinary abilities in the field of computer vision. However, complex network architectures challenge efficient real-time deployment and require significant…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Tailin Liang , John Glossner , Lei Wang , Shaobo Shi , Xiaotong Zhang

The sensitivity of deep neural networks to compressed images hinders their usage in many real applications, which means classification networks may fail just after taking a screenshot and saving it as a compressed file. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Li Ma , Peixi Peng , Guangyao Chen , Yifan Zhao , Siwei Dong , Yonghong Tian

Recently, convolutional neural networks (CNN) have demonstrated impressive performance in various computer vision tasks. However, high performance hardware is typically indispensable for the application of CNN models due to the high…

Computer Vision and Pattern Recognition · Computer Science 2016-05-17 Jiaxiang Wu , Cong Leng , Yuhang Wang , Qinghao Hu , Jian Cheng

Deep learning methods have established a significant place in image classification. While prior research has focused on enhancing final outcomes, the opaque nature of the decision-making process in these models remains a concern for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Elmira Mousa Rezabeyk , Salar Beigzad , Yasin Hamzavi , Mohsen Bagheritabar , Seyedeh Sogol Mirikhoozani

Learning convolutional neural networks (CNNs) with low bitwidth is challenging because performance may drop significantly after quantization. Prior arts often discretize the network weights by carefully tuning hyper-parameters of…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Chaofan Tao , Rui Lin , Quan Chen , Zhaoyang Zhang , Ping Luo , Ngai Wong

Efficient model inference is an important and practical issue in the deployment of deep neural network on resource constraint platforms. Network quantization addresses this problem effectively by leveraging low-bit representation and…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Tianshu Chu , Qin Luo , Jie Yang , Xiaolin Huang

We present LBW-Net, an efficient optimization based method for quantization and training of the low bit-width convolutional neural networks (CNNs). Specifically, we quantize the weights to zero or powers of two by minimizing the Euclidean…

Machine Learning · Computer Science 2017-08-18 Penghang Yin , Shuai Zhang , Yingyong Qi , Jack Xin

In this paper, we study 1-bit convolutional neural networks (CNNs), of which both the weights and activations are binary. While efficient, the lacking of representational capability and the training difficulty impede 1-bit CNNs from…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Zechun Liu , Wenhan Luo , Baoyuan Wu , Xin Yang , Wei Liu , Kwang-Ting Cheng

Quantized Neural Networks (QNNs) are often used to improve network efficiency during the inference phase, i.e. after the network has been trained. Extensive research in the field suggests many different quantization schemes. Still, the…

Machine Learning · Computer Science 2018-06-19 Ron Banner , Itay Hubara , Elad Hoffer , Daniel Soudry

Quantization for deep neural networks have afforded models for edge devices that use less on-board memory and enable efficient low-power inference. In this paper, we present a comparison of model-parameter driven quantization approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-10-14 Prateeth Nayak , David Zhang , Sek Chai

The quantization of neural networks for the mitigation of the nonlinear and components' distortions in dual-polarization optical fiber transmission is studied. Two low-complexity neural network equalizers are applied in three 16-QAM 34.4…

Signal Processing · Electrical Eng. & Systems 2023-10-11 Jamal Darweesh , Nelson Costa , Antonio Napoli , Bernhard Spinnler , Yves Jaouen , Mansoor Yousefi

Quantization Neural Networks (QNN) have attracted a lot of attention due to their high efficiency. To enhance the quantization accuracy, prior works mainly focus on designing advanced quantization algorithms but still fail to achieve…

Computer Vision and Pattern Recognition · Computer Science 2021-09-29 Mingzhu Shen , Feng Liang , Ruihao Gong , Yuhang Li , Chuming Li , Chen Lin , Fengwei Yu , Junjie Yan , Wanli Ouyang

Efficient deep neural network (DNN) inference on mobile or embedded devices typically involves quantization of the network parameters and activations. In particular, mixed precision networks achieve better performance than networks with…

This paper presents a novel network compression framework Kernel Quantization (KQ), targeting to efficiently convert any pre-trained full-precision convolutional neural network (CNN) model into a low-precision version without significant…

Machine Learning · Computer Science 2020-03-12 Zhongzhi Yu , Yemin Shi , Tiejun Huang , Yizhou Yu

Radar sensors are crucial for environment perception of driver assistance systems as well as autonomous vehicles. With a rising number of radar sensors and the so far unregulated automotive radar frequency band, mutual interference is…

Signal Processing · Electrical Eng. & Systems 2022-01-26 Johanna Rock , Wolfgang Roth , Mate Toth , Paul Meissner , Franz Pernkopf