English
Related papers

Related papers: Evolutionary fine tuning of quantized convolution-…

200 papers

Convolutional Neural Networks (CNN) are widely used to face challenging tasks like speech recognition, natural language processing or computer vision. As CNN architectures get larger and more complex, their computational requirements…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Luis Balderas , Miguel Lastra , José M. Benítez

Transformer based large language models have achieved tremendous success. However, the significant memory and computational costs incurred during the inference process make it challenging to deploy large models on resource-constrained…

Computation and Language · Computer Science 2024-02-16 Wenxiao Wang , Wei Chen , Yicong Luo , Yongliu Long , Zhengkai Lin , Liye Zhang , Binbin Lin , Deng Cai , Xiaofei He

Neural network quantization is becoming an industry standard to efficiently deploy deep learning models on hardware platforms, such as CPU, GPU, TPU, and FPGAs. However, we observe that the conventional quantization approaches are…

Machine Learning · Computer Science 2019-04-19 Ji Lin , Chuang Gan , Song Han

Overparameterized networks trained to convergence have shown impressive performance in domains such as computer vision and natural language processing. Pushing state of the art on salient tasks within these domains corresponds to these…

Machine Learning · Computer Science 2020-08-04 James O' Neill

State-of-the-art deep neural networks are trained with large amounts (millions or even billions) of data. The expensive computation and memory costs make it difficult to train them on limited hardware resources, especially for recent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Daquan Zhou , Kai Wang , Jianyang Gu , Xiangyu Peng , Dongze Lian , Yifan Zhang , Yang You , Jiashi Feng

Fixed-point optimization of deep neural networks plays an important role in hardware based design and low-power implementations. Many deep neural networks show fairly good performance even with 2- or 3-bit precision when quantized weights…

Machine Learning · Computer Science 2017-02-28 Sungho Shin , Yoonho Boo , Wonyong Sung

Owing to flexible architectures of deep convolutional neural networks (CNNs), CNNs are successfully used for image denoising. However, they suffer from the following drawbacks: (i) deep network architecture is very difficult to train. (ii)…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Chunwei Tian , Yong Xu , Lunke Fei , Junqian Wang , Jie Wen , Nan Luo

Mixed-precision Deep Neural Networks achieve the energy efficiency and throughput needed for hardware deployment, particularly when the resources are limited, without sacrificing accuracy. However, the optimal per-layer bit precision that…

Machine Learning · Computer Science 2022-08-15 Mariam Rakka , Mohammed E. Fouda , Pramod Khargonekar , Fadi Kurdahi

The practical deployment of diffusion models is still hindered by the high memory and computational overhead. Although quantization paves a way for model compression and acceleration, existing methods face challenges in achieving low-bit…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Haoxuan Wang , Yuzhang Shang , Zhihang Yuan , Junyi Wu , Junchi Yan , Yan Yan

While neural networks have advanced the frontiers in many machine learning applications, they often come at a high computational cost. Reducing the power and latency of neural network inference is vital to integrating modern networks into…

Machine Learning · Computer Science 2022-01-24 Sangeetha Siddegowda , Marios Fournarakis , Markus Nagel , Tijmen Blankevoort , Chirag Patel , Abhijit Khobare

The recent advancement in deep learning (DL) for automatic modulation classification (AMC) of wireless signals has encouraged numerous possible applications on resource-constrained edge devices. However, developing optimized DL models…

Signal Processing · Electrical Eng. & Systems 2024-04-25 Nayan Moni Baishya , B. R. Manoj , Prabin K. Bora

Convolutional neural networks (CNNs) have shown great capability of solving various artificial intelligence tasks. However, the increasing model size has raised challenges in employing them in resource-limited applications. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Hongyang Gao , Zhengyang Wang , Shuiwang Ji

Many studies have been done to prove the vulnerability of neural networks to adversarial example. A trained and well-behaved model can be fooled by a visually imperceptible perturbation, i.e., an originally correctly classified image could…

Computer Vision and Pattern Recognition · Computer Science 2019-06-24 YiGui Luo , RuiJia Yang , Wei Sha , WeiYi Ding , YouTeng Sun , YiSi Wang

We present an overview of techniques for quantizing convolutional neural networks for inference with integer weights and activations. Per-channel quantization of weights and per-layer quantization of activations to 8-bits of precision…

Machine Learning · Computer Science 2018-06-22 Raghuraman Krishnamoorthi

As Deep Neural Networks (DNNs) rapidly advance in various fields, including speech verification, they typically involve high computational costs and substantial memory consumption, which can be challenging to manage on mobile systems.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-15 Yeona Hong , Woo-Jin Chung , Hong-Goo Kang

Convolution is the core operation for many deep neural networks. The Winograd convolution algorithms have been shown to accelerate the widely-used small convolution sizes. Quantized neural networks can effectively reduce model sizes and…

Neural and Evolutionary Computing · Computer Science 2019-01-09 Lingchuan Meng , John Brothers

Deep operator network (DeepONet) has demonstrated great success in various learning tasks, including learning solution operators of partial differential equations. In particular, it provides an efficient approach to predict the evolution…

Machine Learning · Computer Science 2022-12-12 Wuzhe Xu , Yulong Lu , Li Wang

Machine Learning algorithms have been extensively researched throughout the last decade, leading to unprecedented advances in a broad range of applications, such as image classification and reconstruction, object recognition, and text…

Artificial Intelligence · Computer Science 2022-12-20 Gustavo H. de Rosa , Mateus Roder , João Paulo Papa , Claudio F. G. dos Santos

Recently, transformer has achieved remarkable performance on a variety of computer vision applications. Compared with mainstream convolutional neural networks, vision transformers are often of sophisticated architectures for extracting…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Zhenhua Liu , Yunhe Wang , Kai Han , Siwei Ma , Wen Gao

Medical image classification is a critical task in healthcare, enabling accurate and timely diagnosis. However, deploying deep learning models on resource-constrained edge devices presents significant challenges due to computational and…

Image and Video Processing · Electrical Eng. & Systems 2025-12-30 Mahsa Lavaei , Zahra Abadi , Salar Beigzad , Alireza Maleki