English
Related papers

Related papers: On the Acceleration of Deep Neural Network Inferen…

200 papers

Quantization has been proven to be a vital method for improving the inference efficiency of deep neural networks (DNNs). However, it is still challenging to strike a good balance between accuracy and efficiency while quantizing DNN weights…

Computer Vision and Pattern Recognition · Computer Science 2021-11-25 Cheng Gong , Ye Lu , Kunpeng Xie , Zongming Jin , Tao Li , Yanzhi Wang

Although convolutional neural network (CNN) has made great progress, large redundant parameters restrict its deployment on embedded devices, especially mobile devices. The recent compression works are focused on real-value convolutional…

Computer Vision and Pattern Recognition · Computer Science 2019-03-07 Jiasong Wu , Hongshan Ren , Youyong Kong , Chunfeng Yang , Lotfi Senhadji , Huazhong Shu

Quantization is a promising method that reduces memory usage and computational intensity of Deep Neural Networks (DNNs), but it often leads to significant output error that hinder model deployment. In this paper, we propose Bias…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Cheng Gong , Haoshuai Zheng , Mengting Hu , Zheng Lin , Deng-Ping Fan , Yuzhi Zhang , Tao Li

Binary Neural Networks (BNNs) enable efficient deep learning by saving on storage and computational costs. However, as the size of neural networks continues to grow, meeting computational requirements remains a challenge. In this work, we…

Machine Learning · Computer Science 2024-07-18 Matt Gorbett , Hossein Shirazi , Indrakshi Ray

To achieve higher accuracy in machine learning tasks, very deep convolutional neural networks (CNNs) are designed recently. However, the large memory access of deep CNNs will lead to high power consumption. A variety of hardware-friendly…

Image and Video Processing · Electrical Eng. & Systems 2021-06-25 Yubo Shi , Meiqi Wang , Siyi Chen , Jinghe Wei , Zhongfeng Wang

Compressed sensing (CS) is a powerful method routinely employed to accelerate image acquisition. It is particularly suited to situations when the image under consideration is sparse but can be sampled in a basis where it is non-sparse. Here…

Image and Video Processing · Electrical Eng. & Systems 2022-07-18 Xudong Lv , Ashok Ajoy

Quantitative susceptibility mapping (QSM) is an MRI phase-based post-processing method that quantifies tissue magnetic susceptibility distributions. However, QSM acquisitions are relatively slow, even with parallel imaging. Incoherent…

Image and Video Processing · Electrical Eng. & Systems 2021-07-20 Yang Gao , Martijn Cloos , Feng Liu , Stuart Crozier , G. Bruce Pike , Hongfu Sun

Deep learning and especially the use of Deep Neural Networks (DNNs) provides impressive results in various regression and classification tasks. However, to achieve these results, there is a high demand for computing and storing resources.…

Machine Learning · Computer Science 2021-07-21 Erion-Vasilis Pikoulis , Christos Mavrokefalidis , Aris S. Lalos

Quantum neural networks (QNNs) and quantum kernels stand as prominent figures in the realm of quantum machine learning, poised to leverage the nascent capabilities of near-term quantum computers to surmount classical machine learning…

Quantum Physics · Physics 2023-12-14 Yiming Huang , Huiyuan Wang , Yuxuan Du , Xiao Yuan

Compressive sensing is a signal processing technique that enables the reconstruction of sparse signals from a limited number of measurements, leveraging the signal's inherent sparsity to facilitate efficient recovery. Recent works on the…

Quantum Physics · Physics 2025-01-22 Naveed Naimipour , Collin Frink , Harry Shaw , Haleh Safavi , Mojtaba Soltanalian

Most real-world applications that employ deep neural networks (DNNs) quantize them to low precision to reduce the compute needs. We present a method to improve the robustness of quantized DNNs to white-box adversarial attacks. We first…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Saurabh Farkya , Aswin Raghavan , Avi Ziskind

In this paper, we investigate lossy compression of deep neural networks (DNNs) by weight quantization and lossless source coding for memory-efficient deployment. Whereas the previous work addressed non-universal scalar quantization and…

Computer Vision and Pattern Recognition · Computer Science 2019-02-22 Yoojin Choi , Mostafa El-Khamy , Jungwon Lee

Convolutional neural networks (CNNs) have become the dominant neural network architecture for solving visual processing tasks. One of the major obstacles hindering the ubiquitous use of CNNs for inference is their relatively high memory…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Chaim Baskin , Brian Chmiel , Evgenii Zheltonozhskii , Ron Banner , Alex M. Bronstein , Avi Mendelson

Deep Convolutional Neural Networks (CNN) have been successfully applied to many real-life problems. However, the huge memory cost of deep CNN models poses a great challenge of deploying them on memory-constrained devices (e.g., mobile…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Weichao Lan , Liang Lan

Deep neural networks (DNN) have achieved impressive success in multiple domains. Over the years, the accuracy of these models has increased with the proliferation of deeper and more complex architectures. Thus, state-of-the-art solutions…

Sound · Computer Science 2022-07-18 Anderson R. Avila , Khalil Bibi , Rui Heng Yang , Xinlin Li , Chao Xing , Xiao Chen

Quantized neural networks typically require smaller memory footprints and lower computation complexity, which is crucial for efficient deployment. However, quantization inevitably leads to a distribution divergence from the original…

Computer Vision and Pattern Recognition · Computer Science 2022-05-30 Runpei Dong , Zhanhong Tan , Mengdi Wu , Linfeng Zhang , Kaisheng Ma

Deep neural networks (DNNs) have demonstrated remarkable performance in many tasks but it often comes at a high computational cost and memory usage. Compression techniques, such as pruning and quantization, are applied to reduce the memory…

Machine Learning · Computer Science 2025-07-09 Kimia Soroush , Mohsen Raji , Behnam Ghavami

Deep Neural Networks (DNNs) have been shown to be vulnerable to adversarial attacks, wherein, a model gets fooled by applying slight perturbations on the input. With the advent of Internet-of-Things and the necessity to enable intelligence…

Machine Learning · Computer Science 2020-06-30 Priyadarshini Panda

Classification is at the core of data-driven prediction and decision-making, representing a fundamental task in supervised machine learning. Recently, several quantum machine learning algorithms that use quantum kernels as a measure of…

Quantum Physics · Physics 2024-08-12 Jungyun Lee , Daniel K. Park

Deep neural networks have significantly improved performance on a range of tasks with the increasing demand for computational resources, leaving deployment on low-resource devices (with limited memory and battery power) infeasible. Binary…

Machine Learning · Computer Science 2022-06-22 Aaqib Saeed