English
Related papers

Related papers: UFO: Unlocking Ultra-Efficient Quantized Private I…

200 papers

We present LBW-Net, an efficient optimization based method for quantization and training of the low bit-width convolutional neural networks (CNNs). Specifically, we quantize the weights to zero or powers of two by minimizing the Euclidean…

Machine Learning · Computer Science 2017-08-18 Penghang Yin , Shuai Zhang , Yingyong Qi , Jack Xin

Convolutional Neural Networks (CNNs) are computationally intensive, which limits their application on mobile devices. Their energy is dominated by the number of multiplies needed to perform the convolutions. Winograd's minimal filtering…

Computer Vision and Pattern Recognition · Computer Science 2018-02-20 Xingyu Liu , Jeff Pool , Song Han , William J. Dally

Convolutional Neural Networks (CNNs) achieve remarkable accuracy in vision tasks, yet their computational complexity challenges low-power edge deployment. In this work, we present COMET, a framework of CNN models that employ efficient…

Signal Processing · Electrical Eng. & Systems 2026-04-09 Boyang Chen , Mohd Tasleem Khan , George Goussetis , Mathini Sellathurai , Yuan Ding , João F. C. Mota , Jongeun Lee

Humans tend to mine objects by learning from a group of images or several frames of video since we live in a dynamic world. In the computer vision area, many researches focus on co-segmentation (CoS), co-saliency detection (CoSD) and video…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Yukun Su , Jingliang Deng , Ruizhou Sun , Guosheng Lin , Qingyao Wu

Deep convolutional neural networks (CNNs) are deployed in various applications but demand immense computational requirements. Pruning techniques and Winograd convolution are two typical methods to reduce the CNN computation. However, they…

Computer Vision and Pattern Recognition · Computer Science 2019-01-09 Jiecao Yu , Jongsoo Park , Maxim Naumov

The role of quantization within implicit/coordinate neural networks is still not fully understood. We note that using a canonical fixed quantization scheme during training produces poor performance at low-rates due to the network weight…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Cameron Gordon , Shin-Fang Chng , Lachlan MacDonald , Simon Lucey

Multi-source user representation learning plays a critical role in enabling personalized services on web platforms (e.g., Alipay). While prior works have adopted late-fusion strategies to combine heterogeneous data sources, they suffer from…

This paper explores the combination of neural network quantization and entropy coding for memory footprint minimization. Edge deployment of quantized models is hampered by the harsh Pareto frontier of the accuracy-to-bitwidth tradeoff,…

Machine Learning · Computer Science 2024-06-11 C. Metz , O. Bichler , A. Dupret

Neural network quantization aims to transform high-precision weights and activations of a given neural network into low-precision weights/activations for reduced memory usage and computation, while preserving the performance of the original…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Geon Park , Jaehong Yoon , Haiyang Zhang , Xing Zhang , Sung Ju Hwang , Yonina C. Eldar

Deep neural networks (DNNs) can be made hardware-efficient by reducing the numerical precision of the weights and activations of the network and by improving the network's resilience to noise. However, this gain in efficiency often comes at…

Despite the outstanding performance of transformers in both language and vision tasks, the expanding computation and model size have increased the demand for efficient deployment. To address the heavy computation and parameter drawbacks,…

Machine Learning · Computer Science 2024-10-15 Xijie Huang , Zhiqiang Shen , Pingcheng Dong , Kwang-Ting Cheng

Deep Convolutional Neural Networks have become a Swiss knife in solving critical artificial intelligence tasks. However, deploying deep CNN models for latency-critical tasks remains to be challenging because of the complex nature of CNNs.…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Chuanhao Zhuge , Xinheng Liu , Xiaofan Zhang , Sudeep Gummadi , Jinjun Xiong , Deming Chen

Recent convolutional neural network (CNN) development continues to advance the state-of-the-art model accuracy for various applications. However, the enhanced accuracy comes at the cost of substantial memory bandwidth and storage…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Hsu-Hsun Chin , Ren-Song Tsay , Hsin-I Wu

To achieve high accuracy, convolutional neural networks (CNNs) are increasingly growing in complexity and diversity in layer types and topologies. This makes it very challenging to efficiently deploy such networks on custom processor…

Systems and Control · Electrical Eng. & Systems 2024-06-21 Steven Colleman , Man Shi , Marian Verhelst

Network quantization significantly reduces model inference complexity and has been widely used in real-world deployments. However, most existing quantization methods have been developed mainly on Convolutional Neural Networks (CNNs), and…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Yang Lin , Tianyu Zhang , Peiqin Sun , Zheng Li , Shuchang Zhou

The widespread adoption of convolutional neural networks (CNNs) in resource-constrained scenarios has driven the development of Machine Learning as a Service (MLaaS) system. However, this approach is susceptible to privacy leakage, as the…

Cryptography and Security · Computer Science 2025-08-20 Jinyu Lu , Xinrong Sun , Yunting Tao , Tong Ji , Fanyu Kong , Guoqiang Yang

Quantized neural network (NN) with a reduced bit precision is an effective solution to reduces the computational and memory resource requirements and plays a vital role in machine learning. However, it is still challenging to avoid the…

Machine Learning · Computer Science 2020-10-23 Xiaobin Li , Hongxu Jiang , Shuangxi Huang , Fangzheng Tian

This paper examines the use of Quantized Neural Networks (QNNs) for two resource-constrained scientific applications: automated calibration of semi-conductor quantum bits (qubits) and scientific particle detectors. We evaluate the…

Convolutional Neural Networks (CNNs) are state-of-the-art in numerous computer vision tasks such as object classification and detection. However, the large amount of parameters they contain leads to a high computational complexity and…

Machine Learning · Computer Science 2019-01-01 Ghouthi Boukli Hacene , Vincent Gripon , Matthieu Arzel , Nicolas Farrugia , Yoshua Bengio

Small target detection in UAV imagery faces significant challenges such as scale variations, dense distribution, and the dominance of small targets. Existing algorithms rely on manually designed components, and general-purpose detectors are…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Yuankai Chen , Kai Lin , Qihong Wu , Xinxuan Yang , Jiashuo Lai , Ruoen Chen , Haonan Shi , Minfan He , Meihua Wang