English
Related papers

Related papers: Quantization and Compressive Sensing

200 papers

We introduce q-ary compressive sensing, an extension of 1-bit compressive sensing. We propose a novel sensing mechanism and a corresponding recovery procedure. The recovery properties of the proposed approach are analyzed both theoretically…

Information Theory · Computer Science 2013-02-22 Youssef Mroueh , Lorenzo Rosasco

This letter is focused on quantized Compressed Sensing, assuming that Lasso is used for signal estimation. Leveraging recent work, we provide a framework to optimize the quantization function and show that the recovered signal converges to…

Information Theory · Computer Science 2016-06-10 Xiaoyi Gu , Shenyinying Tu , Hao-Jun Michael Shi , Mindy Case , Deanna Needell , Yaniv Plan

Based on the model's resilience to computational noise, model quantization is important for compressing models and improving computing speed. Existing quantization techniques rely heavily on experience and "fine-tuning" skills. In the…

Machine Learning · Computer Science 2022-07-22 Daning Cheng , Wenguang Chen

Suppose that the collection $\{e_i\}_{i=1}^m$ forms a frame for $\R^k$, where each entry of the vector $e_i$ is a sub-Gaussian random variable. We consider expansions in such a frame, which are then quantized using a Sigma-Delta scheme. We…

Information Theory · Computer Science 2013-06-20 Felix Krahmer , Rayan Saab , Özgür Yılmaz

Compressive Sensing, as an emerging technique in signal processing is reviewed in this paper together with its common applications. As an alternative to the traditional signal sampling, Compressive Sensing allows a new acquisition strategy…

Information Theory · Computer Science 2017-05-16 Andjela Draganic , Irena Orovic , Srdjan Stankovic

Quantum computing has the potential to deliver large advantages on computational tasks, but advantages for practical tasks are not yet achievable with current hardware. Quantum sensing is an entirely separate quantum technology that can…

Quantum Physics · Physics 2025-07-24 Saeed A. Khan , Sridhar Prabhu , Logan G. Wright , Peter L. McMahon

This paper considers the problem of compressive sensing over a finite alphabet, where the finite alphabet may be inherent to the nature of the data or a result of quantization. There are multiple examples of finite alphabet based static as…

Information Theory · Computer Science 2013-03-19 Abhik Kumar Das , Sriram Vishwanath

The use of low-bit quantization has emerged as an indispensable technique for enabling the efficient training of large-scale models. Despite its widespread empirical success, a rigorous theoretical understanding of its impact on learning…

Machine Learning · Statistics 2026-02-17 Dechen Zhang , Junwei Su , Difan Zou

We consider the general problem of recovering a high-dimensional signal from noisy quantized measurements. Quantization, especially coarse quantization such as 1-bit sign measurements, leads to severe information loss and thus a good prior…

Signal Processing · Electrical Eng. & Systems 2023-02-21 Xiangming Meng , Yoshiyuki Kabashima

We study the average distortion introduced by scalar, vector, and entropy coded quantization of compressive sensing (CS) measurements. The asymptotic behavior of the underlying quantization schemes is either quantified exactly or…

Information Theory · Computer Science 2009-03-07 Wei Dai , Hoa Vinh Pham , Olgica Milenkovic

This paper addresses the challenges of storage and communication costs for large-scale datasets in resource-constrained edge devices by proposing a novel dataset quantization approach to reduce intra-sample redundancy. Unlike traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Chenyue Yu , Jianyu Yu

Efficient estimation of wideband spectrum is of great importance for applications such as cognitive radio. Recently, sub-Nyquist sampling schemes based on compressed sensing have been proposed to greatly reduce the sampling rate. However,…

Signal Processing · Electrical Eng. & Systems 2018-05-23 Haoyu Fu , Yuejie Chi

Compressed sensing (CS) is on recovery of high dimensional signals from their low dimensional linear measurements under a sparsity prior and digital quantization of the measurement data is inevitable in practical implementation of CS…

Information Theory · Computer Science 2016-08-24 Zai Yang , Lihua Xie , Cishen Zhang

Deep learning methods have established a significant place in image classification. While prior research has focused on enhancing final outcomes, the opaque nature of the decision-making process in these models remains a concern for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Elmira Mousa Rezabeyk , Salar Beigzad , Yasin Hamzavi , Mohsen Bagheritabar , Seyedeh Sogol Mirikhoozani

We present an end-to-end image compression system based on compressive sensing. The presented system integrates the conventional scheme of compressive sampling and reconstruction with quantization and entropy coding. The compression…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Xin Yuan , Raziel Haimi-Cohen

Compressed sensing (CS) is an emerging paradigm for acquisition of compressed representations of a sparse signal. Its low complexity is appealing for resource-constrained scenarios like sensor networks. However, such scenarios are often…

Information Theory · Computer Science 2015-03-31 Diego Valsesia , Giulio Coluccia , Enrico Magli

Scalar quantization is the most practical and straightforward approach to signal quantization. However, it has been shown that scalar quantization of oversampled or Compressively Sensed signals can be inefficient in terms of the…

Information Theory · Computer Science 2011-07-18 Petros T. Boufounos

We investigate information-theoretic limits and design of communication under receiver quantization. Unlike most existing studies, this work is more focused on the impact of resolution reduction from high to low. We consider a standard…

Information Theory · Computer Science 2025-12-29 Jing Zhou , Shuqin Pang , Wenyi Zhang

Quantization is essential for reducing the computational cost and memory usage of deep neural networks, enabling efficient inference on low-precision hardware. Despite the growing adoption of uniform and floating-point quantization schemes,…

Machine Learning · Statistics 2026-05-19 Mehmet Aktukmak , Daniel Huang , Ke Ding

Quantization is a promising technique for reducing the bit-width of deep models to improve their runtime performance and storage efficiency, and thus becomes a fundamental step for deployment. In real-world scenarios, quantized models are…

Machine Learning · Computer Science 2024-04-09 Qun Li , Yuan Meng , Chen Tang , Jiacheng Jiang , Zhi Wang