English
Related papers

Related papers: Channel-Optimized Vector Quantizer Design for Comp…

200 papers

A new framework of compressive sensing (CS), namely statistical compressive sensing (SCS), that aims at efficiently sampling a collection of signals that follow a statistical distribution and achieving accurate reconstruction on average, is…

Computer Vision and Pattern Recognition · Computer Science 2010-10-22 Guoshen Yu , Guillermo Sapiro

Compressed Sensing decoding algorithms can efficiently recover an N dimensional real-valued vector x to within a factor of its best k-term approximation by taking m = 2klog(N/k) measurements y = Phi x. If the sparsity or approximate…

Numerical Analysis · Mathematics 2008-12-09 Rachel Ward

We provide the first analysis of a non-trivial quantization scheme for compressed sensing measurements arising from structured measurements. Specifically, our analysis studies compressed sensing matrices consisting of rows selected at…

Information Theory · Computer Science 2017-02-16 Joe-Mei Feng , Felix Krahmer , Rayan Saab

Spatio-temporal forecasting is crucial in various fields and requires a careful balance between identifying subtle patterns and filtering out noise. Vector quantization (VQ) appears well-suited for this purpose, as it quantizes input…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Chao Chen , Tian Zhou , Yanjun Zhao , Hui Liu , Liang Sun , Rong Jin

We provide the optimal measurement strategy for a class of noisy channels that reduce to the identity channel for a specific value of a parameter (spreading channels). We provide an example that is physically relevant: the estimation of the…

Quantum Physics · Physics 2022-12-21 Wojciech Górecki , Alberto Riccardi , Lorenzo Maccone

Vector quantization(VQ) is a hardware-friendly DNN compression method that can reduce the storage cost and weight-loading datawidth of hardware accelerators. However, conventional VQ techniques lead to significant accuracy loss because the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Shuaiting Li , Chengxuan Wang , Juncan Deng , Zeyu Wang , Zewen Ye , Zongsheng Wang , Haibin Shen , Kejie Huang

Vector quantization, a problem rooted in Shannon's source coding theory, aims to quantize high-dimensional Euclidean vectors while minimizing distortion in their geometric structure. We propose TurboQuant to address both mean-squared error…

Machine Learning · Computer Science 2025-04-29 Amir Zandieh , Majid Daliri , Majid Hadian , Vahab Mirrokni

Compressing large neural networks is an important step for their deployment in resource-constrained computational platforms. In this context, vector quantization is an appealing framework that expresses multiple parameters using a single…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Julieta Martinez , Jashan Shewakramani , Ting Wei Liu , Ioan Andrei Bârsan , Wenyuan Zeng , Raquel Urtasun

We identify a practical vector quantizer design problem where any fixed-length quantizer (FLQ) yields non-zero distortion at any finite rate, while there is a variable-length quantizer (VLQ) that can achieve zero distortion with arbitrarily…

Information Theory · Computer Science 2012-11-01 Erdem Koyuncu , Hamid Jafarkhani

In this paper we study the problem of recovering sparse or compressible signals from uniformly quantized measurements. We present a new class of convex optimization programs, or decoders, coined Basis Pursuit DeQuantizer of moment $p$…

Optimization and Control · Mathematics 2015-03-13 Laurent Jacques , David K. Hammond , M. Jalal Fadili

Vector Quantization (VQ) is an appealing model compression method to obtain a tiny model with less accuracy loss. While methods to obtain better codebooks and codes under fixed clustering dimensionality have been extensively studied,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Zezhou Zhu , Yucong Zhou , Zhao Zhong

Compressive sensing is a signal processing technique that enables the reconstruction of sparse signals from a limited number of measurements, leveraging the signal's inherent sparsity to facilitate efficient recovery. Recent works on the…

Quantum Physics · Physics 2025-01-22 Naveed Naimipour , Collin Frink , Harry Shaw , Haleh Safavi , Mojtaba Soltanalian

Quantum process tomography is often used to completely characterize an unknown quantum process. However, it may lead to an unphysical process matrix, which will cause the loss of information respect to the tomography result. Convex…

Quantum Physics · Physics 2018-09-13 Xuan-Lun Huang , Jun Gao , Zhi-Qiang Jiao , Zeng-Quan Yan , Ling Ji , Xian-Min Jin

Noise is an important factor that influences the reliability of information acquisition, transmission, processing, and storage. In order to suppress the inevitable noise effects, a fault-tolerant information processing approach via quantum…

Quantum Physics · Physics 2026-03-27 Qi Song , Hongjing Li , Chengxi Yu , Jingzheng Huang , Ding Wang , Peng Huang , Guihua Zeng

This paper presents an estimation approach within the framework of uplink massive machine-type communications (mMTC) that considers the energy limitations of the devices. We focus on a scenario where a group of sensors observe a set of…

Signal Processing · Electrical Eng. & Systems 2024-12-10 Sergi Liesegang , Olga Muñoz , Antonio Pascual-Iserte

KV cache compression methods have mainly relied on scalar quantization techniques to reduce the memory requirements during decoding. In this work, we apply residual vector quantization, which has been widely used for high fidelity audio…

Machine Learning · Computer Science 2024-10-22 Ankur Kumar

Recovery of the sparsity pattern (or support) of an unknown sparse vector from a small number of noisy linear measurements is an important problem in compressed sensing. In this paper, the high-dimensional setting is considered. It is shown…

Information Theory · Computer Science 2013-02-06 Galen Reeves , Michael Gastpar

This paper describes performance bounds for compressed sensing (CS) where the underlying sparse or compressible (sparsely approximable) signal is a vector of nonnegative intensities whose measurements are corrupted by Poisson noise. In this…

Information Theory · Computer Science 2015-05-14 Maxim Raginsky , Rebecca M. Willett , Zachary T. Harmany , Roummel F. Marcia

We consider the task of lossy compression of high-dimensional vectors through quantization. We propose the approach that learns quantization parameters by minimizing the distortion of scalar products and squared distances between pairs of…

Computer Vision and Pattern Recognition · Computer Science 2016-06-07 Artem Babenko , Relja Arandjelović , Victor Lempitsky

Randomized (dithered) quantization is a method capable of achieving white reconstruction error independent of the source. Dithered quantizers have traditionally been considered within their natural setting of uniform quantization. In this…

Information Theory · Computer Science 2017-04-26 Emrah Akyol , Kenneth Rose