English
Related papers

Related papers: Distributed Quantization for Measurement of Correl…

200 papers

Deep learning-based semantic communication has largely relied on analog or semi-digital transmission, which limits compatibility with modern digital communication infrastructures. Recent studies have employed vector quantization (VQ) to…

Signal Processing · Electrical Eng. & Systems 2025-10-22 Zian Meng , Qiang Li , Wenqian Tang , Mingdie Yan , Xiaohu Ge

Vector Quantization (VQ) is a well-known technique in deep learning for extracting informative discrete latent representations. VQ-embedded models have shown impressive results in a range of applications including image and speech…

Machine Learning · Computer Science 2023-10-05 Tanmay Gautam , Reid Pryzant , Ziyi Yang , Chenguang Zhu , Somayeh Sojoudi

We consider the problem of distributed joint source-channel coding of correlated Gaussian sources over a Gaussian Multiple Access Channel (GMAC). There may be side information at the decoder and/or at the encoders. First we specialize a…

Information Theory · Computer Science 2009-05-15 R Rajesh , Vinod Sharma

Quantization (Alistarh et al., 2017) is an important (stochastic) compression technique that reduces the volume of transmitted bits during each communication round in distributed model training. Suresh et al. (2022) introduce correlated…

Machine Learning · Computer Science 2024-01-12 Andrei Panferov , Yury Demidovich , Ahmad Rammal , Peter Richtárik

In this paper, we consider the problem of remote vector Gaussian source coding for a wireless acoustic sensor network. Each node receives messages from multiple nodes in the network and decodes these messages using its own measurement of…

Information Theory · Computer Science 2016-11-15 Adel Zahedi , Jan Ostergaard , Soren Holdt Jensen , Patrick Naylor , Soren Bech

We consider the distributed source coding system of $L$ correlated Gaussian sources $Y_i,i=1,2,...,L$ which are noisy observations of correlated Gaussian remote sources $X_k, k=1,2,...,K$. We assume that $Y^{L}={}^{\rm t}(Y_1,Y_2,$ $...,…

Information Theory · Computer Science 2011-02-21 Yasutada Oohama

Built upon vector quantization (VQ), discrete audio codec models have achieved great success in audio compression and auto-regressive audio generation. However, existing models face substantial challenges in perceptual quality and signal…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-20 Zhikang Niu , Sanyuan Chen , Long Zhou , Ziyang Ma , Xie Chen , Shujie Liu

This paper formulates and studies a general distributed field reconstruction problem using a dense network of noisy one-bit randomized scalar quantizers in the presence of additive observation noise of unknown distribution. A constructive…

Information Theory · Computer Science 2009-11-13 Ye Wang , Prakash Ishwar , Venkatesh Saligrama

Recent research advances have revealed the computational secrecy of the compressed sensing (CS) paradigm. Perfect secrecy can also be achieved by normalizing the CS measurement vector. However, these findings are established on real…

Cryptography and Security · Computer Science 2014-11-25 Leo Yu Zhang , Kwok-Wo Wong , Yushu Zhang , Qiuzhen Lin

The compressed sensing paradigm allows to efficiently represent sparse signals by means of their linear measurements. However, the problem of transmitting these measurements to a receiver over a channel potentially prone to packet losses…

Information Theory · Computer Science 2014-03-06 Diego Valsesia , Giulio Coluccia , Enrico Magli

We consider a resource-limited scenario where a sensor that uses compressed sensing (CS) collects a low number of measurements in order to observe a sparse signal, and the measurements are subsequently quantized at a low bit-rate followed…

Information Theory · Computer Science 2015-06-19 Amirpasha Shirazinia , Saikat Chatterjee , Mikael Skoglund

It is known that quantum correlations exhibited by a maximally entangled qubit pair can be simulated with the help of shared randomness, supplemented with additional resources, such as communication, post-selection or non-local boxes. For…

Quantum Physics · Physics 2009-11-11 Julien Degorre , Sophie Laplante , Jérémie Roland

This paper studies fixed rate vector quantisation for noisy networked control systems (NCSs) with correlated packet dropouts. In particular, a discrete-time linear time invariant system is to be controlled over an error-prone digital…

Optimization and Control · Mathematics 2016-01-20 Edwin G. W. Peters , Daniel E. Quevedo , Jan Østergaard

We consider a distributed detection problem within a wireless sensor network (WSN), where a substantial number of sensors cooperate to detect the existence of sparse stochastic signals. To achieve a trade-off between detection performance…

Signal Processing · Electrical Eng. & Systems 2024-11-07 Linlin Mao , Shefeng Yan , Zeping Sui , Hongbin Li

Although analog semantic communication systems have received considerable attention in the literature, there is less work on digital semantic communication systems. In this paper, we develop a deep learning (DL)-enabled vector quantized…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Qifan Fu , Huiqiang Xie , Zhijin Qin , Gregory Slabaugh , Xiaoming Tao

Noisy unsharp measurements incorporated in quantum information protocols may hinder performance, reducing the quantum advantage. However, we show that, unlike projective measurements which completely destroy quantum correlations between…

Quantum Physics · Physics 2025-07-01 Sudipta Mondal , Pritam Halder , Amit Kumar Pal , Aditi Sen De

A plethora of applications hinge on a network or an array of sensors to undertake measurement tasks. A rule of thumb for sensing is that a collective measurement taken by $M$ independent sensors can improve the sensitivity by $1/\sqrt{M}$,…

Quantum Physics · Physics 2020-10-30 Zheshen Zhang , Quntao Zhuang

In this work, we developed and tested 3 techniques for vector quantization (VQ) based model weight compression. To mitigate codebook collapse and enable end-to-end training, we adopted cosine similarity-based assignment. Building on ideas…

Machine Learning · Computer Science 2026-04-28 Terry Gou , Puneet Gupta

Spatio-temporal forecasting is crucial in various fields and requires a careful balance between identifying subtle patterns and filtering out noise. Vector quantization (VQ) appears well-suited for this purpose, as it quantizes input…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Chao Chen , Tian Zhou , Yanjun Zhao , Hui Liu , Liang Sun , Rong Jin

This paper proposes a compressed sensing (CS) framework for the acquisition and reconstruction of frequency-sparse signals with chaotic dynamical systems. The sparse signal is acting as an excitation term of a discrete-time chaotic system…

Information Theory · Computer Science 2016-12-21 Zhong Liu , Shengyao Chen , Feng Xi