English
Related papers

Related papers: Distributed Scalar Quantization for Computing: Hig…

200 papers

Properties of scalar quantization with $r$th power distortion and constrained R\'enyi entropy of order $\alpha\in (0,1)$ are investigated. For an asymptotically (high-rate) optimal sequence of quantizers, the contribution to the R\'enyi…

Information Theory · Computer Science 2012-03-27 Wolfgang Kreitmeier , Tamas Linder

This work establishes the fundamental limits of the classical problem of multi-user distributed computing of linearly separable functions. In particular, we consider a distributed computing setting involving $L$ users, each requesting a…

Information Theory · Computer Science 2026-01-16 K. K. Krishnan Namboodiri , Elizabath Peter , Derya Malak , Petros Elia

Distributed optimization finds many applications in machine learning, signal processing, and control systems. In these real-world applications, the constraints of communication networks, particularly limited bandwidth, necessitate…

Systems and Control · Electrical Eng. & Systems 2024-10-29 Mohammadreza Doostmohammadian , Sérgio Pequito

Quantum computing is presently undergoing rapid development to achieve a significant speedup promised in certain applications. Nonetheless, scaling quantum computers remains a formidable engineering challenge, prompting exploration of…

This paper considers the problem of distributed estimation in wireless sensor networks (WSN), which is anticipated to support a wide range of applications such as the environmental monitoring, weather forecasting, and location estimation.…

Signal Processing · Electrical Eng. & Systems 2023-10-26 Meng He , Ran Li , Chuan Huang , Shulong Zhang

Sensing networks underpin applications from fundamental physics to real-world engineering. Recently, distributed quantum sensing (DQS) has been investigated to boost the sensing performance, yet current schemes typically rely on entangled…

Quantum Physics · Physics 2026-01-22 Binke Xia , Zhaotong Cui , Jingzheng Huang , Yuxiang Yang , Guihua Zeng

The emergence of the Internet-of-Things and cyber-physical systems necessitates the coordination of access to limited communication resources in an autonomous and distributed fashion. Herein, the optimal design of a wireless sensing system…

Systems and Control · Electrical Eng. & Systems 2020-05-26 Xu Zhang , Marcos M. Vasconcelos , Wei Cui , Urbashi Mitra

Distributed computing is fundamental to multi-agent systems, with solving distributed linear equations as a typical example. In this paper, we study distributed solvers for network linear equations over a network with node-to-node…

Systems and Control · Electrical Eng. & Systems 2024-11-18 Lei Wang , Zihao Ren , Deming Yuan , Guodong Shi

Estimation of a vector from quantized linear measurements is a common problem for which simple linear techniques are suboptimal -- sometimes greatly so. This paper develops generalized approximate message passing (GAMP) algorithms for…

Information Theory · Computer Science 2015-03-24 Ulugbek Kamilov , Vivek K. Goyal , Sundeep Rangan

We introduce a universal quantization scheme based on random coding, and we analyze its performance. This scheme consists of a source-independent random codebook (typically_mismatched_ to the source distribution), followed by optimal…

Information Theory · Computer Science 2007-07-13 Ioannis Kontoyiannis , Rami Zamir

We address the problem of distributed computation of arbitrary functions of two correlated sources $X_1$ and $X_2$, residing in two distributed source nodes, respectively. We exploit the structure of a computation task by coding source…

Information Theory · Computer Science 2025-04-23 Mohammad Reza Deylam Salehi , Derya Malak

Quantum information processing is the emerging field that defines and realizes computing devices that make use of quantum mechanical principles, like the superposition principle, entanglement, and interference. In this review we study the…

Quantum Physics · Physics 2015-05-13 Harry Buhrman , Richard Cleve , Serge Massar , Ronald de Wolf

Coresets are small, weighted summaries of larger datasets, aiming at providing provable error bounds for machine learning (ML) tasks while significantly reducing the communication and computation costs. To achieve a better trade-off between…

Machine Learning · Computer Science 2022-04-15 Hanlin Lu , Changchang Liu , Shiqiang Wang , Ting He , Vijay Narayanan , Kevin S. Chan , Stephen Pasteris

Diffusion models have recently emerged as the dominant approach in visual generation tasks. However, the lengthy denoising chains and the computationally intensive noise estimation networks hinder their applicability in low-latency and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Qian Zeng , Jie Song , Yuanyu Wan , Huiqiong Wang , Mingli Song

We consider the distributed source coding problem in which correlated data picked up by scattered sensors has to be encoded separately and transmitted to a common receiver, subject to a rate-distortion constraint. Although near-tooptimal…

Information Theory · Computer Science 2008-09-09 G. Maierbacher , J. Barros

We study the limits of communication efficiency for function computation in collocated networks within the framework of multi-terminal block source coding theory. With the goal of computing a desired function of sources at a sink, nodes…

Information Theory · Computer Science 2016-11-17 Nan Ma , Prakash Ishwar , Piyush Gupta

Incompatible, i.e. non-jointly measurable quantum measurements are a necessary resource for many information processing tasks. It is known that increasing the number of distinct measurements usually enhances the incompatibility of a…

Quantum Physics · Physics 2023-09-28 Lucas Tendick , Hermann Kampermann , Dagmar Bruß

Randomized (dithered) quantization is a method capable of achieving white reconstruction error independent of the source. Dithered quantizers have traditionally been considered within their natural setting of uniform quantization. In this…

Information Theory · Computer Science 2017-04-26 Emrah Akyol , Kenneth Rose

This paper studies a layered coding framework with a relaxed hierarchical structure. Advances in wired/wireless communication and consumer electronic devices have created a requirement for serving the same content at different quality…

Signal Processing · Electrical Eng. & Systems 2018-02-09 Mehdi Salehifar , Tejaswi Nanjundaswamy , Kenneth Rose

We consider machine learning applications that train a model by leveraging data distributed over a trusted network, where communication constraints can create a performance bottleneck. A number of recent approaches propose to overcome this…

Machine Learning · Computer Science 2021-09-10 Osama A. Hanna , Yahya H. Ezzeldin , Christina Fragouli , Suhas Diggavi