English
Related papers

Related papers: How to send a real number using a single bit (and …

200 papers

The scheduling problem consists of finding a common 1 in two remotely located N bit strings. Denote the number of 1s in the string with the fewer 1s by epsilon*N. Classically, it needs at least O(epsilon*N) bits of communication to find the…

Quantum Physics · Physics 2007-05-23 Lov K. Grover

Random beacons-information sources that broadcast a stream of random digits unknown by anyone beforehand-are useful for various cryptographic purposes. But such beacons can be easily and undetectably sabotaged, so that their output is known…

Cryptography and Security · Computer Science 2007-05-23 Charles H. Bennett , John A. Smolin

We explore the connection between dimensionality and communication cost in distributed learning problems. Specifically we study the problem of estimating the mean $\vec{\theta}$ of an unknown $d$ dimensional gaussian distribution in the…

Machine Learning · Computer Science 2014-11-11 Ankit Garg , Tengyu Ma , Huy L. Nguyen

In this paper we consider the estimation of unknown parameters in Bayesian inverse problems. In most cases of practical interest, there are several barriers to performing such estimation, This includes a numerical approximation of a…

Methodology · Statistics 2025-02-07 Neil K. Chada , Ajay Jasra , Mohamed Maama , Raul Tempone

A k-wise independent distribution on n bits is a joint distribution of the bits such that each k of them are independent. In this paper we consider k-wise independent distributions with identical marginals, each bit has probability p to be…

Probability · Mathematics 2011-08-02 Ron Peled , Ariel Yadin , Amir Yehudayoff

We consider the following problem of decentralized statistical inference: given i.i.d. samples from an unknown distribution, estimate an arbitrary quantile subject to limits on the number of bits exchanged. We analyze a standard…

Information Theory · Computer Science 2007-07-13 Ram Rajagopal , Martin J. Wainwright

Consider a sensor network made of remote nodes connected to a common fusion center. In a recent work Blum and Sadler [1] propose the idea of ordered transmissions -sensors with more informative samples deliver their messages first- and…

Information Theory · Computer Science 2011-03-29 Paolo Braca , Stefano Marano , Vincenzo Matta

We consider the problem of shared randomness-assisted multiple access channel (MAC) simulation for product inputs and characterize the one-shot communication cost region via almost-matching inner and outer bounds in terms of the smooth…

Information Theory · Computer Science 2026-03-26 Aditya Nema , Sreejith Sreekumar , Mario Berta

This paper studies distributed algorithms for (strongly convex) composite optimization problems over mesh networks, subject to quantized communications. Instead of focusing on a specific algorithmic design, a black-box model is proposed,…

Optimization and Control · Mathematics 2022-05-19 Nicolò Michelusi , Gesualdo Scutari , Chang-Shen Lee

Most optimization problems in applied sciences realistically involve uncertainty in the parameters defining the cost function, of which only statistical information is known beforehand. In a recent work we introduced a message passing…

Statistical Mechanics · Physics 2013-09-03 Fabrizio Altarelli , Alfredo Braunstein , Abolfazl Ramezanpour , Riccardo Zecchina

Noise causes severe difficulties in implementing quantum computing and quantum cryptography. Several schemes have been suggested to reduce this problem, mainly focusing on quantum computation. Motivated by quantum cryptography, we suggest a…

Quantum Physics · Physics 2007-05-23 T. Mor

A central question in information theory is to determine the maximum success probability that can be achieved in sending a fixed number of messages over a noisy channel. This was first studied in the pioneering work of Shannon who…

Information Theory · Computer Science 2018-06-25 Siddharth Barman , Omar Fawzi

We consider an instance of the following problem: Parties P_1,..., P_k each receive an input x_i, and a coordinator (distinct from each of these parties) wishes to compute f(x_1,..., x_k) for some predicate f. We are interested in one-round…

Computational Complexity · Computer Science 2013-01-22 Daniel Apon , Jonathan Katz , Alex J. Malozemoff

We consider in this paper the problem of noisy 1-bit matrix completion under a general non-uniform sampling distribution using the max-norm as a convex relaxation for the rank. A max-norm constrained maximum likelihood estimate is…

Machine Learning · Statistics 2013-09-25 T. Tony Cai , Wen-Xin Zhou

Decentralized optimization methods enable on-device training of machine learning models without a central coordinator. In many scenarios communication between devices is energy demanding and time consuming and forms the bottleneck of the…

Optimization and Control · Mathematics 2020-11-04 Dmitry Kovalev , Anastasia Koloskova , Martin Jaggi , Peter Richtarik , Sebastian U. Stich

We study an extension of the standard two-party communication model in which Alice and Bob hold probability distributions $p$ and $q$ over domains $X$ and $Y$, respectively. Their goal is to estimate \[ \mathbb{E}_{x \sim p,\, y \sim…

Computational Complexity · Computer Science 2025-12-02 Parikshit Gopalan , Raghu Meka , Prasad Raghavendra , Mihir Singhal , Avi Wigderson

We propose a novel, efficient approach for distributed sparse learning in high-dimensions, where observations are randomly partitioned across machines. Computationally, at each round our method only requires the master machine to solve a…

Machine Learning · Statistics 2016-05-26 Jialei Wang , Mladen Kolar , Nathan Srebro , Tong Zhang

We show that randomization can lead to significant improvements for a few fundamental problems in distributed tracking. Our basis is the {\em count-tracking} problem, where there are $k$ players, each holding a counter $n_i$ that gets…

Data Structures and Algorithms · Computer Science 2011-12-05 Zengfeng Huang , Ke Yi , Qin Zhang

Contention resolution addresses the problem of coordinating access to a shared communication channel. Time is discretized into synchronized slots, and a packet can be sent in any slot. If no packet is sent, then the slot is empty; if a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-22 Umesh Biswas , Trisha Chakraborty , Maxwell Young

We consider the task of faithfully simulating a distributed quantum measurement, wherein we provide a protocol for the three parties, Alice, Bob and Eve, to simulate a repeated action of a distributed quantum measurement using a pair of…

Information Theory · Computer Science 2020-08-17 Touheed Anwar Atif , Mohsen Heidari , S. Sandeep Pradhan