English
Related papers

Related papers: How to send a real number using a single bit (and …

200 papers

In this brief note, we consider estimation of the bitwise combination $x_1 \lor \dots \lor x_n = \max_i x_i$ observing a set of noisy bits $\tilde x_i \in \{0, 1\}$ that represent the true, unobserved bits $x_i \in \{0, 1\}$ under…

Methodology · Statistics 2023-06-19 Jonathan Hehir

We consider a standard distributed optimisation setting where $N$ machines, each holding a $d$-dimensional function $f_i$, aim to jointly minimise the sum of the functions $\sum_{i = 1}^N f_i (x)$. This problem arises naturally in…

Machine Learning · Computer Science 2021-12-08 Dan Alistarh , Janne H. Korhonen

We study the following generalized matrix rank estimation problem: given an $n \times n$ matrix and a constant $c \geq 0$, estimate the number of eigenvalues that are greater than $c$. In the distributed setting, the matrix of interest is…

Data Structures and Algorithms · Computer Science 2015-02-09 Yuchen Zhang , Martin J. Wainwright , Michael I. Jordan

In this work, we study the problem of distributed mean estimation with $1$-bit communication constraints when the variance is unknown. We focus on the specific case where each user has access to one i.i.d. sample drawn from a distribution…

Information Theory · Computer Science 2025-10-10 Ritesh Kumar , Shashank Vatedka

Protocols for tossing a common coin play a key role in the vast majority of implementations of consensus. Even though the common coins in the literature are usually \emph{fair} (they have equal chance of landing heads or tails), we focus on…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-27 Ivan Geffner , Joseph Y. Halpern

We study the setting in which the bits of an unknown infinite binary sequence x are revealed sequentially to an observer. We show that very limited assumptions about x allow one to make successful predictions about unseen bits of x. First,…

Data Structures and Algorithms · Computer Science 2011-01-25 Andrew Drucker

We consider the problem where $n$ clients transmit $d$-dimensional real-valued vectors using $d(1+o(1))$ bits each, in a manner that allows the receiver to approximately reconstruct their mean. Such compression problems naturally arise in…

Machine Learning · Computer Science 2021-12-17 Shay Vargaftik , Ran Ben Basat , Amit Portnoy , Gal Mendelson , Yaniv Ben-Itzhak , Michael Mitzenmacher

We consider the problem of estimating the mean of a symmetric log-concave distribution under the constraint that only a single bit per sample from this distribution is available to the estimator. We study the mean squared error as a…

Information Theory · Computer Science 2023-08-29 Alon Kipnis , John C. Duchi

Generating random bits from a source of biased coins (the biased is unknown) is a classical question that was originally studied by von Neumann. There are a number of known algorithms that have asymptotically optimal information efficiency,…

Information Theory · Computer Science 2012-09-05 Hongchao Zhou , Jehoshua Bruck

This paper studies the problem of nonparametric estimation of a smooth function with data distributed across multiple machines. We assume an independent sample from a white noise model is collected at each machine, and an estimator of the…

Machine Learning · Statistics 2018-06-26 Yuancheng Zhu , John Lafferty

Novel bitwise retransmission schemes are devised which retransmit only the bits received with small reliability. The retransmissions are used to accumulate the reliabilities of individual bits. Unlike the conventional automatic repeat…

Information Theory · Computer Science 2017-08-01 Mohamed A. M. Hassanien , Pavel Loskot , Salman M. Al-Shehri , Tolga Numanoglu , Mehmet Mert

In the setting of error-correcting codes with feedback, Alice wishes to communicate a $k$-bit message $x$ to Bob by sending a sequence of bits over a channel while noiselessly receiving feedback from Bob. It has been long known (Berlekamp,…

Information Theory · Computer Science 2022-12-14 Meghal Gupta , Venkatesan Guruswami , Rachel Yun Zhang

Alice and Bob are connected via a two-way channel, and Alice wants to send a message of $L$ bits to Bob. An adversary flips an arbitrary but finite number of bits, $T$, on the channel. This adversary knows our algorithm and Alice's message,…

Cryptography and Security · Computer Science 2017-07-27 Abhinav Aggarwal , Varsha Dani , Thomas Hayes , Jared Saia

In distributed systems, communication is a major concern due to issues such as its vulnerability or efficiency. In this paper, we are interested in estimating sparse inverse covariance matrices when samples are distributed into different…

Methodology · Statistics 2016-10-04 Jesús Arroyo , Elizabeth Hou

We study the broadcasting problem when the underlying tree is a random recursive tree. The root of the tree has a random bit value assigned. Every other vertex has the same bit value as its parent with probability $1-q$ and the opposite…

Probability · Mathematics 2021-04-27 Louigi Addario-Berry , Luc Devroye , Gabor Lugosi , Vasiliki Velona

The capacity per unit cost, or equivalently minimum cost to transmit one bit, is a well-studied quantity. It has been studied under the assumption of full synchrony between the transmitter and the receiver. In many applications, such as…

Information Theory · Computer Science 2012-10-25 Venkat Chandar , Aslan Tchamkerten , David Tse

We study a problem related to coin flipping, coding theory, and noise sensitivity. Consider a source of truly random bits $x \in \bits^n$, and $k$ parties, who have noisy versions of the source bits $y^i \in \bits^n$, where for all $i$ and…

Probability · Mathematics 2007-05-23 Elchanan Mossel , Ryan O'Donnell

Ultrafast physical random bit generation at hundreds of Gb/s rates, with verified randomness, is a crucial ingredient in secure communication and have recently emerged using optics based physical systems. Here we examine the inverse problem…

Signal Processing · Electrical Eng. & Systems 2019-11-05 Shira Sardi , Herut Uzan , Shiri Otmazgin , Yaara Aviad , Michael Rosenbluh , Ido Kanter

We consider general prepare-and-measure scenarios in which Alice can transmit qubit states to Bob, who can perform general measurements in the form of positive operator-valued measures (POVMs). We show that the statistics obtained in any…

Quantum Physics · Physics 2023-03-29 Martin J. Renner , Armin Tavakoli , Marco Túlio Quintino

The problem of 1-bit compressive sampling is addressed in this paper. We introduce an optimization model for reconstruction of sparse signals from 1-bit measurements. The model targets a solution that has the least l0-norm among all signals…

Information Theory · Computer Science 2013-02-07 Lixin Shen , Bruce W. Suter