English
Related papers

Related papers: Optimal lower bounds for universal relation, and f…

200 papers

Consider a regression problem where the learner is given a large collection of $d$-dimensional data points, but can only query a small subset of the real-valued labels. How many queries are needed to obtain a $1+\epsilon$ relative error…

Machine Learning · Computer Science 2021-06-29 Xue Chen , Michał Dereziński

We consider the problem of covert communication with random slot selection over binary-input Discrete Memoryless Channels and Additive White Gaussian Noise channels, in which a transmitter attempts to reliably communicate with a legitimate…

Information Theory · Computer Science 2025-07-21 Shi-Yuan Wang , Keerthi S. K. Arumugam , Matthieu R. Bloch

We consider the following communication task in the multi-party setting, which involves a joint random variable $XYZMN$ with the property that $M$ is independent of $YZN$ conditioned on $X$ and $N$ is independent of $XZM$ conditioned on…

Information Theory · Computer Science 2020-03-24 Anurag Anshu , Penghui Yao

Differentially private mechanisms achieving worst-case optimal error bounds (e.g., the classical Laplace mechanism) are well-studied in the literature. However, when typical data are far from the worst case, \emph{instance-specific} error…

Cryptography and Security · Computer Science 2024-09-02 Wei Dong , Qiyao Luo , Giulia Fanti , Elaine Shi , Ke Yi

Given a set of discrete probability distributions, the minimum entropy coupling is the minimum entropy joint distribution that has the input distributions as its marginals. This has immediate relevance to tasks such as entropic causal…

Information Theory · Computer Science 2023-02-24 Spencer Compton , Dmitriy Katz , Benjamin Qi , Kristjan Greenewald , Murat Kocaoglu

We derive a lower bound on the smallest output entropy that can be achieved via vector quantization of a $d$-dimensional source with given expected $r$th-power distortion. Specialized to the one-dimensional case, and in the limit of…

Information Theory · Computer Science 2017-03-27 Tobias Koch , Gonzalo Vazquez-Vilar

In this paper, we challenge the conventional approach of state machine replication systems to design deterministic agreement protocols in the eventually synchronous communication model. We first prove that no such protocol can guarantee…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-06 Alexander Spiegelman

We consider the question introduced by \cite{Mason2020} of identifying all the $\varepsilon$-optimal arms in a finite stochastic multi-armed bandit with Gaussian rewards. We give two lower bounds on the sample complexity of any algorithm…

Machine Learning · Statistics 2022-04-07 Aymen Al Marjani , Tomáš Kocák , Aurélien Garivier

We show a tight lower bound of $\Omega(N \log\log N)$ on the number of transmissions required to compute the parity of $N$ input bits with constant error in a noisy communication network of $N$ randomly placed sensors, each having one input…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-02-10 Chinmoy Dutta , Yashodhan Kanoria , D. Manjunath , Jaikumar Radhakrishnan

The question of how much communication is required between collaborating parties to compute a function of their data is of fundamental importance in the fields of theoretical computer science and information theory. In this work, the focus…

Information Theory · Computer Science 2016-02-09 Shijin Rajakrishnan , Sundara Rajan S , Vinod Prabhakaran

We consider the problem of estimating a $d$-dimensional discrete distribution from its samples observed under a $b$-bit communication constraint. In contrast to most previous results that largely focus on the global minimax error, we study…

Information Theory · Computer Science 2021-11-02 Wei-Ning Chen , Peter Kairouz , Ayfer Özgür

This paper considers the problem of maintaining statistic aggregates over the last W elements of a data stream. First, the problem of counting the number of 1's in the last W bits of a binary stream is considered. A lower bound of…

Data Structures and Algorithms · Computer Science 2016-04-12 Ran Ben Basat , Gil Einziger , Roy Friedman , Yaron Kassner

We consider the learning and communication complexity of subsequence containment. In the learning problem, we seek to learn a classifier that positively labels a binary string $x$ if it contains a fixed binary string $y$ as a subsequence.…

Discrete Mathematics · Computer Science 2023-01-23 Mason DiCicco , Daniel Reichman

In order to communicate a message over a noisy channel, a sender (Alice) uses an error-correcting code to encode her message $x$ into a codeword. The receiver (Bob) decodes it correctly whenever there is at most a small constant fraction of…

Information Theory · Computer Science 2024-07-10 Meghal Gupta , Venkatesan Guruswami , Mihir Singhal

In this paper, we settle the problem of learning optimal linear contracts from data in the offline setting, where agent types are drawn from an unknown distribution and the principal's goal is to design a contract that maximizes her…

Computer Science and Game Theory · Computer Science 2026-05-28 Mikael Møller Høgsgaard

We show new lower bounds in the \emph{Merlin-Arthur} (MA) communication model and the related \emph{annotated streaming} or stream verification model. The MA communication model is an enhancement of the classical communication model, where…

Data Structures and Algorithms · Computer Science 2024-01-15 Prantar Ghosh , Vihan Shah

In the online matching on the line problem, the task is to match a set of requests $R$ online to a given set of servers $S$. The distance metric between any two points in $R\,\cup\, S$ is a line metric and the objective for the online…

Data Structures and Algorithms · Computer Science 2017-12-20 Antonios Antoniadis , Carsten Fischer , Andreas Tönnis

A transmitter Alice may wish to reliably transmit a message to a receiver Bob over a binary symmetric channel (BSC), while simultaneously ensuring that her transmission is deniable from an eavesdropper Willie. That is, if Willie listening…

Information Theory · Computer Science 2016-07-12 Pak Hou Che , Mayank Bakshi , Sidharth Jaggi

We consider a standard two-source model for uniform common randomness (UCR) generation, in which Alice and Bob observe independent and identically distributed (i.i.d.) samples of a correlated finite source and where Alice is allowed to send…

Information Theory · Computer Science 2023-05-10 Rami Ezzine , Moritz Wiese , Christian Deppe , Holger Boche

State redistribution is the protocol in which, given an arbitrary tripartite quantum state, with two of the subsystems initially being with Alice and one being with Bob, the goal is for Alice to send one of her subsystems to Bob, possibly…

Quantum Physics · Physics 2017-01-12 Nilanjana Datta , Min-Hsiu Hsieh , Jonathan Oppenheim