English
Related papers

Related papers: Trading information complexity for error

200 papers

We consider the problem of coding for computing with maximal distortion, where the sender communicates with a receiver, which has its own private data and wants to compute a function of their combined data with some fidelity constraint…

Information Theory · Computer Science 2019-10-21 Sourya Basu , Daewon Seo , Lav R. Varshney

We give improved separations for the query complexity analogue of the log-approximate-rank conjecture i.e. we show that there are a plethora of total Boolean functions on $n$ input bits, each of which has approximate Fourier sparsity at…

Computational Complexity · Computer Science 2020-09-08 Arkadev Chattopadhyay , Ankit Garg , Suhail Sherif

We investigate the problem of estimating a random variable $Y\in \mathcal{Y}$ under a privacy constraint dictated by another random variable $X\in \mathcal{X}$, where estimation efficiency and privacy are assessed in terms of two different…

Information Theory · Computer Science 2018-08-14 Shahab Asoodeh , Mario Diaz , Fady Alajaji , Tamas Linder

This paper makes three main contributions to the theory of communication complexity and stream computation. First, we present new bounds on the information complexity of AUGMENTED-INDEX. In contrast to analogous results for INDEX by Jain,…

Computational Complexity · Computer Science 2015-03-14 Amit Chakrabarti , Graham Cormode , Ranganath Kondapally , Andrew McGregor

This paper is on developing some computer-assisted proof methods involving non-classical inequalities for Shannon entropy. Two areas of the applications of information inequalities are studied: Secret sharing schemes and hat guessing games.…

Information Theory · Computer Science 2023-10-19 Emirhan Gürpınar

Round complexity is an extensively studied metric of distributed algorithms. In contrast, our knowledge of the \emph{message complexity} of distributed computing problems and its relationship (if any) with round complexity is still quite…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-01 Fabien Dufoulon , Shreyas Pai , Gopal Pandurangan , Sriram Pemmaraju , Peter Robinson

In this paper, we study a distributed learning problem constrained by constant communication bits. Specifically, we consider the distributed hypothesis testing (DHT) problem where two distributed nodes are constrained to transmit a constant…

Information Theory · Computer Science 2022-01-25 Xiangxiang Xu , Shao-Lun Huang

We study the problem of identifying correlations in multivariate data, under information constraints: Either on the amount of memory that can be used by the algorithm, or the amount of communication when the data is distributed across…

Machine Learning · Computer Science 2018-06-07 Yuval Dagan , Ohad Shamir

We consider the classical problem of discrete distribution estimation using i.i.d. samples in a novel scenario where additional side information is available on the distribution. In large alphabet datasets such as text corpora, such side…

Information Theory · Computer Science 2026-01-19 Haricharan Balasundaram , Andrew Thangaraj

The distributed hypothesis testing problem with full side-information is studied. The trade-off (reliability function) between the two types of error exponents under limited rate is studied in the following way. First, the problem is…

Information Theory · Computer Science 2019-04-24 Nir Weinberger , Yuval Kochman

We consider the point-to-point message passing model of communication in which there are $k$ processors with individual private inputs, each $n$-bit long. Each processor is located at the node of an underlying undirected graph and has…

Computational Complexity · Computer Science 2016-02-22 Arkadev Chattopadhyay , Sagnik Mukhopadhyay

The communication cost of algorithms (also known as I/O-complexity) is shown to be closely related to the expansion properties of the corresponding computation graphs. We demonstrate this on Strassen's and other fast matrix multiplication…

Data Structures and Algorithms · Computer Science 2011-09-12 Grey Ballard , James Demmel , Olga Holtz , Oded Schwartz

This paper considers the problem of channel coding with a given (possibly suboptimal) maximum-metric decoding rule. A cost-constrained random-coding ensemble with multiple auxiliary costs is introduced, and is shown to achieve error…

Information Theory · Computer Science 2014-03-05 Jonathan Scarlett , Alfonso Martinez , Albert Guillén i Fàbregas

The Collision problem is to decide whether a given list of numbers $(x_1,\ldots,x_n)\in[n]^n$ is $1$-to-$1$ or $2$-to-$1$ when promised one of them is the case. We show an $n^{\Omega(1)}$ randomised communication lower bound for the natural…

Computational Complexity · Computer Science 2022-08-11 Mika Göös , Siddhartha Jain

A device-independent randomness expansion protocol aims to take an initial random string and generate a longer one, where the security of the protocol does not rely on knowing the inner workings of the devices used to run it. In order to do…

Quantum Physics · Physics 2026-01-06 Rutvij Bhavsar , Sammy Ragy , Roger Colbeck

Two parties observing correlated data seek to exchange their data using interactive communication. How many bits must they communicate? We propose a new interactive protocol for data exchange which increases the communication size in steps…

Information Theory · Computer Science 2017-11-15 Himanshu Tyagi , Pramod Viswanath , Shun Watanabe

In this paper, we study the problem of relaying a single bit over a tandem of binary-input channels, with the goal of attaining the highest possible error exponent in the exponentially decaying error probability. Our previous work gave an…

Information Theory · Computer Science 2024-06-07 Yan Hao Ling , Jonathan Scarlett

Transparency of information disclosure has always been considered an instrumental component of effective governance, accountability, and ethical behavior in any organization or system. However, a natural question follows: \emph{what is the…

Computer Science and Game Theory · Computer Science 2023-12-01 Tao Li , Quanyan Zhu

The main contribution of this work is to relate information complexity to "tension" [Prabhakaran and Prabhakaran, 2014] - an information-theoretic quantity defined with no reference to protocols - and to illustrate that it allows deriving…

Computational Complexity · Computer Science 2014-08-28 Manoj M. Prabhakaran , Vinod M. Prabhakaran

As conventional communication systems based on classic information theory have closely approached the limits of Shannon channel capacity, semantic communication has been recognized as a key enabling technology for the further improvement of…

Information Theory · Computer Science 2023-06-06 Jiancheng Tang , Qianqian Yang , Zhaoyang Zhang