English
Related papers

Related papers: New Separations Results for External Information

200 papers

We characterize the communication complexity of the following distributed estimation problem. Alice and Bob observe infinitely many iid copies of $\rho$-correlated unit-variance (Gaussian or $\pm1$ binary) random variables, with unknown…

Information Theory · Computer Science 2019-04-19 Uri Hadar , Jingbo Liu , Yury Polyanskiy , Ofer Shayevitz

We consider the problem of bounded-error quantum state identification: given either state \alpha_0 or state \alpha_1, we are required to output `0', `1' or `?' ("don't know"), such that conditioned on outputting `0' or `1', our guess is…

Quantum Physics · Physics 2022-03-29 Dmytro Gavinsky , Julia Kempe , Oded Regev , Ronald de Wolf

Self-stabilization is a general paradigm to provide forward recovery capabilities to distributed systems and networks. Intuitively, a protocol is self-stabilizing if it is able to recover without external intervention from any catastrophic…

Data Structures and Algorithms · Computer Science 2008-11-25 Stéphane Devismes , Toshimitsu Masuzawa , Sébastien Tixeuil

We study a Bayesian persuasion problem with externalities. In this model, a principal sends signals to inform multiple agents about the state of the world. Simultaneously, due to the existence of externalities in the agents' utilities, the…

Artificial Intelligence · Computer Science 2024-12-18 Jonathan Shaki , Jiarui Gan , Sarit Kraus

We study the problem of interactive function computation by multiple parties possessing a single bit each in a differential privacy setting (i.e., there remains an uncertainty in any specific party's bit even when given the transcript of…

Cryptography and Security · Computer Science 2014-10-08 Peter Kairouz , Sewoong Oh , Pramod Viswanath

Partial Information Decomposition (PID) seeks to disentangle how information about a target variable is distributed across multiple sources, separating redundant, unique, and synergistic contributions. Despite extensive theoretical…

Information Theory · Computer Science 2025-12-19 Philip Hendrik Matthias , Abdullah Makkeh , Michael Wibral , Aaron J. Gutknecht

The CEEMDAN algorithm is one of the modern methods used in the analysis of non-stationary signals. This research presents a study of the effectiveness of this method in audio source separation to know the limits of its work. It concluded…

Sound · Computer Science 2024-11-19 Rawad Melhem , Riad Hamadeh , Assef Jafar

Suppose we have individual data from an internal study and various summary statistics from relevant external studies. External summary statistics have the potential to improve statistical inference for the internal population; however, it…

Methodology · Statistics 2026-02-06 Wenjie Hu , Ruoyu Wang , Wei Li , Wang Miao

Communication complexity quantifies how difficult it is for two distant computers to evaluate a function f(X,Y), where the strings X and Y are distributed to the first and second computer respectively, under the constraint of exchanging as…

Quantum Physics · Physics 2024-07-17 Pierre Botteron , Anne Broadbent , Reda Chhaibi , Ion Nechita , Clément Pellegrini

A measure for the complexity of a differentiable function f(x) on an interval is introduced. It is based on approximations of the function by piecewise constant functions. The measure takes into account the quality of the approximation and…

Information Theory · Computer Science 2026-05-19 Matthijs Ruijgrok

Inspired by Solomonoffs theory of inductive inference, we propose a prior based on circuit complexity. There are several advantages to this approach. First, it relies on a complexity measure that does not depend on the choice of UTM. There…

Machine Learning · Computer Science 2023-06-27 Cole Wyeth , Carl Sturtivant

Folklore in complexity theory suspects that circuit lower bounds against $\mathbf{NC}^1$ or $\mathbf{P}/\operatorname{poly}$, currently out of reach, are a necessary step towards proving strong proof complexity lower bounds for systems like…

Computational Complexity · Computer Science 2024-05-06 Noel Arteche , Erfan Khaniki , Ján Pich , Rahul Santhanam

For any $\{0,1\}$-valued function $f$, its \emph{$n$-folded XOR} is the function $f^{\oplus n}$ where $f^{\oplus n}(X_1, \ldots, X_n) = f(X_1) \oplus \cdots \oplus f(X_n)$. Given a procedure for computing the function $f$, one can apply a…

Computational Complexity · Computer Science 2025-06-17 Pachara Sawettamalya , Huacheng Yu

Data complexity is an important concept in the natural sciences and related areas, but lacks a rigorous and computable definition. In this paper, we focus on a particular sense of complexity that is high if the data is structured in a way…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Louis Mahon

We present two classes of improved estimators for mutual information $M(X,Y)$, from samples of random points distributed according to some joint probability density $\mu(x,y)$. In contrast to conventional estimators based on binnings, they…

Statistical Mechanics · Physics 2009-11-10 Alexander Kraskov , Harald Stoegbauer , Peter Grassberger

For any $n$-bit boolean function $f$, we show that the randomized communication complexity of the composed function $f\circ g^n$, where $g$ is an index gadget, is characterized by the randomized decision tree complexity of $f$. In…

Computational Complexity · Computer Science 2017-03-23 Mika Göös , Toniann Pitassi , Thomas Watson

We introduce an information theoretic measure of statistical structure, called 'binding information', for sets of random variables, and compare it with several previously proposed measures including excess entropy, Bialek et al.'s…

Statistics Theory · Mathematics 2010-12-10 Samer A. Abdallah , Mark D. Plumbley

Let $f : \{0,1\}^n \times \{0,1\}^n \rightarrow \{0,1\}$ be a 2-party function. For every product distribution $\mu$ on $\{0,1\}^n \times \{0,1\}^n$, we show that $$\mathsf{CC}^\mu_{0.49}(f) = O\left(\left(\log \mathsf{prt}_{1/8}(f) \cdot…

Computational Complexity · Computer Science 2020-05-08 Prahladh Harsha , Rahul Jain , Jaikumar Radhakrishnan

The introduced entropy functional's (EF) information measure of random process integrates multiple information contributions along the process trajectories, evaluating both the states' and between states' bound information connections. This…

Adaptation and Self-Organizing Systems · Physics 2014-06-04 Vladimir S. Lerner

The ability of information processing in biologically motivated Boolean networks is of interest in recent information theoretic research. One measure to quantify this ability is the well known mutual information. Using Fourier analysis we…

Information Theory · Computer Science 2012-11-06 Johannes Georg Klotz , David Kracht , Martin Bossert , Steffen Schober