中文
相关论文

相关论文: An operational characterization of mutual informat…

200 篇论文

We give efficient "collaboration protocols" through which two parties, who observe different features about the same instances, can interact to arrive at predictions that are more accurate than either could have obtained on their own. The…

机器学习 · 计算机科学 2025-04-09 Natalie Collina , Ira Globus-Harris , Surbhi Goel , Varun Gupta , Aaron Roth , Mirah Shi

We show that real-value approximations of Kolmogorov-Chaitin (K_m) using the algorithmic Coding theorem as calculated from the output frequency of a large set of small deterministic Turing machines with up to 5 states (and 2 symbols), is in…

信息论 · 计算机科学 2013-12-12 Fernando Soler-Toscano , Hector Zenil , Jean-Paul Delahaye , Nicolas Gauvrit

We consider the notion of information distance between two objects $x$ and $y$ introduced by Bennett, G\'acs, Li, Vit\'anyi, and Zurek in 1998 as the minimal length of a program that computes $x$ from $y$ as well as computing $y$ from $x$.…

信息论 · 计算机科学 2020-09-02 Bruno Bauwens

This paper shows that the Hirschfeld-Gebelein-R\'enyi maximal correlation between the message and the ciphertext provides good secrecy guarantees for cryptosystems that use short keys. We first establish a bound on the eavesdropper's…

信息论 · 计算机科学 2018-12-11 Cheuk Ting Li , Abbas El Gamal

It is shown that from two strings that are partially random and independent (in the sense of Kolmogorov complexity) it is possible to effectively construct polynomially many strings that are random and pairwise independent. If the two…

信息论 · 计算机科学 2009-03-24 Marius Zimand

String complexity is defined as the cardinality of a set of all distinct words (factors) of a given string. For two strings, we introduce the joint string complexity as the cardinality of a set of words that are common to both strings.…

信息论 · 计算机科学 2018-05-24 Philippe Jacquet , Dimitris Milioris , Wojciech Szpankowski

In this paper, we present a theoretical effort to connect the theory of program size to psychology by implementing a concrete language of thought with Turing-computable Kolmogorov complexity (LT^2C^2) satisfying the following requirements:…

神经元与认知 · 定量生物学 2013-03-06 Sergio Romano , Mariano Sigman , Santiago Figueira

We present several application of simple topological arguments in problems of Kolmogorov complexity. Basically we use the standard fact from topology that the disk is simply connected. It proves to be enough to construct strings with some…

离散数学 · 计算机科学 2015-01-27 Alexander Shen , Andrei Romashchenko

In the multiterminal secret key agreement problem, a set of users want to discuss with each other until they share a common secret key independent of their discussion. We want to characterize the maximum secret key rate, called the secrecy…

信息论 · 计算机科学 2018-02-15 Chung Chan , Manuj Mukherjee , Navin Kashyap , Qiaoqiao Zhou

The combined Universal Probability M(D) of strings x in sets D is close to max M({x}) over x in D: their ~logs differ by at most D's information j=I(D:H) about the halting sequence H. Thus if all x have complexity K(x) >k, D carries >i bits…

计算复杂性 · 计算机科学 2014-03-21 Samuel Epstein , Leonid A. Levin

We introduce explicit schemes based on the polarization phenomenon for the tasks of one-way secret key agreement from common randomness and private channel coding. For the former task, we show how to use common randomness and insecure…

信息论 · 计算机科学 2015-04-21 David Sutter , Joseph M. Renes , Renato Renner

This paper considers secret-key generation between several agents and a base station that observe independent and identically distributed realizations of correlated random variables. Each agent wishes to generate the longest possible…

信息论 · 计算机科学 2019-04-25 Remi A. Chou , Aylin Yener

Data complexity is an important concept in the natural sciences and related areas, but lacks a rigorous and computable definition. In this paper, we focus on a particular sense of complexity that is high if the data is structured in a way…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Louis Mahon

Mutual information $I(X;Y)$ is a useful definition in information theory to estimate how much information the random variable $Y$ holds about the random variable $X$. One way to define the mutual information is by comparing the joint…

信息论 · 计算机科学 2022-04-14 Bulut Kuskonmaz , Jaron Skovsted Gundersen , Rafal Wisniewski

We give improved separations for the query complexity analogue of the log-approximate-rank conjecture i.e. we show that there are a plethora of total Boolean functions on $n$ input bits, each of which has approximate Fourier sparsity at…

计算复杂性 · 计算机科学 2020-09-08 Arkadev Chattopadhyay , Ankit Garg , Suhail Sherif

Two information structures are said to be close if, with high probability, there is approximate common knowledge that interim beliefs are close under the two information structures. We define an "almost common knowledge topology" reflecting…

理论经济学 · 经济学 2024-11-15 Dirk Bergemann , Stephen Morris , Rafael Veiel

A major open problem in communication complexity is whether or not quantum protocols can be exponentially more efficient than classical protocols on _total_ Boolean functions in the two-party interactive model. The answer appears to be…

量子物理 · 物理学 2008-04-14 Yaoyun Shi , Yufan Zhu

Information-theoretic topological secure aggregation (TSA)\cite{zhang2026information_regular} enables distributed users to compute neighborhood sums over arbitrary networks without revealing individual inputs, while remaining…

信息论 · 计算机科学 2026-05-06 Xiang Zhang , Han Yu , Zhou Li , Yizhou Zhao , Giuseppe Caire

A drawback of Kolmogorov-Chaitin complexity (K) as a function from s to the shortest program producing s is its noncomputability which limits its range of applicability. Moreover, when strings are short, the dependence of K on a particular…

计算复杂性 · 计算机科学 2010-12-20 Jean-Paul Delahaye , Hector Zenil

The Kolmogorov complexity of the word w is equal to the length of the shortest concatenation of program Z and its input x with which the word w is computed by the universal turing machine U. The question introduced in this paper is the…

计算复杂性 · 计算机科学 2009-09-07 Norbert Bátfai