English
Related papers

Related papers: Common Information, Noise Stability, and Their Ext…

200 papers

The uniform information density (UID) hypothesis states that humans tend to distribute information roughly evenly across an utterance or discourse. Early evidence in support of the UID hypothesis came from Genzel & Charniak (2002), which…

Computation and Language · Computer Science 2023-10-19 Vivek Verma , Nicholas Tomlin , Dan Klein

The Uniform Information Density (UID) hypothesis posits that speakers tend to distribute information evenly across linguistic units to achieve efficient communication. Of course, information rate in texts and discourses is not perfectly…

Computation and Language · Computer Science 2024-10-22 Eleftheria Tsipidi , Franz Nowak , Ryan Cotterell , Ethan Wilcox , Mario Giulianelli , Alex Warstadt

We introduce and develop a general paradigm for combining information across diverse data sources. In broad terms, suppose $\phi$ is a parameter of interest, built up via components $\psi_1,\ldots,\psi_k$ from data sources $1,\ldots,k$. The…

Methodology · Statistics 2026-02-25 Céline Cunen , Nils Lid Hjort

The Gray and Wyner lossy source coding for a simple network for sources that generate a tuple of jointly Gaussian random variables (RVs) $X_1 : \Omega \rightarrow {\mathbb R}^{p_1}$ and $X_2 : \Omega \rightarrow {\mathbb R}^{p_2}$, with…

Information Theory · Computer Science 2020-01-22 Charalambos D. Charalambous , Jan H. van Schuppen

In this paper, we consider a network communications problem in which multiple correlated sources must be delivered to a single data collector node, over a network of noisy independent point-to-point channels. We prove that perfect…

Information Theory · Computer Science 2016-08-31 Joao Barros , Sergio D. Servetto

This monograph presents a unified treatment of single- and multi-user problems in Shannon's information theory where we depart from the requirement that the error probability decays asymptotically in the blocklength. Instead, the error…

Information Theory · Computer Science 2015-04-13 Vincent Y. F. Tan

The Information Bottleneck (IB) principle offers a compelling theoretical framework to understand how neural networks (NNs) learn. However, its practical utility has been constrained by unresolved theoretical ambiguities and significant…

Machine Learning · Computer Science 2026-02-02 Charles Westphal , Stephen Hailes , Mirco Musolesi

We present new information-theoretic generalization guarantees through the a novel construction of the "neighboring-hypothesis" matrix and a new family of stability notions termed sample-conditioned hypothesis (SCH) stability. Our approach…

Machine Learning · Statistics 2023-11-01 Ziqiao Wang , Yongyi Mao

The problem of distributed binary hypothesis testing in the Gray-Wyner network with side information is studied in this paper. An observer has access to a discrete memoryless and stationary source and describes its observation to two…

Information Theory · Computer Science 2022-02-07 Reza Abbasalipour , Mahtab Mirmohseni

A grand challenge in representation learning is to learn the different explanatory factors of variation behind the high dimen- sional data. Encoder models are often determined to optimize performance on training data when the real objective…

Machine Learning · Statistics 2018-02-16 Matías Vera , Pablo Piantanida , Leonardo Rey Vega

We present a new notion $R_\ell$ of higher-order common information, which quantifies the information that $\ell\geq 2$ arbitrarily distributed random variables have in common. We provide analytical lower bounds on $R_3$ and $R_4$ for…

Information Theory · Computer Science 2024-06-05 Jan Østergaard

Consensus is a common method for computing a function of the data distributed among the nodes of a network. Of particular interest is distributed average consensus, whereby the nodes iteratively compute the sample average of the data stored…

Information Theory · Computer Science 2021-12-06 Ryan Pilgrim

Inferring the causal direction and causal effect between two discrete random variables X and Y from a finite sample is often a crucial problem and a challenging task. However, if we have access to observational and interventional data, it…

Machine Learning · Statistics 2020-10-16 Peter Gmeiner

Cyber Threat Intelligence (CTI) sharing is an important activity to reduce information asymmetries between attackers and defenders. However, this activity presents challenges due to the tension between data sharing and confidentiality, that…

Quantum information is a common topic of research in many areas of quantum physics, such as quantum communication and quantum computation, as well as quantum thermodynamics. It can be encoded in discrete or continuous variable systems, with…

Quantum Physics · Physics 2021-03-25 Jonas F. G. Santos , Carlos H. S. Vieira , Pedro R. Dieguez

Noise Contrastive Estimation (NCE) is a popular approach for learning probability density functions parameterized up to a constant of proportionality. The main idea is to design a classification problem for distinguishing training data from…

Machine Learning · Computer Science 2023-03-03 Holden Lee , Chirag Pabbaraju , Anish Sevekari , Andrej Risteski

In this note, we provide analytic expressions for the R\'enyi common information of orders in $(1,\infty)$ for the doubly symmetric binary source (DSBS). Until now, analytic expressions for the R\'enyi common information of all orders in…

Information Theory · Computer Science 2024-07-09 Lei Yu

We present a novel deep neural network (DNN) architecture for compressing an image when a correlated image is available as side information only at the decoder. This problem is known as distributed source coding (DSC) in information theory.…

Image and Video Processing · Electrical Eng. & Systems 2021-11-11 Nitish Mital , Ezgi Ozyilkan , Ali Garjani , Deniz Gunduz

This paper quantifies the intuitive observation that adding noise reduces available information by means of non-linear strong data processing inequalities. Consider the random variables $W\to X\to Y$ forming a Markov chain, where $Y=X+Z$…

Information Theory · Computer Science 2017-11-21 Flavio P. Calmon , Yury Polyanskiy , Yihong Wu

Recently, \textit{diffusion history inference} has become an emerging research topic due to its great benefits for various applications, whose purpose is to reconstruct the missing histories of information diffusion traces according to…

Social and Information Networks · Computer Science 2017-08-24 Yanchao Sun , Cong Qian , Ning Yang , Philip S. Yu