English
Related papers

Related papers: Single-shot lossy compression: mutual information …

200 papers

We derive a general upper bound to mutual information in terms of the Fisher information. The bound may be further used to derive a lower bound for the Bayesian quadratic cost. These two provide alternatives to other inequalities in the…

Quantum Physics · Physics 2025-05-16 Wojciech Górecki , Xi Lu , Chiara Macchiavello , Lorenzo Maccone

We consider a binary sequence generated by thresholding a hidden continuous sequence. The hidden variables are assumed to have a compound symmetry covariance structure with a single parameter characterizing the common correlation. We study…

Statistics Theory · Mathematics 2019-09-04 Haolei Weng , Yang Feng

Mutual information (MI) minimization has gained considerable interests in various machine learning tasks. However, estimating and minimizing MI in high-dimensional spaces remains a challenging problem, especially when only samples, rather…

Machine Learning · Computer Science 2020-07-27 Pengyu Cheng , Weituo Hao , Shuyang Dai , Jiachang Liu , Zhe Gan , Lawrence Carin

We derive information theoretic generalization bounds for supervised learning algorithms based on a new measure of leave-one-out conditional mutual information (loo-CMI). Contrary to other CMI bounds, which are black-box bounds that do not…

Machine Learning · Computer Science 2022-07-04 Mohamad Rida Rammal , Alessandro Achille , Aditya Golatkar , Suhas Diggavi , Stefano Soatto

Estimating the mutual information from samples from a joint distribution is a challenging problem in both science and engineering. In this work, we realize a variational bound that generalizes both discriminative and generative approaches.…

Machine Learning · Statistics 2023-06-05 Marco Federici , David Ruhe , Patrick Forré

We consider the problem of recovering the community structure in the stochastic block model with two communities. We aim to describe the mutual information between the observed network and the actual community structure in the sparse…

Probability · Mathematics 2023-08-30 Tomas Dominguez , Jean-Christophe Mourrat

In this paper we focus on the estimation of mutual information from finite samples $(\mathcal{X}\times\mathcal{Y})$. The main concern with estimations of mutual information is their robustness under the class of transformations for which it…

Data Analysis, Statistics and Probability · Physics 2020-02-04 Nicholas Carrara , Jesse Ernst

We present a new family of information-theoretic generalization bounds, in which the training loss and the population loss are compared through a jointly convex function. This function is upper-bounded in terms of the disintegrated,…

Machine Learning · Computer Science 2023-03-28 Fredrik Hellström , Giuseppe Durisi

The process of state preparation, its transmission and subsequent measurement can be classically simulated through the communication of some amount of classical information. Recently, we proved that the minimal communication cost is the…

Quantum Physics · Physics 2014-01-17 Alberto Montina , Stefan Wolf

Neural networks and other machine learning models compute continuous representations, while humans communicate mostly through discrete symbols. Reconciling these two forms of communication is desirable for generating human-readable…

Machine Learning · Computer Science 2022-02-14 António Farinhas , Wilker Aziz , Vlad Niculae , André F. T. Martins

Communication complexity, which quantifies the minimum communication required for distributed computation, offers a natural setting for investigating the capabilities and limitations of quantum mechanics in information processing. We…

Quantum Physics · Physics 2026-02-12 Nikolai Miklin , Prabhav Jain , Mariami Gachechiladze

Lip reading has received an increasing research interest in recent years due to the rapid development of deep learning and its widespread potential applications. One key point to obtain good performance for the lip reading task depends…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Xing Zhao , Shuang Yang , Shiguang Shan , Xilin Chen

We consider the mixed regression problem with two components, under adversarial and stochastic noise. We give a convex optimization formulation that provably recovers the true solution, and provide upper bounds on the recovery errors for…

Machine Learning · Statistics 2015-02-16 Yudong Chen , Xinyang Yi , Constantine Caramanis

Existing high-dimensional statistical methods are largely established for analyzing individual-level data. In this work, we study estimation and inference for high-dimensional linear models where we only observe "proxy data", which include…

Methodology · Statistics 2022-01-12 Sai Li , T. Tony Cai , Hongzhe Li

Meta-learning optimizes an inductive bias---typically in the form of the hyperparameters of a base-learning algorithm---by observing data from a finite number of related tasks. This paper presents an information-theoretic bound on the…

Machine Learning · Computer Science 2021-02-09 Arezou Rezazadeh , Sharu Theresa Jose , Giuseppe Durisi , Osvaldo Simeone

In this paper, we consider fundamental communication limits over a compound channel. Covert communication in the information-theoretic context has been primarily concerned with fundamental limits when the transmitter wishes to communicate…

Information Theory · Computer Science 2019-06-18 Sadaf Salehkalaibar , Mohammad Hossein Yassaee , Vincent Y. F. Tan

Classical information theory typically assumes reliable receiver-side processing. We study remote inference when communication is noisy and the receiver itself is built from unreliable components under a finite redundancy budget. Under a…

Information Theory · Computer Science 2026-04-22 Zhenyu Liu , Yi Ma , Rahim Tafazolli

With increasing volume of data being used across machine learning tasks, the capability to target specific subsets of data becomes more important. To aid in this capability, the recently proposed Submodular Mutual Information (SMI) has been…

Machine Learning · Computer Science 2024-10-28 Nathan Beck , Truong Pham , Rishabh Iyer

The inverse relation between mutual information (MI) and Bayesian error is sharpened by deriving finite sequences of upper and lower bounds on MI in terms of the minimum probability of error (MPE) and related Bayesian quantities. The well…

Information Theory · Computer Science 2014-09-24 Sudhakar Prasad

Lossy compression plays a growing role in scientific simulations where the cost of storing their output data can span terabytes. Using error bounded lossy compression reduces the amount of storage for each simulation; however, there is no…

Applications · Statistics 2021-11-30 David Krasowska , Julie Bessac , Robert Underwood , Jon C. Calhoun , Sheng Di , Franck Cappello