English
Related papers

Related papers: Information-theoretic thresholds from the cavity m…

200 papers

While many multiple graph inference methodologies operate under the implicit assumption that an explicit vertex correspondence is known across the vertex sets of the graphs, in practice these correspondences may only be partially or…

Machine Learning · Statistics 2017-09-29 Vince Lyzinski

We consider the estimation of a n-dimensional vector x from the knowledge of noisy and possibility non-linear element-wise measurements of xxT , a very generic problem that contains, e.g. stochastic 2-block model, submatrix localization or…

Information Theory · Computer Science 2017-03-24 Florent Krzakala , Jiaming Xu , Lenka Zdeborová

We define the information threshold as the point of maximum curvature in the prior vs. posterior Bayesian curve, both of which are described as a function of the true positive and negative rates of the classification system in question. The…

Machine Learning · Statistics 2022-06-07 Jacques Balayla

Improving a result of Dyer, Frieze and Greenhill [Journal of Combinatorial Theory, Series B, 2015], we determine the $q$-colorability threshold in random $k$-uniform hypergraphs up to an additive error of $\ln 2+\varepsilon_q$, where…

Discrete Mathematics · Computer Science 2018-04-16 Peter Ayre , Amin Coja-Oghlan , Catherine Greenhill

We consider the problem of recovering the community structure in the stochastic block model with two communities. We aim to describe the mutual information between the observed network and the actual community structure in the sparse…

Probability · Mathematics 2023-08-30 Tomas Dominguez , Jean-Christophe Mourrat

The Fisher-Rao metric from Information Geometry is related to phase transition phenomena in classical statistical mechanics. Several studies propose to extend the use of Information Geometry to study more general phase transitions in…

Statistical Mechanics · Physics 2016-05-04 Omri Har Shemesh , Rick Quax , Alfons G. Hoekstra , Peter M. A. Sloot

We examine the relationship between the mutual information between the output model and the empirical sample and the generalization of the algorithm in the context of stochastic convex optimization. Despite increasing interest in…

Machine Learning · Computer Science 2024-01-17 Roi Livni

Factorizing low-rank matrices has many applications in machine learning and statistics. For probabilistic models in the Bayes optimal setting, a general expression for the mutual information has been proposed using heuristic statistical…

Information Theory · Computer Science 2017-03-24 Jean Barbier , Mohamad Dia , Nicolas Macris , Florent Krzakala , Thibault Lesieur , Lenka Zdeborova

(abridged) In this paper, we present the issues we consider as essential as far as the statistical mechanics of finite systems is concerned. In particular, we emphasis our present understanding of phase transitions in the framework of…

Statistical Mechanics · Physics 2012-02-20 P. Chomaz , F. Gulminelli

We characterize the statistical bootstrap for the estimation of information-theoretic quantities from data, with particular reference to its use in the study of large-scale social phenomena. Our methods allow one to preserve, approximately,…

Information Theory · Computer Science 2013-06-06 Simon DeDeo , Robert X. D. Hawkins , Sara Klingenstein , Tim Hitchcock

We examine a class of deep learning models with a tractable method to compute information-theoretic quantities. Our contributions are three-fold: (i) We show how entropies and mutual informations can be derived from heuristic statistical…

Machine Learning · Computer Science 2020-01-22 Marylou Gabrié , Andre Manoel , Clément Luneau , Jean Barbier , Nicolas Macris , Florent Krzakala , Lenka Zdeborová

We study the discrete-time threshold-$\theta \geq 2$ contact process on random graphs of general degrees. For random graphs with a given degree distribution $\mu$, we show that if $\mu$ is lower bounded by $\theta+2$ and has finite $k$th…

Probability · Mathematics 2019-07-12 Danny Nam

A method is introduced for studying large deviations in the context of statistical physics of disordered systems. The approach, based on an extension of the cavity method to atypical realizations of the quenched disorder, allows us to…

Disordered Systems and Neural Networks · Physics 2009-11-11 Olivier Rivoire

Estimating the mutual information from samples from a joint distribution is a challenging problem in both science and engineering. In this work, we realize a variational bound that generalizes both discriminative and generative approaches.…

Machine Learning · Statistics 2023-06-05 Marco Federici , David Ruhe , Patrick Forré

In this paper we propose a method of proving impossibility results based on applying strong data-processing inequalities to estimate mutual information between sets of variables forming certain Markov random fields. The end result is that…

Information Theory · Computer Science 2020-05-22 Yury Polyanskiy , Yihong Wu

We recall some of the history of the information-theoretic approach to deriving core results in probability theory and indicate parts of the recent resurgence of interest in this area with current progress along several interesting…

Probability · Mathematics 2022-04-28 Lampros Gavalakis , Ioannis Kontoyiannis

The presence of symmetries imposes a stringent set of constraints on a system. This constrained structure allows intelligent agents interacting with such a system to drastically improve the efficiency of learning and generalization, through…

Information Theory · Computer Science 2024-10-03 Hippolyte Charvin , Nicola Catenacci Volpi , Daniel Polani

Renormalization is an essential technique in field-theoretic descriptions of natural phenomena, where the absence of a UV-complete description yields an abundance of divergent quantities. While the renormalization prescription has been…

High Energy Physics - Theory · Physics 2025-11-14 Brenden Bowen , Albert Farah , Spasen Chaykov , Nishant Agarwal

We develop a statistical theory describing quantum-mechanical scattering of a particle by a cavity when the geometry is such that the classical dynamics is chaotic. This picture is relevant to a variety of systems, ranging from atomic…

Mesoscale and Nanoscale Physics · Physics 2009-10-31 P. A. Mello , H. U. Baranger

We consider high dimensional Wishart matrices $\mathbb{X} \mathbb{X}^{\top}$ where the entries of $\mathbb{X} \in {\mathbb{R}^{n \times d}}$ are i.i.d. from a log-concave distribution. We prove an information theoretic phase transition:…

Probability · Mathematics 2018-08-14 Sébastien Bubeck , Shirshendu Ganguly