English
Related papers

Related papers: Replica Field Theory for Deterministic Models: Bin…

200 papers

The replica method is a non-rigorous but well-known technique from statistical physics used in the asymptotic analysis of large, random, nonlinear problems. This paper applies the replica method, under the assumption of replica symmetry, to…

Information Theory · Computer Science 2015-01-20 Sundeep Rangan , Alyson K. Fletcher , Vivek K Goyal

We consider restricted Boltzmann machines with a binary visible layer and a Gaussian hidden layer trained by an unlabelled dataset composed of noisy realizations of a single ground pattern. We develop a statistical mechanics framework to…

Disordered Systems and Neural Networks · Physics 2024-06-17 Alberto Fachechi , Elena Agliari , Miriam Aquaro , Anthony Coolen , Menno Mulder

Unlike the classical linear model, nonlinear generative models have been addressed sparsely in the literature of statistical learning. This work aims to bringing attention to these models and their secrecy potential. To this end, we invoke…

Information Theory · Computer Science 2022-07-15 Ali Bereyhi , Bruno Loureiro , Florent Krzakala , Ralf R. Müller , Hermann Schulz-Baldes

The Laplace approximation (LA) to posteriors is a ubiquitous tool to simplify Bayesian computation, particularly in the high-dimensional settings arising in Bayesian inverse problems. Precisely quantifying the LA accuracy is a challenging…

Statistics Theory · Mathematics 2025-09-10 Anya Katsevich , Vladimir Spokoiny

Many real-world systems studied are governed by complex, nonlinear dynamics. By modeling these dynamics, we can gain insight into how these systems work, make predictions about how they will behave, and develop strategies for controlling…

Machine Learning · Statistics 2019-06-05 Josue Nassar , Scott W. Linderman , Monica Bugallo , Il Memming Park

This paper deals with developing techniques for the reconstruction of high-dimensional datasets given each bivariate projection, as would be found in a matrix scatterplot. A graph-based solution is introduced, involving clique-finding,…

Machine Learning · Computer Science 2023-12-27 Eli Dugan , Klaus Mueller

The ability to understand and solve high-dimensional inference problems is essential for modern data science. This article examines high-dimensional inference problems through the lens of information theory and focuses on the standard…

Information Theory · Computer Science 2019-07-05 Galen Reeves , Henry Pfister

In this paper we look at a class of random optimization problems that arise in the forms typically known in statistical physics as Little models. In \cite{BruParRit92} the Little models were studied by means of the well known tool from the…

Optimization and Control · Mathematics 2013-06-19 Mihailo Stojnic

We present an algorithm for solving binary classification problems when the dataset is not fully representative of the problem being solved, and obtaining more data is not possible. It relies on a trained model with loose accuracy…

Machine Learning · Computer Science 2025-07-11 Adrian de Wynter

Recovering microscopic couplings directly from data provides a route to solving the inverse problem in statistical field theories, one that complements the traditional-often computationally intractable-forward approach of predicting…

Statistical Mechanics · Physics 2025-11-24 Shreya Shukla , Abhijith Jayakumar , Andrey Y. Lokhov

We consider increasingly complex models of matrix denoising and dictionary learning in the Bayes-optimal setting, in the challenging regime where the matrices to infer have a rank growing linearly with the system size. This is in contrast…

Information Theory · Computer Science 2022-09-14 Jean Barbier , Nicolas Macris

A system of replicators with Hebbian random couplings is studied using dynamical methods. The self-reproducing species are here characterized by a set of binary traits and interact based on complementarity. In the case of an extensive…

Disordered Systems and Neural Networks · Physics 2009-11-11 Tobias Galla

We present a tree-tensor-network-based method to study strongly correlated systems with nonlocal interactions in higher dimensions. Although the momentum-space and quantum-chemistry versions of the density matrix renormalization group…

Strongly Correlated Electrons · Physics 2010-11-08 Valentin Murg , Örs Legeza , Reinhard M. Noack , Frank Verstraete

We study hierarchies of replica-symmetry-breaking solutions of the Sherrington-Kirkpatrick model. Stationarity equations for order parameters of solutions with an arbitrary number of hierarchies are set and the limit to infinite number of…

Disordered Systems and Neural Networks · Physics 2008-09-16 V Janis , A. Klic , M. Ringel

Linear response theory is a well-established method in physics and chemistry for exploring excitations of many-body systems. In particular, the quasiparticle random-phase approximation (QRPA) provides a powerful microscopic framework by…

Computational Physics · Physics 2025-10-17 L. Jin , A. Ravlić , P. Giuliani , K. Godbey , W. Nazarewicz

We consider the demixing problem of two (or more) high-dimensional vectors from nonlinear observations when the number of such observations is far less than the ambient dimension of the underlying vectors. Specifically, we demonstrate an…

Machine Learning · Statistics 2017-01-25 Mohammadreza Soltani , Chinmay Hegde

The replicated field theory of the random field Ising model involves the couplings of replicas of different indices. The resulting correlation functions involve a superposition of different types of long distance behaviours. However the…

Condensed Matter · Physics 2009-10-31 E. Brézin , De Dominicis

We investigate dense higher-order associative memories in the high storage regime when the stored patterns are biased, namely when the entries of the patterns are not symmetrically distributed around zero. In this setting, the standard…

Disordered Systems and Neural Networks · Physics 2026-04-06 Linda Albanese , Andrea Alessandrelli , Federico Carella

We revisit the replica method for analyzing inference and learning in parametric models, considering situations where the data-generating distribution is unknown or analytically intractable. Instead of assuming idealized distributions to…

Disordered Systems and Neural Networks · Physics 2025-11-17 Takashi Takahashi

We consider a generic time-reversal invariant model of fermions hopping randomly on a square lattice. By means of the conventional replica-trick within the fermionic path-integral formalism, the model is mapped onto a non-linear sigma-model…

Disordered Systems and Neural Networks · Physics 2009-11-11 Luca Dell'Anna