English
Related papers

Related papers: Pattern recognition in Deep Boltzmann machines

200 papers

We study the problem of testing and recovering $k$-clique Ferromagnetic mean shift in the planted Sherrington-Kirkpatrick model (i.e., a type of spin glass model) with $n$ spins. The planted SK model -- a stylized mixture of an uncountable…

Statistics Theory · Mathematics 2024-03-25 Yihan He , Han Liu , Jianqing Fan

In this paper we study the bipartite version of Sherrington-Kirkpatrick model. We prove that the free energy density is given by an analogue of the Parisi formula, that contains both the usual overlap and an additional new type of overlap.…

Disordered Systems and Neural Networks · Physics 2018-12-18 Liming Pan , Simone Franchini

We present a new method to solve the dynamics of disordered spin systems on finite time-scales. It involves a closed driven diffusion equation for the joint spin-field distribution, with time-dependent coefficients described by a dynamical…

Condensed Matter · Physics 2009-10-28 A. C. C. Coolen , S. N. Laughton , D. Sherrington

We consider a Lattice Gas model in which the sites interact via infinite-ranged random couplings independently distributed with a Gaussian probability density. This is the Lattice Gas analogue of the well known Sherrington-Kirkpatrick Ising…

Statistical Mechanics · Physics 2009-10-30 Francesco M. Russo

We present the full phase diagram of the spherical $2+p$ spin glass model with $p\geq 4$. The main outcome is the presence of a new phase with both properties of Full Replica Symmetry Breaking (FRSB) phases of discrete models, e.g, the…

Disordered Systems and Neural Networks · Physics 2009-11-10 A. Crisanti , L. Leuzzi

In these short notes, we adapt and systematically apply Guerra's interpolation techniques on a class of disordered mean-field spin glasses equipped with crystal fields and multi-value spin variables. These models undergo the phenomenon of…

Disordered Systems and Neural Networks · Physics 2025-05-12 Linda Albanese , Adriano Barra , Emilio N. M. Cirillo

The full mean-field solution of spin glass models with a continuous order-parameter function is not directly available and approximate schemes must be used to assess its properties. The averaged physical quantities are to be represented via…

Disordered Systems and Neural Networks · Physics 2013-03-27 V. Janis , A. Kauch , A. Klic

Through a redefinition of patterns in an Hopfield-like model, we introduce and develop an approach to model discrete systems made up of many, interacting components with inner degrees of freedom. Our approach clarifies the intrinsic…

Statistical Mechanics · Physics 2015-05-19 Elena Agliari , Adriano Barra

We analyze the free energy and the overlaps in the 2-spin spherical Sherrington Kirkpatrick spin glass model with an external field for the purpose of understanding the transition between this model and the one without an external field. We…

Disordered Systems and Neural Networks · Physics 2021-05-26 Jinho Baik , Elizabeth Collins-Woodfin , Pierre Le Doussal , Hao Wu

Francesco Guerra and Fabio Toninelli have developped a very powerful technique to study the high temperature behaviour of the Sherrington-Kirkpatrick mean field spin glass model. They show that this model is asymptoticaly comparable to a…

Probability · Mathematics 2007-05-23 Philippe Carmona

This thesis focus on the extension of the Parisi full replica symmetry breaking solution to the Ising spin glass on a random regular graph. We propose a new martingale approach, that overcomes the limits of the Parisi-M\'ezard cavity…

Statistical Mechanics · Physics 2019-11-05 Francesco Concetti

We show that the algebra of Parisi ultrametric matrices is recovered by the real-time, replica-free, Dyson-Keldysh equations of infinite-range quantum spin glasses in the late time glassy limit. This connects to earlier results on classical…

Disordered Systems and Neural Networks · Physics 2024-12-10 Johannes Lang , Subir Sachdev , Sebastian Diehl

Building a good generative model for image has long been an important topic in computer vision and machine learning. Restricted Boltzmann machine (RBM) is one of such models that is simple but powerful. However, its restricted form also has…

Machine Learning · Computer Science 2016-11-24 Hengyuan Hu , Lisheng Gao , Quanbin Ma

A specific type of neural network, the Restricted Boltzmann Machine (RBM), is implemented for classification and feature detection in machine learning. RBM is characterized by separate layers of visible and hidden units, which are able to…

Disordered Systems and Neural Networks · Physics 2012-01-11 Adriano Barra , Alberto Bernacchia , Enrica Santucci , Pierluigi Contucci

In order to study certain questions concerning the distribution of the overlap in Sherrington--Kirkpatrick type models, such as the chaos and ultrametricity problems, it seems natural to study the free energy of multiple systems with…

Probability · Mathematics 2009-09-29 Dmitry Panchenko , Michel Talagrand

We study the Riemannian geometry of the Deep Linear Network (DLN) as a foundation for a thermodynamic description of the learning process. The main tools are the use of group actions to analyze overparametrization and the use of Riemannian…

Machine Learning · Computer Science 2026-05-22 Govind Menon , Tianmin Yu

We show that multiple filamentation patterns in high-power laser beams, can be described by means of two statistical physics concepts, namely self-similarity of the patterns over two nested scales, and nearest-neighbor interactions of…

Statistical Mechanics · Physics 2015-05-27 Wahb Ettoumi , Jérôme Kasparian , Jean-Pierre Wolf

Methods for understanding classical disordered spin systems with interactions conforming to some idealized graphical structure are well developed. The equilibrium properties of the Sherrington-Kirkpatrick model, which has a densely…

Disordered Systems and Neural Networks · Physics 2013-05-29 Jack Raymond , David Saad

We present a general and powerful numerical method useful to study the density matrix of spin models. We apply the method to finite dimensional spin glasses, and we analyze in detail the four dimensional Edwards-Anderson model with Gaussian…

Disordered Systems and Neural Networks · Physics 2009-11-07 L. Correale , E. Marinari , V. Martin-Mayor

We consider $N$ i.i.d. Ising spins with mean $m\in (-1,1)$ whose interactions are described by a Sherrington-Kirkpatrick Hamiltonian with a quartic correction. This model was recently introduced by Bolthausen in \cite{Bolt2} as a toy model…

Probability · Mathematics 2024-12-10 Christian Brennecke , Adrien Schertzer