English
Related papers

Related papers: Pattern recognition in Deep Boltzmann machines

200 papers

We present a feature learning model that learns to encode relationships between images. The model is defined as a Gated Boltzmann Machine, which is constrained such that hidden units that are nearby in space can gate each other's…

Machine Learning · Computer Science 2013-03-12 Felix Bauer , Roland Memisevic

We study the free energy of a most used deep architecture for restricted Boltzmann machines, where the layers are disposed in series. Assuming independent Gaussian distributed random weights, we show that the error term in the so-called…

Disordered Systems and Neural Networks · Physics 2022-07-08 Giuseppe Genovese

Statistical mechanics of spin glasses is one of the main strands toward a comprehension of information processing by neural networks and learning machines. Tackling this approach, at the fairly standard replica symmetric level of…

Disordered Systems and Neural Networks · Physics 2023-12-18 Linda Albanese , Andrea Alessandrelli , Alessia Annibale , Adriano Barra

We elaborate on a general method that we recently introduced for characterizing the "natural" structures in complex physical systems via a multiscale network based approach for the data mining of such structures. The approach is based on…

Materials Science · Physics 2015-03-18 P. Ronhovde , S. Chakrabarty , D. Hu , M. Sahu , K. F. Kelton , N. A. Mauro , K . K. Sahu , Z. Nussinov

We develop a field theory for spin glasses using Replica Fourier Transforms (RFT). We present the formalism for the case of replica symmetry and the case of replica symmetry breaking on an ultrametric tree, with the number of replicas $n$…

Disordered Systems and Neural Networks · Physics 2015-06-23 I. R. Pimentel , C. De Dominicis

The authors of [Ann. Henri Poincar\'{e} 16 (2015) 691-708] introduced a multi-species version of the Sherrington-Kirkpatrick model and suggested the analogue of the Parisi formula for the free energy. Using a variant of Guerra's replica…

Probability · Mathematics 2015-12-23 Dmitry Panchenko

We investigate the connection between the well known Sherrington-Kirkpatrick Ising Spin Glass and the corresponding Lattice Gas model by analyzing the relation between their thermodynamical functions. We present results of replica approach…

Statistical Mechanics · Physics 2009-10-30 Francesco M. Russo

In this paper we study two non-mean-field spin models built on a hierarchical lattice: The hierarchical Edward-Anderson model (HEA) of a spin glass, and Dyson's hierarchical model (DHM) of a ferromagnet. For the HEA, we prove the existence…

Mathematical Physics · Physics 2014-09-09 Michele Castellana , Adriano Barra , Francesco Guerra

We consider a one-step replica symmetry breaking description of the Edwards-Anderson spin glass model in 2D. The ingredients of this description are a Kikuchi approximation to the free energy and a second-level statistical model built on…

Disordered Systems and Neural Networks · Physics 2016-08-24 Gino Del Ferraro , Chuang Wang , Hai-Jun Zhou , Erik Aurell

We study the Hopfield model where the ratio $\alpha$ of patterns to sites grows large. We prove that the free energy with inverse temperature $\beta$ and external field $B$ behaves like $\beta\sqrt\alpha+\gamma$, where $\gamma$ is the…

Probability · Mathematics 2012-10-15 James Y. Zhao

A review of the replica symmetric solution of the classical and quantum, infinite-range, Sherrington-Kirkpatrick spin glass is presented.

Statistical Mechanics · Physics 2017-06-27 A. P. Young

A systematic study for a single-specie lattice Boltzmann model with frustrated-short range attractive and mid/long-range repulsive-interactions is presented. The equilibrium analysis is performed along the guidelines proposed by [X. Shan,…

Soft Condensed Matter · Physics 2014-02-26 M. Sbragaglia , R. Benzi , M. Bernaschi S. Succi

Restricted Boltzmann machines (RBMs) constitute one of the main models for machine statistical inference and they are widely employed in Artificial Intelligence as powerful tools for (deep) learning. However, in contrast with countless…

Disordered Systems and Neural Networks · Physics 2019-03-12 Elena Agliari , Adriano Barra , Brunello Tirozzi

We study the Hopfield model with pure $p$-spin interactions with even $p\geq 4$, and a number of patterns, M(N) growing with the system size, $N$, as $M(N) = \a N^{p-1}$. We prove the existence of a critical temperature $\b_p$ characterized…

Disordered Systems and Neural Networks · Physics 2007-05-23 Anton Bovier , Beat Niederhauser

We study numerically a disordered model that interpolates among the Sherrington-Kirkpatrick mean field model and the three dimensional Edwards-Anderson spin glass. We find that averages over the disorder of powers of the overlap and of the…

Disordered Systems and Neural Networks · Physics 2009-10-31 E. Marinari

Speckles arise when coherent light interacts with biological tissues. Information retrieval from speckles is desired yet challenging, requiring understanding or mapping of the multiple scattering process, or reliable capability to reverse…

Image and Video Processing · Electrical Eng. & Systems 2020-05-05 Huanhao Li , Zhipeng Yu , Yunqi Luo , Shengfu Cheng , Lihong V. Wang , Yuanjin Zheng , Puxiang Lai

We study numerically the Sherrington--Kirkpatrick model as function of the magnetic field h, with fixed temperature T=0.6 Tc. We investigate the finite size scaling behavior of several quantities, such as the spin glass susceptibility,…

Statistical Mechanics · Physics 2009-11-10 Alain Billoire , Barbara Coluzzi

Spin glasses, generally defined as disordered systems with randomized competing interactions, are a widely investigated complex system. Theoretical models describing spin glasses are broadly used in other complex systems, such as those…

We introduce a new disordered system, the Super-Potts model, which is a more frustrated version of the Potts glass. Its elementary degrees of freedom are variables that can take M values and are coupled via pair-wise interactions. Its exact…

Disordered Systems and Neural Networks · Physics 2015-01-15 Maria Chiara Angelini , Giulio Biroli

p-spin glasses, characterized by frustrated many-body interactions beyond the conventional pairwise case (p>2), are prototypical disordered systems whose ground-state search is NP-hard and computationally prohibitive for large instances.…

Disordered Systems and Neural Networks · Physics 2026-02-19 Li Zeng , Mutian Shen , Tianle Pu , Zohar Nussinov , Qing Feng , Chao Chen , Zhong Liu , Changjun Fan