Related papers: Parisi Phase in a Neuron
We introduce a hierarchical class of approximations of the random Ising spin glass in $d$ dimensions. The attention is focused on finite clusters of spins where the action of the rest of the system is properly taken into account. At the…
We solve the random energy model when the energies of the configurations take only integer values. In the thermodynamic limit, the average overlaps remain size dependent and oscillate as the system size increases. While the extensive part…
The thermal and phase properties of a multifragmentation model which uses clusters as degrees of freedom, are explored as a function of isospin. A good qualitative agreement is found with the phase diagram of asymmetric nuclear matter as…
The activity of a neural network is defined by patterns of spiking and silence from the individual neurons. Because spikes are (relatively) sparse, patterns of activity with increasing numbers of spikes are less probable, but with more…
Neuronal responses are conspicuously variable. We focus on one particular aspect of that variability: the precision of action potential timing. We show that for common models of noisy spike generation, elementary considerations imply that…
Spontaneous symmetry breaking in statistical mechanics primarily occurs during phase transitions at the thermodynamic limit where the Hamiltonian preserves inversion symmetry, yet the low-temperature free energy exhibits reduced symmetry.…
We consider mean-field vector spin glasses with self-overlap correction. The limit of free energy is known to be the Parisi formula, which is an infimum over matrix-valued paths. We decompose such a path into a Lipschitz matrix-valued path…
In this paper we develop a method introduced by one of us to study metastable states in spin glasses. We consider a `potential function' defined as the free energy of a system at a given temperature $T$ constrained to have a fixed overlap…
The brain is a biological system comprising nerve cells and orchestrates its embodied agent's perception, behavior, and learning in the dynamic environment. The free energy principle (FEP) advocated by Karl Friston explicates the local,…
The field of disordered systems provides many simple models in which the competing influences of thermal and non-thermal disorder lead to new phases and non-trivial thermal behavior of order parameters. In this paper, we add a model to the…
We explore a one-to-one correspondence between a neural network (NN) and a statistical mechanical spin model where neurons are mapped to Ising spins and weights to spin-spin couplings. The process of training an NN produces a family of spin…
We present a simple model that recalls two different patterns depending on the temperature. To realize a change in recall pattern due to temperature change, we embed two patterns to different graphs: the first pattern into a fully connected…
Using numerical self-consistent solutions of a sequence of finite replica symmetry breakings (RSB) and Wilson's renormalization group but with the number of RSB-steps playing a role of decimation scales, we report evidence for a non-trivial…
The spherical version of the Hopfield model for pattern recognition is considered in the static limit. Structures inside the patterns are modeled by Gaussian random variables that reward correlation between pairs of spins in a given…
We report large-scale simulations of the three-dimensional Edwards-Anderson Ising spin glass system using the recently introduced multi-overlap Monte Carlo algorithm. In this approach the temperature is fixed and two replica are coupled…
Understanding the glassy nature of neural networks is pivotal both for theoretical and computational advances in Machine Learning and Theoretical Artificial Intelligence. Keeping the focus on dense associative Hebbian neural networks, the…
Aging in spin glasses (and in some other systems) reveals astonishing effects of `rejuvenation and memory' upon temperature changes. In this paper, we propose microscopic mechanisms (at the scale of spin-spin interactions) which can be at…
We numerically study a disordered model for the RNA secondary structure and we find that it undergoes a phase transition, with a breaking of the replica symmetry in the low temperature region (like in spin glasses). Our results are based on…
This paper provides a perspective on applying the concepts of information thermodynamics, developed recently in non-equilibrium statistical physics, to problems in theoretical neuroscience. Historically, information and energy in…
The Sherrington-Kirkpatrick spin-glass model is investigated by means of Monte Carlo simulations employing a combination of the multi-overlap algorithm with parallel tempering methods. We investigate the finite-size scaling behaviour of the…