English
Related papers

Related papers: The Mean-Field Approximation: Information Inequali…

200 papers

This report considers the problem of computing the Cramer-Rao bound for the parameters of a Markov random field. Computation of the exact bound is not feasible for most fields of interest because their likelihoods are intractable and have…

Computation · Statistics 2013-09-18 Marcelo Pereyra , Nicolas Dobigeon , Hadj Batatia , Jean-Yves Tourneret

We develop an elementary mean field approach for fully asymmetric kinetic Ising models, which can be applied to a single instance of the problem. In the case of the asymmetric SK model this method gives the exact values of the local…

Disordered Systems and Neural Networks · Physics 2015-05-27 M. Mezard , J. Sakellariou

Mean-Field is an efficient way to approximate a posterior distribution in complex graphical models and constitutes the most popular class of Bayesian variational approximation methods. In most applications, the mean field distribution…

Machine Learning · Computer Science 2015-02-23 Pierre Baqué , Jean-Hubert Hours , François Fleuret , Pascal Fua

We study the large-population limit of interacting particle systems evolving on adaptive dynamical networks, motivated in particular by models of opinion dynamics. In such systems, agents interact through weighted graphs whose structure…

Analysis of PDEs · Mathematics 2026-01-13 Nathalie Ayi

We enlighten some critical aspects of the three-dimensional ($d=3$) random-field Ising model from simulations performed at zero temperature. We consider two different, in terms of the field distribution, versions of model, namely a Gaussian…

Disordered Systems and Neural Networks · Physics 2015-01-13 P. E. Theodorakis , N. G. Fytas

Solving the error correcting code is an important goal with regard to communication theory.To reveal the error correcting code characteristics, several researchers have applied a statistical-mechanical approach to this problem. In our…

Disordered Systems and Neural Networks · Physics 2007-05-23 Masami Takata , Hayaru Shouno , Kazuki Joe , Masato Okada

Non-linear dynamics in the quantum random walk setting have been shown to enable conditional speedup of Grover's algorithm. We examine the mean field approximation required for the use of the Gross-Pitaevskii equation on identical bosons…

Quantum Physics · Physics 2019-11-01 Alexander Meill , David A. Meyer

Periodic boundary conditions are applied to a ferromagnetic spin lattice. A symmetrical lattice and its contributions all over space are being used. Results, for the Ising model with ferromagnetic interaction that decays as a $1/r^{D+\nu}$…

Statistical Mechanics · Physics 2009-11-10 Sergio Curilef

We study the mixing time of Glauber dynamics for Ising models in which the interaction matrix contains a single negative spectral outlier. This class includes the anti-ferromagnetic Curie-Weiss model, the anti-ferromagnetic Ising model on…

Probability · Mathematics 2026-04-09 Dan Mikulincer , Youngtak Sohn

Mean field approximation is a powerful technique to study the performance of large stochastic systems represented as $n$ interacting objects. Applications include load balancing models, epidemic spreading, cache replacement policies, or…

Performance · Computer Science 2021-11-03 Sebastian Allmeier , Nicolas Gast

This paper studies a general class of stochastic population processes in which agents interact with one another over a network. Agents update their behaviors in a random and decentralized manner according to a policy that depends only on…

Probability · Mathematics 2023-07-21 Anirudh Sridhar , Soummya Kar

Mean field approximation is a powerful technique which has been used in many settings to study large-scale stochastic systems. In the case of two-timescale systems, the approximation is obtained by a combination of scaling arguments and the…

Probability · Mathematics 2023-01-24 Sebastian Allmeier , Nicolas Gast

Networks that have power-law connectivity, commonly referred to as the scale-free networks, are an important class of complex networks. A heterogeneous mean-field approximation has been previously proposed for the Ising model of the…

Disordered Systems and Neural Networks · Physics 2020-05-12 Jeyashree Krishnan , Reza Torabi , Edoardo Di Napoli , Carsten Honerkamp , Andreas Schuppert

This is a technical report which explores the estimation methodologies on hyper-parameters in Markov Random Field and Gaussian Hidden Markov Random Field. In first section, we briefly investigate a theoretical framework on…

Machine Learning · Statistics 2017-11-22 Namjoon Suh

Continuous-time Bayesian networks is a natural structured representation language for multicomponent stochastic processes that evolve continuously over time. Despite the compact representation, inference in such models is intractable even…

Artificial Intelligence · Computer Science 2012-05-14 Ido Cohn , Tal El-Hay , Nir Friedman , Raz Kupferman

This work provides a theoretical framework for assessing the generalization error of graph neural networks in the over-parameterized regime, where the number of parameters surpasses the quantity of data points. We explore two widely…

Machine Learning · Statistics 2024-07-02 Gholamali Aminian , Yixuan He , Gesine Reinert , Łukasz Szpruch , Samuel N. Cohen

We consider the problem of function approximation by two-layer neural nets with random weights that are "nearly Gaussian" in the sense of Kullback-Leibler divergence. Our setting is the mean-field limit, where the finite population of…

Machine Learning · Computer Science 2024-06-25 Belinda Tzen , Maxim Raginsky

We propose a novel framework for exploring weak and $L_2$ generalization errors of algorithms through the lens of differential calculus on the space of probability measures. Specifically, we consider the KL-regularized empirical risk…

Machine Learning · Statistics 2023-06-21 Gholamali Aminian , Samuel N. Cohen , Łukasz Szpruch

We study a ferromagnetic Ising model on random graphs with a power-law degree distribution and compute the thermodynamic limit of the pressure when the mean degree is finite (degree exponent $\tau>2$), for which the random graph has a…

Probability · Mathematics 2011-07-01 Sander Dommers , Cristian Giardinà , Remco van der Hofstad

Using combinatorial optimisation techniques we study the critical properties of the two- and the three-dimensional Ising model with uniformly distributed random antiferromagnetic couplings $(1 \le J_i \le 2)$ in the presence of a…

Disordered Systems and Neural Networks · Physics 2022-06-08 Jean-Christian Anglès d'Auriac , Ferenc Iglói