English
Related papers

Related papers: A statistical physics approach to learning curves …

200 papers

We discuss several algorithms for sampling from unnormalized probability distributions in statistical physics, but using the language of statistics and machine learning. We provide a self-contained introduction to some key ideas and…

Computation · Statistics 2025-05-05 Michael F. Faulkner , Samuel Livingstone

The notion of duality -- that a given physical system can have two different mathematical descriptions -- is a key idea in modern theoretical physics. Establishing a duality in lattice statistical mechanics models requires the construction…

Statistical Mechanics · Physics 2024-11-08 Andrea E. V. Ferrari , Prateek Gupta , Nabil Iqbal

We study Ising chains with arbitrary multispin finite-range couplings, providing an explicit solution of the associated inverse Ising problem, i.e. the problem of inferring the values of the coupling constants from the correlation…

Statistical Mechanics · Physics 2011-11-16 Giacomo Gori , Andrea Trombettoni

The couplings in a sparse asymmetric, asynchronous Ising network are reconstructed using an exact learning algorithm. L$_1$ regularization is used to remove the spurious weak connections that would otherwise be found by simply minimizing…

Methodology · Statistics 2012-11-19 Hong-Li Zeng , John Hertz , Yasser Roudi

We study two-dimensional Ising spins, evolving through reinforcement learning using their state, action, and reward. The state of a spin is defined as whether it is in the majority or minority with its nearest neighbours. The spin updates…

Statistical Mechanics · Physics 2022-11-22 Pranay Bimal Sampat , Ananya Verma , Riya Gupta , Shradha Mishra

Inferring a generative model from data is a fundamental problem in machine learning. It is well-known that the Ising model is the maximum entropy model for binary variables which reproduces the sample mean and pairwise correlations.…

Statistical Mechanics · Physics 2018-06-19 Soma Turi , Alpha A. Lee

We study the statistical Ising model of spins on the infinite lattice using a bootstrap method that combines spin-flip identities with positivity conditions, including reflection positivity and Griffiths inequalities, to derive rigorous…

High Energy Physics - Theory · Physics 2022-07-04 Minjae Cho , Barak Gabai , Ying-Hsuan Lin , Victor A. Rodriguez , Joshua Sandor , Xi Yin

The two-dimensional random-bond Ising model is numerically studied on long strips by transfer-matrix methods. It is shown that the rate of decay of correlations at criticality, as derived from averages of the two largest Lyapunov exponents…

Condensed Matter · Physics 2009-10-22 S. L. A. de Queiroz

Recent work has shown that probabilistic models based on pairwise interactions-in the simplest case, the Ising model-provide surprisingly accurate descriptions of experiments on real biological networks ranging from neurons to genes.…

Quantitative Methods · Quantitative Biology 2007-12-18 Tamara Broderick , Miroslav Dudik , Gasper Tkacik , Robert E. Schapire , William Bialek

Using a variational technique, we generalize the statistical physics approach of learning from random examples to make it applicable to real data. We demonstrate the validity and relevance of our method by computing approximate estimators…

Disordered Systems and Neural Networks · Physics 2009-11-07 D. Malzahn , M. Opper

We consider long strips of finite width $L \leq 13$ sites of ferromagnetic Ising spins with random couplings distributed according to the binary distribution: $P(J_{ij})= {1 \over 2} ( \delta (J_{ij} -J_0) + \delta (J_{ij} -rJ_0) ) ,\ 0 < r…

Condensed Matter · Physics 2009-10-28 S. L. A. de Queiroz , R. B. Stinchcombe

The Ising model is a celebrated example of a Markov random field, introduced in statistical physics to model ferromagnetism. This is a discrete exponential family with binary outcomes, where the sufficient statistic involves a quadratic…

Statistics Theory · Mathematics 2021-09-08 Somabha Mukherjee

I propose a variational approach to maximum pseudolikelihood inference of the Ising model. The variational algorithm is more computationally efficient, and does a better job predicting out-of-sample correlations than $L_2$ regularized…

Statistical Mechanics · Physics 2014-09-26 Charles K. Fisher

In this paper, we applied a deep neural network to study the issue of knowledge transferability between statistical mechanics models. The following computer experiment was conducted. A convolutional neural network was trained to solve the…

Disordered Systems and Neural Networks · Physics 2024-11-21 Diana Sukhoverkhova , Lev Shchur

This thesis is interested in the application of statistical physics methods and inference to sparse linear estimation problems. The main tools are the graphical models and approximate message-passing algorithm together with the cavity…

Information Theory · Computer Science 2015-11-06 Jean Barbier

We propose a novel quantum technique to search for unmodeled anomalies in multidimensional binned collider data. We propose associating an Ising lattice spin site with each bin, with the Ising Hamiltonian suitably constructed from the…

High Energy Physics - Phenomenology · Physics 2025-06-30 Konstantin T. Matchev , Prasanth Shyamsundar , Jordan Smolinsky

Concepts and techniques from statistical physics inspired a new method for traffic prediction. This method is particularly suitable in settings where the only information available is floating car data. We propose a system, based on the…

Probability · Mathematics 2007-05-23 Arnaud De La Fortelle , Jean-Marc Lasgouttes , Cyril Furtlehner

For the formal verification and design of control systems, abstractions with quantified accuracy are crucial. This is especially the case when considering accurate deviation bounds between a stochastic continuous-state model and its finite…

Systems and Control · Electrical Eng. & Systems 2022-01-19 B. C. van Huijgevoort , S. Haesaert

Using a formalism based on the spectral decomposition of the replicated transfer matrix for disordered Ising models, we obtain several results that apply both to isolated one-dimensional systems and to locally tree-like graph and factor…

Disordered Systems and Neural Networks · Physics 2014-08-04 Carlo Lucibello , Flaviano Morone , Tommaso Rizzo

We consider the problem of learning the underlying graph of an unknown Ising model on p spins from a collection of i.i.d. samples generated from the model. We suggest a new estimator that is computationally efficient and requires a number…

Machine Learning · Computer Science 2017-04-17 Marc Vuffray , Sidhant Misra , Andrey Y. Lokhov , Michael Chertkov