English
Related papers

Related papers: A statistical physics approach to learning curves …

200 papers

In this paper we study the inference of the kinetic Ising model on sparse graphs by the decimation method. The decimation method, which was first proposed in [Phys. Rev. Lett. 112, 070603] for the static inverse Ising problem, tries to…

Disordered Systems and Neural Networks · Physics 2016-06-30 Aurélien Decelle , Pan Zhang

Learning Gibbs distributions using only sufficient statistics has long been recognized as a computationally hard problem. On the other hand, computationally efficient algorithms for learning Gibbs distributions rely on access to full sample…

Machine Learning · Computer Science 2026-02-16 Abhijith Jayakumar , Shreya Shukla , Marc Vuffray , Andrey Y. Lokhov , Sidhant Misra

Statistical physics is used to investigate independent component analysis with polynomial contrast functions. While the replica method fails, an adapted cavity approach yields valid results. The learning curves, obtained in a suitable…

Disordered Systems and Neural Networks · Physics 2009-11-10 R. Urbanczik

We propose an algorithm to obtain numerically approximate solutions of the direct Ising problem, that is, to compute the free energy and the equilibrium observables of spin systems with arbitrary two-spin interactions. To this purpose we…

Statistical Mechanics · Physics 2019-11-20 Simona Cocco , Giancarlo Croce , Francesco Zamponi

Inverse problems arise in situations where data is available, but the underlying model is not. It can therefore be necessary to infer the parameters of the latter starting from the former. Statistical mechanics offers a toolbox of…

Statistical Mechanics · Physics 2025-07-04 Stefano Bae , Dario Bocchi , Luca Maria Del Bono , Luca Leuzzi

Error-mitigation methods for Ising machines are reexamined not merely as noise-suppression techniques but as a structural design problem of replica-coupled Ising models. Using simulated annealing as a hardware-noise-free testbed, we…

Statistical Mechanics · Physics 2026-01-15 Tetsuro Abe , Kanta Hino , Shu Tanaka

A one-dimensional flocking model using active Ising spins is studied, where the system evolves through the reinforcement learning approach \textit{via} defining state, action, and cost function for each spin. The orientation of spin with…

Soft Condensed Matter · Physics 2024-12-02 Anish Kumar , Pawan Kumar Mishra , Riya Singh , Shradha Mishra , Debaprasad Giri

Statistical inverse learning aims at recovering an unknown function $f$ from randomly scattered and possibly noisy point evaluations of another function $g$, connected to $f$ via an ill-posed mathematical model. In this paper we blend…

Statistics Theory · Mathematics 2024-01-22 Tapio Helin

Correlations between two variables of a high-dimensional system can be indicative of an underlying interaction, but can also result from indirect effects. Inverse Ising inference is a method to distinguish one from the other. Essentially,…

Populations and Evolution · Quantitative Biology 2014-12-10 Benedikt Obermayer , Erel Levine

We revisit the problem of efficiently learning the underlying parameters of Ising models from data. Current algorithmic approaches achieve essentially optimal sample complexity when given i.i.d. samples from the stationary measure and the…

Machine Learning · Computer Science 2023-11-16 Jason Gaitonde , Elchanan Mossel

Recent remarkable advances in the experimental techniques have provided a background for inferring neuronal couplings from point process data that includes a great number of neurons. Here, we propose a systematic procedure for pre- and…

Disordered Systems and Neural Networks · Physics 2020-07-08 Yu Terada , Tomoyuki Obuchi , Takuya Isomura , Yoshiyuki Kabashima

Inverse Ising inference allows pairwise interactions of complex binary systems to be reconstructed from empirical correlations. Typical estimators used for this inference, such as Pseudo-likelihood maximization (PLM), are biased. Using the…

Disordered Systems and Neural Networks · Physics 2023-07-19 Maximilian Benedikt Kloucek , Thomas Machon , Shogo Kajimura , C. Patrick Royall , Naoki Masuda , Francesco Turci

Ising models originated in statistical physics and are widely used in modeling spatial data and computer vision problems. However, statistical inference of this model remains challenging due to intractable nature of the normalizing constant…

Methodology · Statistics 2021-09-06 Minwoo Kim , Shrijita Bhattacharya , Tapabrata Maiti

If we have a system of binary variables and we measure the pairwise correlations among these variables, then the least structured or maximum entropy model for their joint distribution is an Ising model with pairwise interactions among the…

Disordered Systems and Neural Networks · Physics 2014-09-12 Michele Castellana , William Bialek

The construction of a statistical model for eigenfunctions of the Ising model in transverse and longitudinal fields is discussed in detail for the chaotic case. When the number of spins is large, each wave function coefficient has the…

Mathematical Physics · Physics 2015-03-17 Y. Y. Atas , E. Bogomolny

Based on dynamical cavity method, we propose an approach to the inference of kinetic Ising model, which asks to reconstruct couplings and external fields from given time-dependent output of original system. Our approach gives an exact…

Statistical Mechanics · Physics 2012-07-24 Pan Zhang

We present a procedure to solve the inverse Ising problem, that is to find the interactions between a set of binary variables from the measure of their equilibrium correlations. The method consists in constructing and selecting specific…

Disordered Systems and Neural Networks · Physics 2015-05-30 Simona Cocco , Rémi Monasson

The use of statistical physics to study problems of social sciences is motivated and its current state of the art briefly reviewed, in particular for the case of discrete choice making. The coupling of two binary choices is studied in some…

Physics and Society · Physics 2011-04-27 Ana Fernández del Río

Inference and learning of graphical models are both well-studied problems in statistics and machine learning that have found many applications in science and engineering. However, exact inference is intractable in general graphical models,…

Machine Learning · Statistics 2010-11-16 Jason K. Johnson , Praneeth Netrapalli , Michael Chertkov

We present a systematic small-correlation expansion to solve the inverse Ising problem: find a set of couplings and fields corresponding to a given set of correlations and magnetizations. Couplings are calculated up to the third order in…

Disordered Systems and Neural Networks · Physics 2009-01-07 Vitor Sessak , Rémi Monasson