English
Related papers

Related papers: Learning performance in inverse Ising problems wit…

200 papers

Using methods of statistical physics, we analyse the error of learning couplings in large Ising models from independent data (the inverse Ising problem). We concentrate on learning based on local cost functions, such as the…

Disordered Systems and Neural Networks · Physics 2017-08-02 Ludovica Bachschmid-Romano , Manfred Opper

The inference performance of the pseudolikelihood method is discussed in the framework of the inverse Ising problem when the $\ell_2$-regularized (ridge) linear regression is adopted. This setup is introduced for theoretically investigating…

Disordered Systems and Neural Networks · Physics 2021-10-19 Xiangming Meng , Tomoyuki Obuchi , Yoshiyuki Kabashima

We consider the inverse Ising problem, i.e. the inference of network couplings from observed spin trajectories for a model with continuous time Glauber dynamics. By introducing two sets of auxiliary latent random variables we render the…

Machine Learning · Statistics 2017-12-22 Christian Donner , Manfred Opper

In this paper we study the inference of the kinetic Ising model on sparse graphs by the decimation method. The decimation method, which was first proposed in [Phys. Rev. Lett. 112, 070603] for the static inverse Ising problem, tries to…

Disordered Systems and Neural Networks · Physics 2016-06-30 Aurélien Decelle , Pan Zhang

We study inference and reconstruction of couplings in a partially observed kinetic Ising model. With hidden spins, calculating the likelihood of a sequence of observed spin configurations requires performing a trace over the configurations…

Disordered Systems and Neural Networks · Physics 2021-04-13 Benjamin Dunn , Yasser Roudi

We study analytically the performance of a recently proposed algorithm for learning the couplings of a random asymmetric kinetic Ising model from finite length trajectories of the spin dynamics. Our analysis shows the importance of the…

Disordered Systems and Neural Networks · Physics 2015-09-30 Ludovica Bachschmid-Romano , Manfred Opper

We propose a new algorithm to learn the network of the interactions of pairwise Ising models. The algorithm is based on the pseudo-likelihood method (PLM), that has already been proven to efficiently solve the problem in a large variety of…

Disordered Systems and Neural Networks · Physics 2019-02-19 Silvio Franz , Federico Ricci-Tersenghi , Jacopo Rocchi

Maximum pseudolikelihood method has been among the most important methods for learning parameters of statistical physics models, such as Ising models. In this paper, we study how pseudolikelihood can be derived for learning parameters of a…

Machine Learning · Computer Science 2015-06-09 Onur Dikmen

We study pairwise Ising models for describing the statistics of multi-neuron spike trains, using data from a simulated cortical network. We explore efficient ways of finding the optimal couplings in these models and examine their…

Quantitative Methods · Quantitative Biology 2009-05-21 Yasser Roudi , Joanna Tyrcha , John Hertz

Recovering microscopic couplings directly from data provides a route to solving the inverse problem in statistical field theories, one that complements the traditional-often computationally intractable-forward approach of predicting…

Statistical Mechanics · Physics 2025-11-24 Shreya Shukla , Abhijith Jayakumar , Andrey Y. Lokhov

Learning near-optimal behaviour from an expert's demonstrations typically relies on the assumption that the learner knows the features that the true reward function depends on. In this paper, we study the problem of learning from…

Machine Learning · Computer Science 2019-03-28 Luis Haug , Sebastian Tschiatschek , Adish Singla

Randomly coupled Ising spins constitute the classical model of collective phenomena in disordered systems, with applications covering ferromagnetism, combinatorial optimization, protein folding, stock market dynamics, and social dynamics.…

Disordered Systems and Neural Networks · Physics 2016-08-24 David Dahmen , Hannah Bos , Moritz Helias

We consider the problem of learning the underlying graph of a sparse Ising model with $p$ nodes from $n$ i.i.d. samples. The most recent and best performing approaches combine an empirical loss (the logistic regression loss or the…

Machine Learning · Statistics 2021-09-17 Antoine Dedieu , Miguel Lázaro-Gredilla , Dileep George

The Ising spin glass is a one-parameter exponential family model for binary data with quadratic sufficient statistic. In this paper, we show that given a single realization from this model, the maximum pseudolikelihood estimate (MPLE) of…

Statistics Theory · Mathematics 2017-03-06 Bhaswar B. Bhattacharya , Sumit Mukherjee

In this Letter we propose a new method to infer the topology of the interaction network in pairwise models with Ising variables. By using the pseudolikelihood method (PLM) at high temperature, it is generally possible to distinguish between…

Disordered Systems and Neural Networks · Physics 2014-02-25 Aurélien Decelle , Federico Ricci-Tersenghi

We consider the problem of inferring a causality structure from multiple binary time series by using the Kinetic Ising Model in datasets where a fraction of observations is missing. We take our steps from a recent work on Mean Field methods…

Data Analysis, Statistics and Probability · Physics 2019-07-03 Carlo Campajola , Fabrizio Lillo , Daniele Tantari

Inference and learning of graphical models are both well-studied problems in statistics and machine learning that have found many applications in science and engineering. However, exact inference is intractable in general graphical models,…

Machine Learning · Statistics 2015-02-04 Jason K. Johnson , Diane Oyen , Michael Chertkov , Praneeth Netrapalli

We consider the problem of learning the underlying graph of an unknown Ising model on p spins from a collection of i.i.d. samples generated from the model. We suggest a new estimator that is computationally efficient and requires a number…

Machine Learning · Computer Science 2017-04-17 Marc Vuffray , Sidhant Misra , Andrey Y. Lokhov , Michael Chertkov

Machine teaching is an inverse problem of machine learning that aims at steering the student learner towards its target hypothesis, in which the teacher has already known the student's learning parameters. Previous studies on machine…

Machine Learning · Computer Science 2021-05-31 Xiaofeng Cao , Ivor W. Tsang

Inference and learning of graphical models are both well-studied problems in statistics and machine learning that have found many applications in science and engineering. However, exact inference is intractable in general graphical models,…

Machine Learning · Statistics 2010-11-16 Jason K. Johnson , Praneeth Netrapalli , Michael Chertkov
‹ Prev 1 2 3 10 Next ›