English
Related papers

Related papers: On the trade-off between complexity and correlatio…

200 papers

Complex applications such as big data analytics involve different forms of coupling relationships that reflect interactions between factors related to technical, business (domain-specific) and environmental (including socio-cultural and…

Machine Learning · Computer Science 2020-07-28 Longbing Cao

We study pair correlations in cooperative systems placed on complex networks. We show that usually in these systems, the correlations between two interacting objects (e.g., spins), separated by a distance $\ell$, decay, on average, faster…

Statistical Mechanics · Physics 2009-11-11 S. N. Dorogovtsev , A. V. Goltsev , J. F. F. Mendes

Recently, machine-learning methods have been shown to be successful in identifying and classifying different phases of the square-lattice Ising model. We study the performance and limits of classification and regression models. In…

Disordered Systems and Neural Networks · Physics 2022-04-01 Burak Çivitcioğlu , Rudolf A. Römer , Andreas Honecker

In this paper, we provide new complexity results for algorithms that learn discrete-variable Bayesian networks from data. Our results apply whenever the learning algorithm uses a scoring criterion that favors the simplest model able to…

Machine Learning · Computer Science 2012-12-12 David Maxwell Chickering , Christopher Meek , David Heckerman

Neural networks often learn to make predictions that overly rely on spurious correlation existing in the dataset, which causes the model to be biased. While previous work tackles this issue by using explicit labeling on the spuriously…

Machine Learning · Computer Science 2020-11-24 Junhyun Nam , Hyuntak Cha , Sungsoo Ahn , Jaeho Lee , Jinwoo Shin

How complex is an Ising model? Usually, this is measured by the computational complexity of its ground state energy problem. Yet, this complexity measure only distinguishes between planar and non-planar interaction graphs, and thus fails to…

Statistical Mechanics · Physics 2025-05-28 Tobias Reinhart , Gemma De les Coves

We provide time- and sample-efficient algorithms for learning and testing latent-tree Ising models, i.e. Ising models that may only be observed at their leaf nodes. On the learning side, we obtain efficient algorithms for learning a…

Machine Learning · Computer Science 2023-07-11 Davin Choo , Yuval Dagan , Constantinos Daskalakis , Anthimos Vardis Kandiros

We study the problem of learning the structure and parameters of the Ising model, a fundamental model of high-dimensional data, when observing the evolution of an associated Markov chain. A recent line of work has studied the natural…

Machine Learning · Computer Science 2025-07-22 Jason Gaitonde , Ankur Moitra , Elchanan Mossel

An investigation of the performance of the multilevel algorithm in the approach to criticality has been undertaken using the Ising model, performing simulations across a range of temperatures. Numerical results show that the performance of…

High Energy Physics - Lattice · Physics 2022-01-06 Ben Kitching-Morley , Andreas Jüttner

We consider the problem of reconstructing the graph underlying an Ising model from i.i.d. samples. Over the last fifteen years this problem has been of significant interest in the statistics, machine learning, and statistical physics…

Machine Learning · Computer Science 2014-12-02 Guy Bresler

Existing methods for differentiable structure learning in discrete data typically assume that the data are generated from specific structural equation models. However, these assumptions may not align with the true data-generating process,…

Machine Learning · Computer Science 2025-10-28 Chang Deng , Bryon Aragam

The Ising models have been applied for various problems on information sciences, social sciences, and so on. In many cases, solving these problems corresponds to minimizing the Bethe free energy. To minimize the Bethe free energy, a…

Disordered Systems and Neural Networks · Physics 2009-11-11 Jun Ohkubo , Muneki Yasuda , Kazuyuki Tanaka

The features of the response of frustrated states to the external field are considered on the example of a diluted Ising chain. In the ferromagnetic case, partial ordering occurs, which leads to a decrease in entropy. In the…

Statistical Mechanics · Physics 2024-11-12 Yury Panov

Using methods of statistical physics, we analyse the error of learning couplings in large Ising models from independent data (the inverse Ising problem). We concentrate on learning based on local cost functions, such as the…

Disordered Systems and Neural Networks · Physics 2017-08-02 Ludovica Bachschmid-Romano , Manfred Opper

The two-dimensional random-bond Ising model is numerically studied on long strips by transfer-matrix methods. It is shown that the rate of decay of correlations at criticality, as derived from averages of the two largest Lyapunov exponents…

Condensed Matter · Physics 2009-10-22 S. L. A. de Queiroz

Structure learning of Gaussian graphical models is an extensively studied problem in the classical multivariate setting where the sample size n is larger than the number of random variables p, as well as in the more challenging setting when…

Methodology · Statistics 2012-02-20 Inma Tur , Robert Castelo

To construct models of large, multivariate complex systems, such as those in biology, one needs to constrain which variables are allowed to interact. This can be viewed as detecting "local" structures among the variables. In the context of…

Data Analysis, Statistics and Probability · Physics 2023-10-19 Mahajabin Rahman , Ilya Nemenman

A class of random graphs is introduced and studied. The graphs are constructed in an algorithmic way from five motifs which were found in [Milo R., Shen-Orr S., Itzkovitz S., Kashtan N., Chklovskii D., Alon U., Science, 2002, 298, 824-827].…

Mathematical Physics · Physics 2011-06-23 M. Kotorowicz , Yu. Kozitsky

Recent advances in deep learning optimization showed that just a subset of parameters are really necessary to successfully train a model. Potentially, such a discovery has broad impact from the theory to application; however, it is known…

Machine Learning · Computer Science 2022-12-29 Enzo Tartaglione

The major challenge in designing a discriminative learning algorithm for predicting structured data is to address the computational issues arising from the exponential size of the output space. Existing algorithms make different assumptions…

Machine Learning · Computer Science 2010-06-29 Shankar Vembu