English
Related papers

Related papers: Efficiently learning Ising models on arbitrary gra…

200 papers

Learning on large graphs presents significant challenges, with traditional Message Passing Neural Networks suffering from computational and memory costs scaling linearly with the number of edges. We introduce the Intersecting Block Graph…

Social and Information Networks · Computer Science 2026-02-12 Jonathan Kouchly , Ben Finkelshtein , Michael Bronstein , Ron Levie

Learning a graph topology to reveal the underlying relationship between data entities plays an important role in various machine learning and data analysis tasks. Under the assumption that structured data vary smoothly over a graph, the…

Machine Learning · Statistics 2023-08-23 Xingyue Pu , Tianyue Cao , Xiaoyun Zhang , Xiaowen Dong , Siheng Chen

We consider the minimum cost intervention design problem: Given the essential graph of a causal graph and a cost to intervene on a variable, identify the set of interventions with minimum total cost that can learn any causal graph with the…

Machine Learning · Computer Science 2018-10-30 Erik M. Lindgren , Murat Kocaoglu , Alexandros G. Dimakis , Sriram Vishwanath

We consider the problem of estimating the graph associated with a binary Ising Markov random field. We describe a method based on $\ell_1$-regularized logistic regression, in which the neighborhood of any given node is estimated by…

Statistics Theory · Mathematics 2010-10-05 Pradeep Ravikumar , Martin J. Wainwright , John D. Lafferty

We consider Ising model on edge-dual of uncorrelated random networks with arbitrary degree distribution. These networks have a finite clustering in the thermodynamic limit. High and low temperature expansions of Ising model on the edge-dual…

Disordered Systems and Neural Networks · Physics 2009-11-10 A. Ramezanpour

We study the problem of learning a tree Ising model from samples such that subsequent predictions made using the model are accurate. The prediction task considered in this paper is that of predicting the values of a subset of variables…

Statistics Theory · Mathematics 2018-06-15 Guy Bresler , Mina Karzand

Autoregressive models enable tractable sampling from learned probability distributions, but their performance critically depends on the variable ordering used in the factorization via complexities of the resulting conditional distributions.…

Machine Learning · Statistics 2026-03-04 Shiba Biswal , Marc Vuffray , Andrey Y. Lokhov

We show that $n$-variable tree-structured Ising models can be learned computationally-efficiently to within total variation distance $\epsilon$ from an optimal $O(n \ln n/\epsilon^2)$ samples, where $O(\cdot)$ hides an absolute constant…

Machine Learning · Computer Science 2020-12-01 Constantinos Daskalakis , Qinxuan Pan

This paper studies how to capture dependency graph structures from real data which may not be Gaussian. Starting from marginal loss functions not necessarily derived from probability distributions, we utilize an additive…

Machine Learning · Statistics 2019-12-03 Yiyuan She , Shao Tang , Qiaoya Zhang

This work maps deep neural networks to classical Ising spin models, allowing them to be described using statistical thermodynamics. The density of states shows that structures emerge in the weights after they have been trained --…

Statistical Mechanics · Physics 2022-09-20 Dusan Stosic , Darko Stosic , Borko Stosic

We call an Ising model tractable when it is possible to compute its partition function value (statistical inference) in polynomial time. The tractability also implies an ability to sample configurations of this model in polynomial time. The…

Computation · Statistics 2021-12-07 Valerii Likhosherstov , Yury Maximov , Michael Chertkov

The exploitation of graph structures is the key to effectively learning representations of nodes that preserve useful information in graphs. A remarkable property of graph is that a latent hierarchical grouping of nodes exists in a global…

Artificial Intelligence · Computer Science 2021-11-02 Lu Lin , Ethan Blaser , Hongning Wang

Given a graph $G$, we form a random subgraph $G_p$ by including each edge of $G$ independently with probability $p$. We provide an asymptotic expansion of the expected number of independent sets in random subgraphs of regular bipartite…

Combinatorics · Mathematics 2026-05-14 Anna Geisler , Mihyun Kang , Michail Sarantis , Ronen Wdowinski

Graph representation learning has drawn increasing attention in recent years, especially for learning the low dimensional embedding at both node and graph level for classification and recommendations tasks. To enable learning the…

Machine Learning · Computer Science 2022-01-20 Tiehua Zhang , Yuze Liu , Xin Chen , Xiaowei Huang , Feng Zhu , Xi Zheng

We study the structure learning problem for $H$-colorings, an important class of Markov random fields that capture key combinatorial structures on graphs, including proper colorings and independent sets, as well as spin systems from…

Discrete Mathematics · Computer Science 2018-04-25 Antonio Blanca , Zongchen Chen , Daniel Štefankovič , Eric Vigoda

Graphical models are useful tools for describing structured high-dimensional probability distributions. Development of efficient algorithms for learning graphical models with least amount of data remains an active research topic.…

Machine Learning · Computer Science 2021-11-18 Marc Vuffray , Sidhant Misra , Andrey Y. Lokhov

There have been two separate lines of work on estimating Ising models: (1) estimating them from multiple independent samples under minimal assumptions about the model's interaction matrix; and (2) estimating them from one sample in…

Statistics Theory · Mathematics 2020-12-11 Yuval Dagan , Constantinos Daskalakis , Nishanth Dikkala , Anthimos Vardis Kandiros

Causal structure learning has been a challenging task in the past decades and several mainstream approaches such as constraint- and score-based methods have been studied with theoretical guarantees. Recently, a new approach has transformed…

Machine Learning · Computer Science 2019-11-19 Ignavier Ng , Shengyu Zhu , Zhitang Chen , Zhuangyan Fang

The problem of learning the structure of a high dimensional graphical model from data has received considerable attention in recent years. In many applications such as sensor networks and proteomics it is often expensive to obtain samples…

Machine Learning · Statistics 2016-04-08 Gautam Dasarathy , Aarti Singh , Maria-Florina Balcan , Jong Hyuk Park

We study the problem of graph structure identification, i.e., of recovering the graph of dependencies among time series. We model these time series data as components of the state of linear stochastic networked dynamical systems. We assume…

Machine Learning · Computer Science 2023-06-29 Sérgio Machado , Anirudh Sridhar , Paulo Gil , Jorge Henriques , José M. F. Moura , Augusto Santos