English
Related papers

Related papers: High-dimensional Ising model selection using ${\el…

200 papers

In this paper, we derive the limit of experiments for one parameter Ising models on dense regular graphs. In particular, we show that the limiting experiment is Gaussian in the low temperature regime, non Gaussian in the critical regime,…

Statistics Theory · Mathematics 2023-05-11 Yuanzhe Xu , Sumit Mukherjee

We consider the structure learning problem for graphical models that we call loosely connected Markov random fields, in which the number of short paths between any pair of nodes is small, and present a new conditional independence test…

Machine Learning · Statistics 2014-02-05 Rui Wu , R. Srikant , Jian Ni

Markov random fields are used to model high dimensional distributions in a number of applied areas. Much recent interest has been devoted to the reconstruction of the dependency structure from independent samples from the Markov random…

Computational Complexity · Computer Science 2010-03-09 Guy Bresler , Elchanan Mossel , Allan Sly

The graphical lasso is a widely used algorithm for fitting undirected Gaussian graphical models. However, for inference on functionals of edge values in the learned graph, standard tools lack formal statistical guarantees, such as control…

Methodology · Statistics 2025-04-01 Sofia Guglielmini , Gerda Claeskens , Snigdha Panigrahi

We investigate the unsupervised node classification problem on random hypergraphs under the non-uniform Hypergraph Stochastic Block Model (HSBM) with two equal-sized communities. In this model, edges appear independently with probabilities…

Statistics Theory · Mathematics 2025-12-01 Hai-Xiao Wang

Learning Gibbs distributions using only sufficient statistics has long been recognized as a computationally hard problem. On the other hand, computationally efficient algorithms for learning Gibbs distributions rely on access to full sample…

Machine Learning · Computer Science 2026-02-16 Abhijith Jayakumar , Shreya Shukla , Marc Vuffray , Andrey Y. Lokhov , Sidhant Misra

We theoretically analyze the model selection consistency of least absolute shrinkage and selection operator (Lasso), both with and without post-thresholding, for high-dimensional Ising models. For random regular (RR) graphs of size $p$ with…

Machine Learning · Statistics 2023-02-20 Xiangming Meng , Tomoyuki Obuchi , Yoshiyuki Kabashima

Inference and learning of graphical models are both well-studied problems in statistics and machine learning that have found many applications in science and engineering. However, exact inference is intractable in general graphical models,…

Machine Learning · Statistics 2015-02-04 Jason K. Johnson , Diane Oyen , Michael Chertkov , Praneeth Netrapalli

We investigate the problem of sequentially predicting the binary labels on the nodes of an arbitrary weighted graph. We show that, under a suitable parametrization of the problem, the optimal number of prediction mistakes can be…

Machine Learning · Computer Science 2012-12-27 Nicolo' Cesa-Bianchi , Claudio Gentile , Fabio Vitale , Giovanni Zappella

Let $(Y,X_1,...,X_m)$ be a random vector. It is desired to predict $Y$ based on $(X_1,...,X_m)$. Examples of prediction methods are regression, classification using logistic regression or separating hyperplanes, and so on. We consider the…

Statistics Theory · Mathematics 2007-06-13 Eitan Greenshtein

I propose an estimation algorithm for Exponential Random Graph Models (ERGM), a popular statistical network model for estimating the structural parameters of strategic network formation in economics and finance. Existing methods often…

Econometrics · Economics 2025-12-09 Yoon Choi

In this work, we study the problem of learning partially observed linear dynamical systems from a single sample trajectory. A major practical challenge in the existing system identification methods is the undesirable dependency of their…

Machine Learning · Computer Science 2020-10-09 Salar Fattahi

Neighborhood selection is a widely used method used for estimating the support set of sparse precision matrices, which helps determine the conditional dependence structure in undirected graphical models. However, reporting only point…

Methodology · Statistics 2023-12-29 Yiling Huang , Snigdha Panigrahi , Walter Dempsey

Undirected graphs are often used to describe high dimensional distributions. Under sparsity conditions, the graph can be estimated using $\ell_1$-penalization methods. We propose and study the following method. We combine a multiple…

Machine Learning · Statistics 2012-01-11 Shuheng Zhou , Philipp Rutimann , Min Xu , Peter Buhlmann

We propose a new localized inference algorithm for answering marginalization queries in large graphical models with the correlation decay property. Given a query variable and a large graphical model, we define a much smaller model in a…

Machine Learning · Statistics 2017-10-31 Jinglin Chen , Jian Peng , Qiang Liu

In this paper we consider the problem of grouped variable selection in high-dimensional regression using $\ell_1-\ell_q$ regularization ($1\leq q \leq \infty$), which can be viewed as a natural generalization of the $\ell_1-\ell_2$…

Machine Learning · Statistics 2008-02-12 Han Liu , Jian Zhang

One of the most common methods for statistical inference is the maximum likelihood estimator (MLE). The MLE needs to compute the normalization constant in statistical models, and it is often intractable. Using unnormalized statistical…

Statistics Theory · Mathematics 2016-04-26 Takafumi Kanamori , Takashi Takenouchi

In Gaussian graphical models, the likelihood equations must typically be solved iteratively. We investigate two algorithms: A version of iterative proportional scaling which avoids inversion of large matrices, and an algorithm based on…

Computation · Statistics 2023-12-12 Søren Højsgaard , Steffen Lauritzen

Social networks and other large sparse data sets pose significant challenges for statistical inference, as many standard statistical methods for testing model fit are not applicable in such settings. Algebraic statistics offers a…

Methodology · Statistics 2014-01-21 Elizabeth Gross , Sonja Petrović , Despina Stasi

In this paper, we first propose a Bayesian neighborhood selection method to estimate Gaussian Graphical Models (GGMs). We show the graph selection consistency of this method in the sense that the posterior probability of the true model…

Applications · Statistics 2015-07-08 Zhixiang Lin , Tao Wang , Can Yang , Hongyu Zhao