English
Related papers

Related papers: Structure Learning of Gaussian Markov Random Field…

200 papers

Methods for inference and simulation of linearly constrained Gaussian Markov Random Fields (GMRF) are computationally prohibitive when the number of constraints is large. In some cases, such as for intrinsic GMRFs, they may even be…

Methodology · Statistics 2021-06-04 David Bolin , Jonas Wallin

Estimating graphical model structure from high-dimensional and undersampled data is a fundamental problem in many scientific fields. Existing approaches, such as GLASSO, latent variable GLASSO, and latent tree models, suffer from high…

Machine Learning · Statistics 2019-09-18 Greg Ver Steeg , Hrayr Harutyunyan , Daniel Moyer , Aram Galstyan

Low-rank approximation models of data matrices have become important machine learning and data mining tools in many fields including computer vision, text mining, bioinformatics and many others. They allow for embedding high-dimensional…

Machine Learning · Computer Science 2020-10-19 Penglong Zhai , Shihua Zhang

Decoding complex relationships among large numbers of variables with relatively few observations is one of the crucial issues in science. One approach to this problem is Gaussian graphical modeling, which describes conditional independence…

Methodology · Statistics 2019-04-26 A. Mohammadi , E. C. Wit

A regularized version of Mixture Models is proposed to learn a principal graph from a distribution of $D$-dimensional data points. In the particular case of manifold learning for ridge detection, we assume that the underlying manifold can…

Machine Learning · Computer Science 2023-07-13 Tony Bonnaire , Aurélien Decelle , Nabila Aghanim

We present two algorithms for learning the structure of a Markov network from data: GSMN* and GSIMN. Both algorithms use statistical independence tests to infer the structure by successively constraining the set of structures consistent…

Machine Learning · Computer Science 2014-01-16 Facundo Bromberg , Dimitris Margaritis , Vasant Honavar

The L1-regularized Gaussian maximum likelihood estimator (MLE) has been shown to have strong statistical guarantees in recovering a sparse inverse covariance matrix, or alternatively the underlying graph structure of a Gaussian Markov…

Machine Learning · Computer Science 2013-06-14 Cho-Jui Hsieh , Matyas A. Sustik , Inderjit S. Dhillon , Pradeep Ravikumar

In this paper a new approach for constructing \emph{multivariate} Gaussian random fields (GRFs) using systems of stochastic partial differential equations (SPDEs) has been introduced and applied to simulated data and real data. By solving a…

Methodology · Statistics 2013-07-08 Xiangping Hu , Daniel Simpson , Finn Lindgren , Håvard Rue

We consider the problem of estimating the graph structure associated with a discrete Markov random field. We describe a method based on $\ell_1$-regularized logistic regression, in which the neighborhood of any given node is estimated by…

Statistics Theory · Mathematics 2008-04-29 Pradeep Ravikumar , Martin J. Wainwright , John D. Lafferty

We consider structure discovery of undirected graphical models from observational data. Inferring likely structures from few examples is a complex task often requiring the formulation of priors and sophisticated inference procedures.…

Machine Learning · Statistics 2017-08-04 Eugene Belilovsky , Kyle Kastner , Gaël Varoquaux , Matthew Blaschko

We introduce a new perspective on spectral dimensionality reduction which views these methods as Gaussian Markov random fields (GRFs). Our unifying perspective is based on the maximum entropy principle which is in turn inspired by maximum…

Artificial Intelligence · Computer Science 2012-01-05 Neil D. Lawrence

Recent years have witnessed great success in handling graph-related tasks with Graph Neural Networks (GNNs). However, most existing GNNs are based on message passing to perform feature aggregation and transformation, where the structural…

Machine Learning · Computer Science 2024-09-10 Lirong Wu , Haitao Lin , Guojiang Zhao , Cheng Tan , Stan Z. Li

The problem of hypothesis testing against independence for a Gauss-Markov random field (GMRF) is analyzed. Assuming an acyclic dependency graph, an expression for the log-likelihood ratio of detection is derived. Assuming random placement…

Information Theory · Computer Science 2016-11-15 Animashree Anandkumar , Lang Tong , Ananthram Swami

High-dimensional sparse generalized linear models (GLMs) have emerged in the setting that the number of samples and the dimension of variables are large, and even the dimension of variables grows faster than the number of samples. False…

Statistics Theory · Mathematics 2021-05-04 Chang Cui , Jinzhu Jia , Yijun Xiao , Huiming Zhang

We study a family of regularized score-based estimators for learning the structure of a directed acyclic graph (DAG) for a multivariate normal distribution from high-dimensional data with $p\gg n$. Our main results establish support…

Statistics Theory · Mathematics 2017-10-03 Bryon Aragam , Arash A. Amini , Qing Zhou

Currently, Markov-Gibbs random field (MGRF) image models which include high-order interactions are almost always built by modelling responses of a stack of local linear filters. Actual interaction structure is specified implicitly by the…

Computer Vision and Pattern Recognition · Computer Science 2015-12-01 Ralph Versteegen , Georgy Gimel'farb , Patricia Riddle

To improve the robustness of graph neural networks (GNN), graph structure learning (GSL) has attracted great interest due to the pervasiveness of noise in graph data. Many approaches have been proposed for GSL to jointly learn a clean graph…

Machine Learning · Computer Science 2023-07-06 Shaogao Lv , Gang Wen , Shiyu Liu , Linsen Wei , Ming Li

Gene covariation networks are commonly used to study biological processes. The inference of gene covariation networks from observational data can be challenging, especially considering the large number of players involved and the small…

Molecular Networks · Quantitative Biology 2019-04-17 Anatoly Yambartsev , Michael Perlin , Yevgeniy Kovchegov , Natalia Shulzhenko , Karina L. Mine , Xiaoxi Dong , Andrey Morgun

Undirected probabilistic graphical models represent the conditional dependencies, or Markov properties, of a collection of random variables. Knowing the sparsity of such a graphical model is valuable for modeling multivariate distributions…

Machine Learning · Statistics 2023-02-28 Ricardo Baptista , Youssef Marzouk , Rebecca E. Morrison , Olivier Zahm

The graphical Lasso (GLASSO) is a widely used algorithm for learning high-dimensional undirected Gaussian graphical models (GGM). Given i.i.d. observations from a multivariate normal distribution, GLASSO estimates the precision matrix by…

Methodology · Statistics 2026-01-15 Ha Nguyen , Sumanta Basu