English
Related papers

Related papers: Inference in high-dimensional graphical models

200 papers

Bayesian networks, with structure given by a directed acyclic graph (DAG), are a popular class of graphical models. However, learning Bayesian networks from discrete or categorical data is particularly challenging, due to the large…

Methodology · Statistics 2018-02-06 Jiaying Gu , Fei Fu , Qing Zhou

This paper provides an overview of results, concerning longest or heaviest paths, in the area of random directed graphs on the integers along with some extensions. We study first-order asymptotics of heaviest paths allowing weights both on…

Probability · Mathematics 2018-08-09 Sergey Foss , Takis Konstantopoulos

The increasingly wide use of deep machine learning techniques in computational mechanics has significantly accelerated simulations of problems that were considered unapproachable just a few years ago. However, in critical applications such…

Machine Learning · Computer Science 2026-04-01 David Gonzalez , Alba Muixi , Beatriz Moya , Elias Cueto

Graphical models are widely used to model stochastic dependences among large collections of variables. We introduce a new method of estimating undirected conditional independence graphs based on the score matching loss, introduced by…

Methodology · Statistics 2016-03-24 Lina Lin , Mathias Drton , Ali Shojaie

In this paper, we present a novel way to summarize the structure of large graphs, based on non-parametric estimation of edge density in directed multigraphs. Following coclustering approach, we use a clustering of the vertices, with a…

Social and Information Networks · Computer Science 2015-08-07 Marc Boullé

Despite numerous years of research into the merits and trade-offs of various model selection criteria, obtaining robust results that elucidate the behavior of cross-validation remains a challenging endeavor. In this paper, we highlight the…

Statistics Theory · Mathematics 2023-12-29 Zhao Lyu , Wai Ming Tai , Mladen Kolar , Bryon Aragam

Gaussian Graphical Models (GGM) are often used to describe the conditional correlations between the components of a random vector. In this article, we compare two families of GGM inference methods: nodewise edge selection and penalised…

Recently, a special case of precision matrix estimation based on a distributionally robust optimization (DRO) framework has been shown to be equivalent to the graphical lasso. From this formulation, a method for choosing the regularization…

Methodology · Statistics 2022-06-10 Chau Tran , Pedro Cisneros-Velarde , Sang-Yun Oh , Alexander Petersen

Structural learning of directed acyclic graphs (DAGs) or Bayesian networks has been studied extensively under the assumption that data are independent. We propose a new Gaussian DAG model for dependent data which assumes the observations…

Machine Learning · Statistics 2021-07-30 Hangjian Li , Oscar Hernan Madrid Padilla , Qing Zhou

While graphical models for continuous data (Gaussian graphical models) and discrete data (Ising models) have been extensively studied, there is little work on graphical models linking both continuous and discrete variables (mixed data),…

Machine Learning · Statistics 2016-08-22 Jie Cheng , Tianxi Li , Elizaveta Levina , Ji Zhu

We consider complete graphs with edge weights and/or node weights taking values in some set. In the first part of this paper, we show that a large number of graphs are completely determined, up to isomorphism, by the distribution of their…

Combinatorics · Mathematics 2007-10-11 Mireille Boutin , Gregor Kemper

We consider tests of significance in the setting of the graphical lasso for inverse covariance matrix estimation. We propose a simple test statistic based on a subsequence of the knots in the graphical lasso path. We show that this…

Statistics Theory · Mathematics 2013-07-24 Max Grazier G'Sell , Jonathan Taylor , Robert Tibshirani

A great deal of interest has recently focused on conducting inference on the parameters in a high-dimensional linear model. In this paper, we consider a simple and very na\"{i}ve two-step procedure for this task, in which we (i) fit a lasso…

Methodology · Statistics 2020-07-02 Sen Zhao , Daniela Witten , Ali Shojaie

Undirected graphs are often used to describe high dimensional distributions. Under sparsity conditions, the graph can be estimated using $\ell_1$ penalization methods. However, current methods assume that the data are independent and…

Machine Learning · Statistics 2008-04-29 Shuheng Zhou , John Lafferty , Larry Wasserman

We consider a Gibbs distribution over all spanning trees of an undirected, edge weighted finite graph, where, up to normalization, the probability of each tree is given by the product of its edge weights. Defining the weighted degree of a…

Discrete Mathematics · Computer Science 2024-10-18 Enrique Fita Sanmartín , Christoph Schnörr , Fred A. Hamprecht

This paper studies how to capture dependency graph structures from real data which may not be Gaussian. Starting from marginal loss functions not necessarily derived from probability distributions, we utilize an additive…

Machine Learning · Statistics 2019-12-03 Yiyuan She , Shao Tang , Qiaoya Zhang

An important question in statistical network analysis is how to estimate models of discrete and dependent network data with intractable likelihood functions, without sacrificing computational scalability and statistical guarantees. We…

Statistics Theory · Mathematics 2026-03-06 Jonathan R. Stewart , Michael Schweinberger

In many applications, data often arise from multiple groups that may share similar characteristics. A joint estimation method that models several groups simultaneously can be more efficient than estimating parameters in each group…

Methodology · Statistics 2020-08-17 Kyoungjae Lee , Xuan Cao

Structure discovery in graphical models is the determination of the topology of a graph that encodes conditional independence properties of the joint distribution of all variables in the model. For some class of probability distributions,…

Machine Learning · Statistics 2016-04-07 Wacha Bounliphone , Matthew Blaschko

In this paper, the fused graphical lasso (FGL) method is used to estimate multiple precision matrices from multiple populations simultaneously. The lasso penalty in the FGL model is a restraint on sparsity of precision matrices, and a…

Statistics Theory · Mathematics 2023-03-03 Qiuyan Zhang , Zhidong Bai , Lingrui Li , Hu Yang