English
Related papers

Related papers: Estimation of High-Dimensional Graphical Models Us…

200 papers

The problem of identifying change points in high-dimensional Gaussian graphical models (GGMs) in an online fashion is of interest, due to new applications in biology, economics and social sciences. The offline version of the problem, where…

Statistics Theory · Mathematics 2020-03-18 Hossein Keshavarz , George Michailidis

We investigate the approximation efficiency of score functions by deep neural networks in diffusion-based generative modeling. While existing approximation theories utilize the smoothness of score functions, they suffer from the curse of…

Machine Learning · Computer Science 2023-09-21 Song Mei , Yuchen Wu

Gaussian Graphical Models (GGMs) have wide-ranging applications in machine learning and the natural and social sciences. In most of the settings in which they are applied, the number of observed samples is much smaller than the dimension…

Machine Learning · Computer Science 2020-03-10 Jonathan Kelner , Frederic Koehler , Raghu Meka , Ankur Moitra

In recent literature, the Gaussian Graphical model (GGM; Lauritzen, 1996),a network of partial correlation coefficients, has been used to capture potential dynamic relationships between observed variables. The GGM can be estimated using…

Methodology · Statistics 2017-09-25 Sacha Epskamp

We propose a framework to perform Bayesian inference using conditional score-based diffusion models to solve a class of inverse problems in mechanics involving the inference of a specimen's spatially varying material properties from noisy…

Undirected graphical models are powerful tools for uncovering complex relationships among high-dimensional variables. This paper aims to fully recover the structure of an undirected graphical model when the data naturally take matrix form,…

Methodology · Statistics 2025-08-08 Minsub Shin , Johan Lim , Seongoh Park

Gaussian graphical models (GGMs) are well-established tools for probabilistic exploration of dependence structures using precision matrices. We develop a Bayesian method to incorporate covariate information in this GGMs setup in a nonlinear…

In this paper we consider the task of estimating the non-zero pattern of the sparse inverse covariance matrix of a zero-mean Gaussian random vector from a set of iid samples. Note that this is also equivalent to recovering the underlying…

Machine Learning · Computer Science 2012-02-28 Christopher C. Johnson , Ali Jalali , Pradeep Ravikumar

Score-based diffusion models provide a powerful way to model images using the gradient of the data distribution. Leveraging the learned score function as a prior, here we introduce a way to sample data from a conditional distribution given…

Image and Video Processing · Electrical Eng. & Systems 2022-07-19 Hyungjin Chung , Jong Chul Ye

Computer Vision practitioners must thoroughly understand their model's performance, but conditional evaluation is complex and error-prone. In biometric verification, model performance over continuous covariates---real-number attributes of…

Machine Learning · Computer Science 2020-09-22 Mel McCurrie , Hamish Nicholson , Walter J. Scheirer , Samuel Anthony

This work introduces a sampling method capable of solving Bayesian inverse problems in function space. It does not assume the log-concavity of the likelihood, meaning that it is compatible with nonlinear inverse problems. The method…

Machine Learning · Statistics 2024-05-27 Lorenzo Baldassari , Ali Siahkoohi , Josselin Garnier , Knut Solna , Maarten V. de Hoop

Accurate model selection is a fundamental requirement for statistical analysis. In many real-world applications of graphical modelling, correct model structure identification is the ultimate objective. Standard model validation procedures…

Machine Learning · Statistics 2019-08-28 Robert O'Shea

Sparse structure learning in high-dimensional Gaussian graphical models is an important problem in multivariate statistical signal processing; since the sparsity pattern naturally encodes the conditional independence relationship among…

Methodology · Statistics 2023-09-26 Ksheera Sagar , Jyotishka Datta , Sayantan Banerjee , Anindya Bhadra

Functional graphical models explore dependence relationships of random processes. This is achieved through estimating the precision matrix of the coefficients from the Karhunen-Loeve expansion. This paper deals with the problem of…

Methodology · Statistics 2021-10-14 Ilias Moysidis , Bing Li

In this paper, we introduce an innovative testing procedure for assessing individual hypotheses in high-dimensional linear regression models with measurement errors. This method remains robust even when either the X-model or Y-model is…

Methodology · Statistics 2025-01-14 Shijie Cui , Xu Guo , Songshan Yang , Zhe Zhang

Diffusion models achieve state-of-the-art performance in various generation tasks. However, their theoretical foundations fall far behind. This paper studies score approximation, estimation, and distribution recovery of diffusion models,…

Machine Learning · Computer Science 2023-02-15 Minshuo Chen , Kaixuan Huang , Tuo Zhao , Mengdi Wang

Gaussian graphical models, where it is assumed that the variables of interest jointly follow a multivariate normal distribution with a sparse precision matrix, have been used to study intrinsic dependence among variables, but the normality…

Methodology · Statistics 2020-05-20 Jami J. Mulgrave , Subhashis Ghosal

Despite the remarkable empirical success of score-based diffusion models, their statistical guarantees remain underdeveloped. Existing analyses often provide pessimistic convergence rates that do not reflect the intrinsic low-dimensional…

Machine Learning · Statistics 2026-04-24 Saptarshi Chakraborty , Quentin Berthet , Peter L. Bartlett

Optimization problems with norm-bounding constraints arise in a variety of applications, including portfolio optimization, machine learning, and feature selection. A common approach to these problems involves relaxing the norm constraint…

Optimization and Control · Mathematics 2025-05-08 Danial Davarnia , Mohammadreza Kiaghadi

We propose to learn latent graphical models when data have mixed variables and missing values. This model could be used for further data analysis, including regression, classification, ranking etc. It also could be used for imputing missing…

Methodology · Statistics 2015-11-17 Xiao Li , Jinzhu Jia , Yuan Yao