English
Related papers

Related papers: Estimation of High-Dimensional Graphical Models Us…

200 papers

Gaussian graphical models emerge in a wide range of fields. They model the statistical relationships between variables as a graph, where an edge between two variables indicates conditional dependence. Unfortunately, well-established…

Machine Learning · Statistics 2024-01-19 Taulant Koka , Jasin Machkour , Michael Muma

Accurate and automated detection of anomalous samples in a natural image dataset can be accomplished with a probabilistic model for end-to-end modeling of images. Such images have heterogeneous complexity, however, and a probabilistic model…

Machine Learning · Computer Science 2018-09-05 Takashi Matsubara , Kenta Hama , Ryosuke Tachibana , Kuniaki Uehara

Motivated by the need to study the molecular mechanism underlying Type 1 Diabetes (T1D) with the gene expression data collected from both the patients and healthy controls at multiple time points, we propose an innovative method for jointly…

Methodology · Statistics 2018-12-10 Bochao Jia , Faming Liang , the TEDDY Study Group

We propose a new class of semiparametric exponential family graphical models for the analysis of high dimensional mixed data. Different from the existing mixed graphical models, we allow the nodewise conditional distributions to be…

Machine Learning · Statistics 2015-10-16 Zhuoran Yang , Yang Ning , Han Liu

This thesis studies high-dimensional, continuous-valued pairwise Markov Random Fields. We are particularly interested in approximating pairwise densities whose logarithm belongs to a Sobolev space. For this problem we propose the method of…

Statistics Theory · Mathematics 2015-06-12 Eric Janofsky

We study the problem of estimating the score function using both implicit score matching and denoising score matching. Assuming that the data distribution exhibiting a low-dimensional structure, we prove that implicit score matching is able…

Statistics Theory · Mathematics 2026-01-01 Konstantin Yakovlev , Anna Markovich , Nikita Puchkin

Score-based models have achieved remarkable results in the generative modeling of many domains. By learning the gradient of smoothed data distribution, they can iteratively generate samples from complex distribution e.g. natural images.…

Artificial Intelligence · Computer Science 2024-03-27 Binxu Wang , John J. Vastola

Sparse models for high-dimensional linear regression and machine learning have received substantial attention over the past two decades. Model selection, or determining which features or covariates are the best explanatory variables, is…

Machine Learning · Statistics 2019-10-15 Yuan Li , Benjamin Mark , Garvesh Raskutti , Rebecca Willett , Hyebin Song , David Neiman

The discovery of structure from time series data is a key problem in fields of study working with complex systems. Most identifiability results and learning algorithms assume the underlying dynamics to be discrete in time. Comparatively…

Machine Learning · Statistics 2022-02-04 Alexis Bellot , Kim Branson , Mihaela van der Schaar

We present a novel method for training score-based generative models which uses nonlinear noising dynamics to improve learning of structured distributions. Generalizing to a nonlinear drift allows for additional structure to be incorporated…

Machine Learning · Statistics 2025-07-10 Jeremiah Birrell , Markos A. Katsoulakis , Luc Rey-Bellet , Benjamin J. Zhang , Wei Zhu

The time-evolving precision matrix of a piecewise-constant Gaussian graphical model encodes the dynamic conditional dependency structure of a multivariate time-series. Traditionally, graphical models are estimated under the assumption that…

Methodology · Statistics 2017-11-01 Alexander J. Gibberd , James D. B. Nelson

This paper introduces a novel framework for estimation and inference in penalized M-estimators applied to robust high-dimensional linear regression models. Traditional methods for high-dimensional statistical inference, which predominantly…

Methodology · Statistics 2025-04-15 Dian Zheng , Lingzhou Xue

Likelihood-based estimation methods involve the normalising constant of the model distributions, expressed as a function of the parameter. However in many problems this function is not easily available, and then less efficient but more…

Methodology · Statistics 2019-04-30 Silvia Columbu , Valentina Mameli , Monica Musio , A. Philip Dawid

Gaussian graphical models provide a powerful framework to reveal the conditional dependency structure between multivariate variables. The process of uncovering the conditional dependency network is known as structure learning. Bayesian…

Methodology · Statistics 2024-07-30 Lucas Vogels , Reza Mohammadi , Marit Schoonhoven , S. Ilker Birbil

Selecting regularization parameters in penalized high-dimensional graphical models in a principled, data-driven, and computationally efficient manner continues to be one of the key challenges in high-dimensional statistics. We present…

Methodology · Statistics 2016-10-19 Christian L. Müller , Richard Bonneau , Zachary Kurtz

Gaussian graphical models with sparsity in the inverse covariance matrix are of significant interest in many modern applications. For the problem of recovering the graphical structure, information criteria provide useful optimization…

Statistics Theory · Mathematics 2010-12-01 Rina Foygel , Mathias Drton

The incorporation of generative models as regularisers within variational formulations for inverse problems has proven effective across numerous image reconstruction tasks. However, the resulting optimisation problem is often non-convex and…

Machine Learning · Computer Science 2024-08-14 Pascal Fernsel , Željko Kereta , Alexander Denker

Score matching has become a central training objective in modern generative modeling, particularly in diffusion models, where it is used to learn high-dimensional data distributions through the estimation of score functions. Despite its…

Machine Learning · Computer Science 2025-12-01 Yiran Zhang , Weihang Xu , Mo Zhou , Maryam Fazel , Simon Shaolei Du

Gaussian graphical models represent the backbone of the statistical toolbox for analyzing continuous multivariate systems. However, due to the intrinsic properties of the multivariate normal distribution, use of this model family may hide…

Statistics Theory · Mathematics 2014-09-09 Henrik Nyman , Johan Pensar , Jukka Corander

We study a family of regularized score-based estimators for learning the structure of a directed acyclic graph (DAG) for a multivariate normal distribution from high-dimensional data with $p\gg n$. Our main results establish support…

Statistics Theory · Mathematics 2017-10-03 Bryon Aragam , Arash A. Amini , Qing Zhou