English
Related papers

Related papers: Conditional Independence Estimates for the General…

200 papers

A Gaussian fluctuation formula is proved for linear statistics of complex random matrices in the case that the statistic is rotationally invariant. For a general linear statistic without this symmetry, Coulomb gas theory is used to predict…

Statistical Mechanics · Physics 2007-05-23 P. J. Forrester

We describe various sets of conditional independence relationships, sufficient for qualitatively comparing non-vanishing squared partial correlations of a Gaussian random vector. These sufficient conditions are satisfied by several…

Statistics Theory · Mathematics 2018-10-16 Sanjay Chaudhuri

Nonparametric regression for massive numbers of samples (n) and features (p) is an increasingly important problem. In big n settings, a common strategy is to partition the feature space, and then separately apply simple models to each…

Machine Learning · Statistics 2014-06-10 Rajarshi Guhaniyogi , David B. Dunson

Undirected graphical models are widely used to model the conditional independence structure of vector-valued data. However, in many modern applications, for example those involving EEG and fMRI data, observations are more appropriately…

Machine Learning · Statistics 2024-01-29 Boxin Zhao , Percy S. Zhai , Y. Samuel Wang , Mladen Kolar

Gaussian random fields are popular models for spatially varying uncertainties, arising for instance in geotechnical engineering, hydrology or image processing. A Gaussian random field is fully characterised by its mean function and…

Numerical Analysis · Mathematics 2019-02-19 Jonas Latz , Marvin Eisenberger , Elisabeth Ullmann

Deep learning offers promising new ways to accurately model aleatoric uncertainty in robotic state estimation systems, particularly when the uncertainty distributions do not conform to traditional assumptions of being fixed and Gaussian. In…

Machine Learning · Computer Science 2025-02-28 Aastha Acharya , Caleb Lee , Marissa D'Alonzo , Jared Shamwell , Nisar R. Ahmed , Rebecca Russell

We study the problem of learning multivariate dependencies in nonparametric and high-dimensional settings. This includes but is not limited to graphical models. Our approach effectively combines several features that are missing from…

Statistics Theory · Mathematics 2026-03-31 Arash A. Amini , Bryon Aragam , Qing Zhou

Recent work has shown that Transformers can perform in-context learning for linear regression under restrictive assumptions, including i.i.d. data, Gaussian noise, and Gaussian regression coefficients. However, real-world data often violate…

Machine Learning · Computer Science 2026-03-20 Hoang T. H. Cao , Hai D. V. Trinh , Tho Quan , Lan V. Truong

Gaussian graphical models are widely used to represent correlations among entities but remain vulnerable to data corruption. In this work, we introduce a modified trimmed-inner-product algorithm to robustly estimate the covariance in an…

Machine Learning · Computer Science 2023-09-19 Tong Yao , Shreyas Sundaram

This short note reviews so-called Natural Gradient Descent (NGD) for multivariate Gaussians. The Fisher Information Matrix (FIM) is derived for several different parameterizations of Gaussians. Careful attention is paid to the symmetric…

Machine Learning · Statistics 2020-10-20 Timothy D. Barfoot

Conditional independence testing is a fundamental problem underlying causal discovery and a particularly challenging task in the presence of nonlinear and high-dimensional dependencies. Here a fully non-parametric test for continuous data…

Machine Learning · Statistics 2017-09-06 Jakob Runge

Tree structured graphical models are powerful at expressing long range or hierarchical dependency among many variables, and have been widely applied in different areas of computer science and statistics. However, existing methods for…

Machine Learning · Statistics 2014-01-17 Le Song , Han Liu , Ankur Parikh , Eric Xing

We propose a novel approach to estimating the precision matrix of multivariate Gaussian data that relies on decomposing them into a low-rank and a diagonal component. Such decompositions are very popular for modeling large covariance…

Methodology · Statistics 2022-08-18 Noirrit Kiran Chandra , Peter Mueller , Abhra Sarkar

Parametric conditional copula models allow the copula parameters to vary with a set of covariates according to an unknown calibration function. Flexible Bayesian inference for the calibration function of a bivariate conditional copula is…

Methodology · Statistics 2017-05-26 Evgeny Levi , Radu V. Craiu

One of the common obstacles for learning causal models from data is that high-order conditional independence (CI) relationships between random variables are difficult to estimate. Since CI tests with conditioning sets of low order can be…

Machine Learning · Computer Science 2020-10-07 Marcel Wienöbst , Maciej Liśkiewicz

Gaussian graphical model is a graphical representation of the dependence structure for a Gaussian random vector. It is recognized as a powerful tool in different applied fields such as bioinformatics, error-control codes, speech language,…

Machine Learning · Statistics 2017-01-10 Valery A. Kalyagin , Alexander P. Koldanov , Petr A. Koldanov , Panos M. Pardalos

Graphical models are widely used in scienti fic and engineering research to represent conditional independence structures between random variables. In many controlled experiments, environmental changes or external stimuli can often alter…

Machine Learning · Computer Science 2012-03-19 Bai Zhang , Yue Wang

We propose a Bayesian approximate inference method for learning the dependence structure of a Gaussian graphical model. Using pseudo-likelihood, we derive an analytical expression to approximate the marginal likelihood for an arbitrary…

Machine Learning · Statistics 2017-04-13 Janne Leppä-aho , Johan Pensar , Teemu Roos , Jukka Corander

This paper considers the posterior contraction of non-parametric Bayesian inference on non-homogeneous Poisson processes. We consider the quality of inference on a rate function $\lambda$, given non-identically distributed realisations,…

Statistics Theory · Mathematics 2019-06-26 James A. Grant , David S. Leslie

In multivariate statistics, the question of finding direct interactions can be formulated as a problem of network inference - or network reconstruction - for which the Gaussian graphical model (GGM) provides a canonical framework.…

Methodology · Statistics 2018-06-11 Julien Chiquet , Mahendra Mariadassou , Stéphane Robin