English
Related papers

Related papers: Bayesian inference for high-dimensional decomposab…

200 papers

The performance of Gaussian Process (GP) regression is often hampered by the curse of dimensionality, which inflates computational cost and reduces predictive power in high-dimensional problems. Variable selection is thus crucial for…

Methodology · Statistics 2025-11-24 Minshen Xu , Shiwei Lan , Lulu Kang

We study the sparse high-dimensional Gaussian mixture model when the number of clusters is allowed to grow with the sample size. A minimax lower bound for parameter estimation is established, and we show that a constrained maximum…

Statistics Theory · Mathematics 2024-02-26 Dapeng Yao , Fangzheng Xie , Yanxun Xu

High-dimensional linear models have been widely studied, but the developments in high-dimensional generalized linear models, or GLMs, have been slower. In this paper, we propose an empirical or data-driven prior leading to an empirical…

Statistics Theory · Mathematics 2025-07-09 Yiqi Tang , Ryan Martin

The G-Wishart distribution is the conjugate prior for precision matrices that encode the conditional independencies of a Gaussian graphical model. While the distribution has received considerable attention, posterior inference has proven…

Computation · Statistics 2013-04-05 Alex Lenkoski

Sparse Bayesian factor models are routinely implemented for parsimonious dependence modeling and dimensionality reduction in high-dimensional applications. We provide theoretical understanding of such Bayesian procedures in terms of…

Statistics Theory · Mathematics 2014-06-03 Debdeep Pati , Anirban Bhattacharya , Natesh S. Pillai , David Dunson

Graphs are ubiquitous in modelling relational structures. Recent endeavours in machine learning for graph-structured data have led to many architectures and learning algorithms. However, the graph used by these algorithms is often…

Machine Learning · Statistics 2020-06-25 Soumyasundar Pal , Saber Malekmohammadi , Florence Regol , Yingxue Zhang , Yishi Xu , Mark Coates

The random dot product graph is a popular model for network data with extensions that accommodate dynamic (time-varying) networks. However, two significant deficiencies exist in the dynamic random dot product graph literature: (1) no…

Methodology · Statistics 2025-09-25 Joshua Daniel Loyal

We study the rate of Bayesian consistency for hierarchical priors consisting of prior weights on a model index set and a prior on a density model for each choice of model index. Ghosal, Lember and Van der Vaart [2] have obtained general…

Statistics Theory · Mathematics 2008-09-23 Yang Xing

We use rescaled Gaussian processes as prior models for functional parameters in nonparametric statistical models. We show how the rate of contraction of the posterior distributions depends on the scaling factor. In particular, we exhibit…

Statistics Theory · Mathematics 2009-09-29 Aad van der Vaart , Harry van Zanten

This paper develops a new statistical inference theory for the precision matrix of high-frequency data in a high-dimensional setting. The focus is not only on point estimation but also on interval estimation and hypothesis testing for…

Statistics Theory · Mathematics 2020-05-20 Yuta Koike

We reconsider a nonparametric density model based on Gaussian processes. By augmenting the model with latent P\'olya--Gamma random variables and a latent marked Poisson process we obtain a new likelihood which is conjugate to the model's…

Machine Learning · Statistics 2018-05-30 Christian Donner , Manfred Opper

Functional data are defined as realizations of random functions (mostly smooth functions) varying over a continuum, which are usually collected with measurement errors on discretized grids. In order to accurately smooth noisy functional…

Methodology · Statistics 2016-12-13 Jingjing Yang , Dennis D. Cox , Jong Soo Lee , Peng Ren , Taeryon Choi

Currently several Bayesian approaches are available to estimate large sparse precision matrices, including Bayesian graphical Lasso (Wang, 2012), Bayesian structure learning (Banerjee and Ghosal, 2015), and graphical horseshoe (Li et al.,…

Methodology · Statistics 2021-04-27 Ruoyang Zhang , Yisha Yao , Malay Ghosh

Deep kernel processes are a recently introduced class of deep Bayesian models that have the flexibility of neural networks, but work entirely with Gram matrices. They operate by alternately sampling a Gram matrix from a distribution over…

Machine Learning · Statistics 2023-05-25 Sebastian Ober , Ben Anson , Edward Milsom , Laurence Aitchison

Parameter identification problems in partial differential equations (PDEs) consist in determining one or more functional coefficient in a PDE. In this article, the Bayesian nonparametric approach to such problems is considered. Focusing on…

Statistics Theory · Mathematics 2025-04-24 Matteo Giordano

Precision matrix estimation in a multivariate Gaussian model is fundamental to network estimation. Although there exist both Bayesian and frequentist approaches to this, it is difficult to obtain good Bayesian and frequentist properties…

Statistics Theory · Mathematics 2022-01-19 Ksheera Sagar , Sayantan Banerjee , Jyotishka Datta , Anindya Bhadra

In recent years, neural networks have revolutionized various domains, yet challenges such as hyperparameter tuning and overfitting remain significant hurdles. Bayesian neural networks offer a framework to address these challenges by…

Machine Learning · Computer Science 2025-12-16 Hayk Amirkhanian , Marco F. Huber

Bayesian latent space models offer a principled approach to network representation, but rely on correct specification of both geometry and link function. Real-world networks often violate these assumptions, exhibiting geometric mismatch and…

Machine Learning · Statistics 2026-05-20 Aldric Labarthe

We consider a Bayesian nonparametric approach to a family of linear inverse problems in a separable Hilbert space setting with Gaussian noise. We assume Gaussian priors, which are conjugate to the model, and present a method of identifying…

Statistics Theory · Mathematics 2013-08-05 Sergios Agapiou , Stig Larsson , Andrew M. Stuart

This paper considers the posterior contraction of non-parametric Bayesian inference on non-homogeneous Poisson processes. We consider the quality of inference on a rate function $\lambda$, given non-identically distributed realisations,…

Statistics Theory · Mathematics 2019-06-26 James A. Grant , David S. Leslie