English
Related papers

Related papers: Bayesian modelling of VAR precision matrices using…

200 papers

Sparse convex clustering is to cluster observations and conduct variable selection simultaneously in the framework of convex clustering. Although a weighted $L_1$ norm is usually employed for the regularization term in sparse convex…

Machine Learning · Statistics 2020-05-27 Kaito Shimamura , Shuichi Kawano

We study full Bayesian procedures for high-dimensional linear regression under sparsity constraints. The prior is a mixture of point masses at zero and continuous distributions. Under compatibility conditions on the design matrix, the…

Statistics Theory · Mathematics 2015-10-15 Ismaël Castillo , Johannes Schmidt-Hieber , Aad van der Vaart

Variants of fluctuation theorems recently discovered in the statistical mechanics of non-equilibrium processes may be used for the efficient determination of high-dimensional integrals as typically occurring in Bayesian data analysis. In…

Data Analysis, Statistics and Probability · Physics 2015-06-19 Alberto Favaro , Daniel Nickelsen , Elena Barykina , Andreas Engel

In cluster analysis interest lies in probabilistically capturing partitions of individuals, items or observations into groups, such that those belonging to the same group share similar attributes or relational profiles. Bayesian posterior…

Methodology · Statistics 2017-03-23 Riccardo Rastelli , Nial Friel

Modeling relations between individuals is a classical question in social sciences and clustering individuals according to the observed patterns of interactions allows to uncover a latent structure in the data. Stochastic block model (SBM)…

Methodology · Statistics 2015-01-27 Pierre Barbillon , Sophie Donnet , Emmanuel Lazega , Avner Bar-Hen

Finite Gaussian mixture models provide a powerful and widely employed probabilistic approach for clustering multivariate continuous data. However, the practical usefulness of these models is jeopardized in high-dimensional spaces, where…

Methodology · Statistics 2022-05-13 Alessandro Casa , Andrea Cappozzo , Michael Fop

We consider the problem of fitting variational posterior approximations using stochastic optimization methods. The performance of these approximations depends on (1) how well the variational family matches the true posterior…

The stochastic block model is one of the most studied network models for community detection. It is well-known that most algorithms proposed for fitting the stochastic block model likelihood function cannot scale to large-scale networks.…

Methodology · Statistics 2021-08-31 Jiangzhou Wang , Jingfei Zhang , Binghui Liu , Ji Zhu , Jianhua Guo

Sparseness of the regression coefficient vector is often a desirable property, since, among other benefits, sparseness improves interpretability. In practice, many true regression coefficients might be negligibly small, but non-zero, which…

Methodology · Statistics 2019-10-01 Daniel Andrade , Kenji Fukumizu

Neural networks are the cornerstone of modern machine learning, yet can be difficult to interpret, give overconfident predictions and are vulnerable to adversarial attacks. Bayesian neural networks (BNNs) provide some alleviation of these…

Machine Learning · Statistics 2026-02-24 August Arnstad , Leiv Rønneberg , Geir Storvik

Model misspecification in multivariate econometric models can strongly influence estimates of quantities of interest such as structural parameters, forecast distributions or responses to structural shocks, even more so if higher-order…

Econometrics · Economics 2025-09-09 Florian Huber , Massimiliano Marcellino , Tobias Scheckel

We develop a new Bayesian modelling framework for the class of higher-order, variable-memory Markov chains, and introduce an associated collection of methodological tools for exact inference with discrete time series. We show that a version…

We introduce a variational Bayesian neural network where the parameters are governed via a probability distribution on random matrices. Specifically, we employ a matrix variate Gaussian \cite{gupta1999matrix} parameter posterior…

Machine Learning · Statistics 2016-06-24 Christos Louizos , Max Welling

Modern neural network architectures have achieved remarkable accuracies but remain highly dependent on their training data, often lacking interpretability in their learned mappings. While effective on large datasets, they tend to overfit on…

Machine Learning · Computer Science 2025-03-19 Pavia Bera , Sanjukta Bhanja

Exact recovery in stochastic block models (SBMs) is well understood in undirected settings, but remains considerably less developed for directed and sparse networks, particularly when the number of communities diverges. Spectral methods for…

Machine Learning · Statistics 2026-02-18 Behzad Aalipur , Yichen Qin

We propose a Bayesian methodology for estimating spiked covariance matrices with jointly sparse structure in high dimensions. The spiked covariance matrix is reparametrized in terms of the latent factor model, where the loading matrix is…

Methodology · Statistics 2019-01-31 Fangzheng Xie , Yanxun Xu , Carey E. Priebe , Joshua Cape

We propose a scalable algorithmic framework for exact Bayesian variable selection and model averaging in linear models under the assumption that the Gram matrix is block-diagonal, and as a heuristic for exploring the model space for general…

Computation · Statistics 2017-01-04 Omiros Papaspiliopoulos , David Rossell

This paper focuses on exploring the sparsity of the inverse covariance matrix $\bSigma^{-1}$, or the precision matrix. We form blocks of parameters based on each off-diagonal band of the Cholesky factor from its modified Cholesky…

Methodology · Statistics 2008-05-27 Clifford Lam

Inference networks of traditional Variational Autoencoders (VAEs) are typically amortized, resulting in relatively inaccurate posterior approximation compared to instance-wise variational optimization. Recent semi-amortized approaches were…

Machine Learning · Computer Science 2020-11-18 Minyoung Kim , Vladimir Pavlovic

In variational autoencoders, the prior on the latent codes $z$ is often treated as an afterthought, but the prior shapes the kind of latent representation that the model learns. If the goal is to learn a representation that is interpretable…

Machine Learning · Computer Science 2018-10-17 Sharad Vikram , Matthew D. Hoffman , Matthew J. Johnson