English
Related papers

Related papers: Provably Scalable Black-Box Variational Inference …

200 papers

Modern methods for Bayesian regression beyond the Gaussian response setting are often computationally impractical or inaccurate in high dimensions. In fact, as discussed in recent literature, bypassing such a trade-off is still an open…

Methodology · Statistics 2022-04-14 Augusto Fasano , Daniele Durante , Giacomo Zanella

Variational approximation has been widely used in large-scale Bayesian inference recently, the simplest kind of which involves imposing a mean field assumption to approximate complicated latent structures. Despite the computational…

Statistics Theory · Mathematics 2019-05-21 Purnamrita Sarkar , Y. X. Rachel Wang , Soumendu Sundar Mukherjee

High-cardinality categorical variables are variables for which the number of different levels is large relative to the sample size of a data set, or in other words, there are few data points per level. Machine learning methods can have…

Machine Learning · Computer Science 2023-07-06 Fabio Sigrist

For many decades now, Bayesian Model Averaging (BMA) has been a popular framework to systematically account for model uncertainty that arises in situations when multiple competing models are available to describe the same or similar…

Computation · Statistics 2022-03-29 Vojtech Kejzlar , Shrijita Bhattacharya , Mookyong Son , Tapabrata Maiti

One of the core problems of modern statistics is to approximate difficult-to-compute probability densities. This problem is especially important in Bayesian statistics, which frames all inference about unknown quantities as a calculation…

Computation · Statistics 2018-05-11 David M. Blei , Alp Kucukelbir , Jon D. McAuliffe

Reconstructing the evolutionary history relating a collection of molecular sequences is the main subject of modern Bayesian phylogenetic inference. However, the commonly used Markov chain Monte Carlo methods can be inefficient due to the…

Machine Learning · Statistics 2024-08-12 Tianyu Xie , Frederick A. Matsen , Marc A. Suchard , Cheng Zhang

Given an intractable target density $p$, variational inference (VI) attempts to find the best approximation $q$ from a tractable family $Q$. This is typically done by minimizing the exclusive Kullback-Leibler divergence, $\text{KL}(q||p)$.…

Machine Learning · Statistics 2025-11-04 Charles C. Margossian , Lawrence K. Saul

We consider the problem of fitting variational posterior approximations using stochastic optimization methods. The performance of these approximations depends on (1) how well the variational family matches the true posterior…

Despite variations in architecture and pretraining strategies, recent studies indicate that large-scale AI models often converge toward similar internal representations that also align with neural activity. We propose that scale-invariance,…

Neurons and Cognition · Quantitative Biology 2025-06-17 Junjie Yu , Wenxiao Ma , Jianyu Zhang , Haotian Deng , Zihan Deng , Yi Guo , Quanying Liu

We introduce overdispersed black-box variational inference, a method to reduce the variance of the Monte Carlo estimator of the gradient in black-box variational inference. Instead of taking samples from the variational distribution, we use…

Machine Learning · Statistics 2016-03-04 Francisco J. R. Ruiz , Michalis K. Titsias , David M. Blei

Current variational inference methods for hierarchical Bayesian nonparametric models can neither characterize the correlation structure among latent variables due to the mean-field setting, nor infer the true posterior dimension because of…

Machine Learning · Statistics 2022-04-07 Yirui Liu , Xinghao Qiao , Jessica Lam

Matrix valued data has become increasingly prevalent in many applications. Most of the existing clustering methods for this type of data are tailored to the mean model and do not account for the dependence structure of the features, which…

Machine Learning · Statistics 2023-12-07 Inbeom Lee , Siyi Deng , Yang Ning

We present improved methods of using structured SVMs in a large-scale hierarchical classification problem, that is when labels are leaves, or sets of leaves, in a tree or a DAG. We examine the need to normalize both the regularization and…

Machine Learning · Computer Science 2016-03-07 Heejin Choi , Yutaka Sasaki , Nathan Srebro

The stochastic variational inference (SVI) paradigm, which combines variational inference, natural gradients, and stochastic updates, was recently proposed for large-scale data analysis in conjugate Bayesian models and demonstrated to be…

Machine Learning · Statistics 2018-02-05 Rishit Sheth , Roni Khardon

Structural equation models are commonly used to capture the relationship between sets of observed and unobservable variables. Traditionally these models are fitted using frequentist approaches but recently researchers and practitioners have…

Methodology · Statistics 2023-02-22 Khue-Dung Dang , Luca Maestrini

We propose a novel variational Bayes approach to estimate high-dimensional vector autoregression (VAR) models with hierarchical shrinkage priors. Our approach does not rely on a conventional structural VAR representation of the parameter…

Econometrics · Economics 2023-07-03 Mauro Bernardi , Daniele Bianchi , Nicolas Bianco

We describe \textit{deep exponential families} (DEFs), a class of latent variable models that are inspired by the hidden structures used in deep neural networks. DEFs capture a hierarchy of dependencies between latent variables, and are…

Machine Learning · Statistics 2014-11-11 Rajesh Ranganath , Linpeng Tang , Laurent Charlin , David M. Blei

Semi-implicit variational inference (SIVI) greatly enriches the expressiveness of variational families by considering implicit variational distributions defined in a hierarchical manner. However, due to the intractable densities of…

Machine Learning · Statistics 2023-08-22 Longlin Yu , Cheng Zhang

We propose a differential geometric construction for families of low-rank covariance matrices, via interpolation on low-rank matrix manifolds. In contrast with standard parametric covariance classes, these families offer significant…

Computation · Statistics 2020-04-28 Antoni Musolas , Estelle Massart , Julien M. Hendrickx , P. -A. Absil , Youssef Marzouk

The widespread success of convolutional neural networks may largely be attributed to their intrinsic property of translation equivariance. However, convolutions are not equivariant to variations in scale and fail to generalize to objects of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Thomas Altstidl , An Nguyen , Leo Schwinn , Franz Köferl , Christopher Mutschler , Björn Eskofier , Dario Zanca