English
Related papers

Related papers: Collapsed Variational Inference for Nonparametric …

200 papers

This paper presents an efficient variational inference framework for deriving a family of structured gaussian process regression network (SGPRN) models. The key idea is to incorporate auxiliary inducing variables in latent functions and…

Machine Learning · Computer Science 2021-11-19 Rui Meng , Herbie Lee , Kristofer Bouchard

Negative controls are increasingly used to evaluate the presence of potential unmeasured confounding in observational studies. Beyond the use of negative controls to detect the presence of residual confounding, proximal causal inference…

Methodology · Statistics 2024-06-06 Jiewen Liu , Chan Park , Kendrick Li , Eric J. Tchetgen Tchetgen

Neuroimaging meta-analysis is an important tool for finding consistent effects over studies that each usually have 20 or fewer subjects. Interest in meta-analysis in brain mapping is also driven by a recent focus on so-called "reverse…

Applications · Statistics 2014-12-05 Jian Kang , Thomas E. Nichols , Tor D. Wager , Timothy D. Johnson

Variational Autoencoders (VAEs) provide a flexible and scalable framework for non-linear dimensionality reduction. However, in application domains such as genomics where data sets are typically tabular and high-dimensional, a black-box…

Machine Learning · Statistics 2020-03-10 Kaspar Märtens , Christopher Yau

We study the implementation of Automatic Differentiation Variational inference (ADVI) for Bayesian inference on regression models with bridge penalization. The bridge approach uses $\ell_{\alpha}$ norm, with $\alpha \in (0, +\infty)$ to…

Machine Learning · Statistics 2023-08-08 Carlos Tadeu Pagani Zanini , Helio dos Santos Migon , Ronaldo Dias

Variational Bayes (VB), also known as independent mean-field approximation, has become a popular method for Bayesian network inference in recent years. Its application is vast, e.g. in neural network, compressed sensing, clustering, etc. to…

Information Theory · Computer Science 2018-03-30 Viet Hung Tran

Neuroimaging studies produce gigabytes of spatio-temporal data for a small number of participants and stimuli. Rarely do researchers attempt to model and examine how individual participants vary from each other -- a question that should be…

A nonparanormal graphical model is a semiparametric generalization of a Gaussian graphical model for continuous variables in which it is assumed that the variables follow a Gaussian graphical model only after some unknown smooth monotone…

Methodology · Statistics 2021-02-23 Jami J. Mulgrave , Subhashis Ghosal

Given observed data and a probabilistic generative model, Bayesian inference searches for the distribution of the model's parameters that could have yielded the data. Inference is challenging for large population studies where millions of…

Machine Learning · Statistics 2023-08-31 Louis Rouillard , Alexandre Le Bris , Thomas Moreau , Demian Wassermann

We develop an efficient Bayesian sequential inference framework for factor analysis models observed via various data types, such as continuous, binary and ordinal data. In the continuous data case, where it is possible to marginalise over…

Methodology · Statistics 2022-01-28 Konstantinos Vamvourellis , Konstantinos Kalogeropoulos , Irini Moustaki

Metabolomics is the study of small molecules in biological samples. Metabolomics data are typically high-dimensional and contain highly correlated variables and frequent missing values. Both missing at random (MAR) data, due to acquisition…

The stochastic variational inference (SVI) paradigm, which combines variational inference, natural gradients, and stochastic updates, was recently proposed for large-scale data analysis in conjugate Bayesian models and demonstrated to be…

Machine Learning · Statistics 2018-02-05 Rishit Sheth , Roni Khardon

Gaussian processes (GPs) are Bayesian nonparametric models for function approximation with principled predictive uncertainty estimates. Deep Gaussian processes (DGPs) are multilayer generalizations of GPs that can represent complex marginal…

Machine Learning · Statistics 2024-09-20 Qiuxian Meng , Yongyou Zhang

The main challenge in Bayesian models is to determine the posterior for the model parameters. Already, in models with only one or few parameters, the analytical posterior can only be determined in special settings. In Bayesian neural…

Machine Learning · Statistics 2021-06-02 Sefan Hörtling , Daniel Dold , Oliver Dürr , Beate Sick

A beta-negative binomial (BNB) process is proposed, leading to a beta-gamma-Poisson process, which may be viewed as a "multi-scoop" generalization of the beta-Bernoulli process. The BNB process is augmented into a beta-gamma-gamma-Poisson…

Machine Learning · Statistics 2012-02-07 Mingyuan Zhou , Lauren Hannah , David Dunson , Lawrence Carin

Bounded Variable Addition (BVA) is a central preprocessing method in modern state-of-the-art SAT solvers. We provide a graph-theoretic characterization of which 2-CNF encodings can be constructed by an idealized BVA algorithm. Based on this…

Computational Complexity · Computer Science 2026-04-21 Benjamin Przybocki , Bernardo Subercaseaux , Marijn J. H. Heule

Nested error regression models are useful tools for analysis of grouped data, especially in the case of small area estimation. This paper suggests a nested error regression model using uncertain random effects in which the random effect in…

Methodology · Statistics 2017-02-28 Shonosuke Sugasawa , Tatsuya Kubokawa

Deep Gaussian Process (DGP) models offer a powerful nonparametric approach for Bayesian inference, but exact inference is typically intractable, motivating the use of various approximations. However, existing approaches, such as mean-field…

Machine Learning · Computer Science 2025-08-13 Jian Xu , Shian Du , Junmei Yang , Qianli Ma , Delu Zeng

The Gaussian process latent variable model (GPLVM) is a popular probabilistic method used for nonlinear dimension reduction, matrix factorization, and state-space modeling. Inference for GPLVMs is computationally tractable only when the…

Machine Learning · Statistics 2023-06-16 Michael Minyi Zhang , Gregory W. Gundersen , Barbara E. Engelhardt

The Bayesian approach to feature extraction, known as factor analysis (FA), has been widely studied in machine learning to obtain a latent representation of the data. An adequate selection of the probabilities and priors of these bayesian…

Machine Learning · Statistics 2020-01-27 Carlos Sevilla-Salcedo , Vanessa Gómez-Verdejo , Pablo M. Olmos