English
Related papers

Related papers: Streamlined Variational Inference for Linear Mixed…

200 papers

Hawkes processes are often applied to model dependence and interaction phenomena in multivariate event data sets, such as neuronal spike trains, social interactions, and financial transactions. In the nonparametric setting, learning the…

Statistics Theory · Mathematics 2023-09-04 Deborah Sulem , Vincent Rivoirard , Judith Rousseau

This work considers variational Bayesian inference as an inexpensive and scalable alternative to a fully Bayesian approach in the context of sparsity-promoting priors. In particular, the priors considered arise from scale mixtures of Normal…

Computation · Statistics 2022-11-01 Kody J. H. Law , Vitaly Zankin

Structured additive distributional regression models offer a versatile framework for estimating complete conditional distributions by relating all parameters of a parametric distribution to covariates. Although these models efficiently…

Methodology · Statistics 2023-11-14 Jana Kleinemeier , Nadja Klein

While stochastic variational inference is relatively well known for scaling inference in Bayesian probabilistic models, related methods also offer ways to circumnavigate the approximation of analytically intractable expectations. The key…

Machine Learning · Statistics 2015-09-08 David A. Knowles

In this paper, we address the fundamental problem of line spectral estimation in a Bayesian framework. We target model order and parameter estimation via variational inference in a probabilistic model in which the frequencies are…

Information Theory · Computer Science 2017-04-05 Mihai-Alin Badiu , Thomas Lundgaard Hansen , Bernard Henri Fleury

One of the core problems of modern statistics is to approximate difficult-to-compute probability densities. This problem is especially important in Bayesian statistics, which frames all inference about unknown quantities as a calculation…

Computation · Statistics 2018-05-11 David M. Blei , Alp Kucukelbir , Jon D. McAuliffe

Beta regression models are a suitable choice for continuous response variables on the unity interval. Random effects add further flexibility to the models and accommodate data structures such as hierarchical, repeated measures and…

Applications · Statistics 2017-04-25 Wagner H. Bonat , Paulo J. Ribeiro , Walmes Marque Zeviani

Recently, a number of mostly $\ell_1$-norm regularized least squares type deterministic algorithms have been proposed to address the problem of \emph{sparse} adaptive signal estimation and system identification. From a Bayesian perspective,…

Variational inference methods have been shown to lead to significant improvements in the computational efficiency of approximate Bayesian inference in mixed multinomial logit models when compared to standard Markov-chain Monte Carlo (MCMC)…

Computation · Statistics 2020-04-14 Filipe Rodrigues

Nonlinear Mixed effects models are hidden variables models that are widely used in many fields such as pharmacometrics. In such models, the distribution characteristics of hidden variables can be specified by including several parameters…

Methodology · Statistics 2021-10-19 Edouard Ollier

Variational Bayes (VB) is a popular scalable alternative to Markov chain Monte Carlo for Bayesian inference. We study a mean-field spike and slab VB approximation of widely used Bayesian model selection priors in sparse high-dimensional…

Machine Learning · Statistics 2021-09-07 Kolyan Ray , Botond Szabo , Gabriel Clara

Linear mixed models with large imbalanced crossed random effects structures pose severe computational problems for maximum likelihood estimation and for Bayesian analysis. The costs can grow as fast as $N^{3/2}$ when there are N…

Methodology · Statistics 2017-05-30 K. Gao , A. B. Owen

We provide finite-sample distribution approximations, that are uniform in the parameter, for inference in linear mixed models. Focus is on variances and covariances of random effects in cases where existing theory fails because their…

Statistics Theory · Mathematics 2025-07-29 Karl Oskar Ekvall , Matteo Bottai

Structural equation models are commonly used to capture the relationship between sets of observed and unobservable variables. Traditionally these models are fitted using frequentist approaches but recently researchers and practitioners have…

Methodology · Statistics 2023-02-22 Khue-Dung Dang , Luca Maestrini

Machine learning methods for computational imaging require uncertainty estimation to be reliable in real settings. While Bayesian models offer a computationally tractable way of recovering uncertainty, they need large data volumes to be…

Machine Learning · Computer Science 2020-08-24 Francesco Tonolini , Jack Radford , Alex Turpin , Daniele Faccio , Roderick Murray-Smith

We propose a method to approximate the distribution of robot configurations satisfying multiple objectives. Our approach uses variational inference, a popular method in Bayesian computation, which has several advantages over sampling-based…

Robotics · Computer Science 2019-11-25 Emmanuel Pignat , Teguh Lembono , Sylvain Calinon

In stochastic variational inference, the variational Bayes objective function is optimized using stochastic gradient approximation, where gradients computed on small random subsets of data are used to approximate the true gradient over the…

Methodology · Statistics 2015-10-19 Linda S. L. Tan , David J. Nott

A principled method to obtain approximate solutions of general constrained integer optimization problems is introduced. The approach is based on the calculation of a mean field probability distribution for the decision variables which is…

Optimization and Control · Mathematics 2013-05-08 Arturo Berrones , Jonás Velasco , Juan Banda

In this paper, we present a variational inference algorithm that decomposes a signal into multiple groups of related spectral lines. The spectral lines in each group are associated with a group parameter common to all spectral lines within…

Signal Processing · Electrical Eng. & Systems 2025-11-05 Jakob Möderl , Franz Pernkopf , Klaus Witrisal , Erik Leitinger

We address the problem of providing inference from a Bayesian perspective for parameters selected after viewing the data. We present a Bayesian framework for providing inference for selected parameters, based on the observation that…

Computation · Statistics 2015-03-13 Daniel Yekutieli