English
Related papers

Related papers: Variational Inference for Bayesian Bridge Regressi…

200 papers

In this paper, we develop an analytical approach for estimating brain connectivity networks that accounts for subject heterogeneity. More specifically, we consider a novel extension of a multi-subject Bayesian vector autoregressive model…

We develop a new Monte Carlo variance reduction method to estimate the expectation of two commonly encountered path-dependent functionals: first-passage times and occupation times of sets. The method is based on a recursive approximation of…

Probability · Mathematics 2014-10-28 Aleksandar Mijatovic , Martijn Pistorius , Johannes Stolte

High-dimensional vector autoregression with measurement error is frequently encountered in a large variety of scientific and business applications. In this article, we study statistical inference of the transition matrix under this model.…

Methodology · Statistics 2020-09-18 Xiang Lyu , Jian Kang , Lexin Li

We develop a penalized two-pass regression with time-varying factor loadings. The penalization in the first pass enforces sparsity for the time-variation drivers while also maintaining compatibility with the no-arbitrage restrictions by…

Econometrics · Economics 2022-08-02 Gaetan Bakalli , Stéphane Guerrier , Olivier Scaillet

We introduce Support Decomposition Variational Inference (SDVI), a new variational inference (VI) approach for probabilistic programs with stochastic support. Existing approaches to this problem rely on designing a single global variational…

Machine Learning · Computer Science 2023-11-02 Tim Reichelt , Luke Ong , Tom Rainforth

Variational inference (VI) is a method to approximate the computationally intractable posterior distributions that arise in Bayesian statistics. Typically, VI fits a simple parametric distribution to the target posterior by minimizing an…

Machine Learning · Statistics 2023-07-18 Chirag Modi , Charles Margossian , Yuling Yao , Robert Gower , David Blei , Lawrence Saul

We introduce a flexible empirical Bayes approach for fitting Bayesian generalized linear models. Specifically, we adopt a novel mean-field variational inference (VI) method and the prior is estimated within the VI algorithm, making the…

Machine Learning · Statistics 2026-01-30 Dongyue Xie , Wanrong Zhu , Matthew Stephens

This paper provides a comprehensive analysis of variational inference in latent variable models for survival analysis, emphasizing the distinctive challenges associated with applying variational methods to survival data. We identify a…

Machine Learning · Computer Science 2025-06-05 Chuanhui Liu , Xiao Wang

Variational inference has been widely used in machine learning literature to fit various Bayesian models. In network analysis, this method has been successfully applied to solve the community detection problems. Although these results are…

Machine Learning · Statistics 2024-05-22 Xuezhen Li , Can M. Le

Inverse problems of partial differential equations are ubiquitous across various scientific disciplines and can be formulated as statistical inference problems using Bayes' theorem. To address large-scale problems, it is crucial to develop…

Numerical Analysis · Mathematics 2025-12-23 Yang Zhao , Haoyu Lu , Junxiong Jia , Tao Zhou

As an example for the fast calculation of distributional parameters of Gaussian processes, we propose a new Monte Carlo algorithm for the computation of quantiles of the supremum norm of weighted Brownian bridges. As it is known, the…

Computation · Statistics 2021-01-05 Jürgen Franke , Mario Hefter , André Herzwurm , Klaus Ritter , Stefanie Schwaar

Bayesian finite mixture models can identify discrete risk clusters (low-risk vs. high-risk equipment), but face three critical bottlenecks: (1) insufficient degradation signals from coarse state discretization, (2) unstable cluster…

Machine Learning · Computer Science 2026-04-29 Takato Yasuno

We derive streamlined mean field variational Bayes algorithms for fitting linear mixed models with crossed random effects. In the most general situation, where the dimensions of the crossed groups are arbitrarily large, streamlining is…

Methodology · Statistics 2022-04-15 Marianne Menictas , Gioia Di Credico , Matt P. Wand

We introduce Action-Inspired Generative Models (AGMs), a dual-network generative framework motivated by the observation that existing bridge-matching methods assign uniform regression weight to every stochastic transition in the transport…

Machine Learning · Computer Science 2026-05-15 Eshwar R. A. , Debnath Pal

Augmenting a smooth cost function with an $\ell_1$ penalty allows analysts to efficiently conduct estimation and variable selection simultaneously in sophisticated models and can be efficiently implemented using proximal gradient methods.…

Machine Learning · Statistics 2024-12-10 Nathan Wycoff , Lisa O. Singh , Ali Arab , Katharine M. Donato

Optimal designs minimize the number of experimental runs (samples) needed to accurately estimate model parameters, resulting in algorithms that, for instance, efficiently minimize parameter estimate variance. Governed by knowledge of past…

Methodology · Statistics 2023-02-03 Nicholas W. Barendregt , Emily G. Webb , Zachary P. Kilpatrick

There is a growing interest in the so-called Bayesian Predictive Inference approach, which allows to perform Bayesian inference without specifying the likelihood and prior of the model, or the need of any MCMC. Instead, only a sequence of…

Statistics Theory · Mathematics 2025-09-30 Marco Battiston , Lorenzo Cappello

In a Gaussian graphical model, the conditional independence between two variables are characterized by the corresponding zero entries in the inverse covariance matrix. Maximum likelihood method using the smoothly clipped absolute deviation…

Methodology · Statistics 2009-09-07 Xin Gao , Daniel Q. Pu , Yuehua Wu , Hong Xu

Approximating complex probability densities is a core problem in modern statistics. In this paper, we introduce the concept of Variational Inference (VI), a popular method in machine learning that uses optimization techniques to estimate…

Machine Learning · Computer Science 2021-11-23 Ankush Ganguly , Samuel W. F. Earp

A Bayesian approach to the classification problem is proposed in which random partitions play a central role. It is argued that the partitioning approach has the capacity to take advantage of a variety of large-scale spatial structures, if…

Statistics Theory · Mathematics 2007-06-13 Marc A. Coram