English
Related papers

Related papers: Geometric variational inference

200 papers

Wasserstein geometry and information geometry are two important structures introduced in a manifold of probability distributions. The former is defined by using the transportation cost between two distributions, so it reflects the metric…

Statistics Theory · Mathematics 2020-03-13 Shun-ichi Amari

We study computing geometric problems on uncertain points. An uncertain point is a point that does not have a fixed location, but rather is described by a probability distribution. When these probability distributions are restricted to a…

Computational Geometry · Computer Science 2012-05-03 Allan Jorgensen , Maarten Löffler , Jeff M. Phillips

In order to predict future performance of subsurface fluid reservoirs under possible operating scenarios, a dynamic, porous-medium flow simulation model must be tuned to include representative properties of the reservoir. Estimating…

Geophysics · Physics 2026-02-04 Zhen Zhang , Xuebin Zhao , Andrew Curtis

Recent variational Bayes methods for geospatial regression, proposed as an alternative to computationally expensive Markov chain Monte Carlo (MCMC) sampling, have leveraged Nearest Neighbor Gaussian processes (NNGP) to achieve scalability.…

Computation · Statistics 2025-07-17 Jiafang Song , Abhirup Datta

The Bayesian approach to Inverse Problems relies predominantly on Markov Chain Monte Carlo methods for posterior inference. The typical nonlinear concentration of posterior measure observed in many such Inverse Problems presents severe…

Computation · Statistics 2016-02-17 Shiwei Lan , Tan Bui-Thanh , Mike Christie , Mark Girolami

Distributed inference/estimation in Bayesian framework in the context of sensor networks has recently received much attention due to its broad applicability. The variational Bayesian (VB) algorithm is a technique for approximating…

Machine Learning · Statistics 2020-11-30 Junhao Hua , Chunguang Li

In a variety of scientific applications we wish to characterize a physical system using measurements or observations. This often requires us to solve an inverse problem, which usually has non-unique solutions so uncertainty must be…

Geophysics · Physics 2022-05-19 Xin Zhang , Muhammad Atif Nawaz , Xuebin Zhao , Andrew Curtis

A key design constraint when implementing Monte Carlo and variational inference algorithms is that it must be possible to cheaply and exactly evaluate the marginal densities of proposal distributions and variational families. This takes…

Machine Learning · Computer Science 2022-11-22 Alexander K. Lew , Marco Cusumano-Towner , Vikash K. Mansinghka

Modern variational inference (VI) uses stochastic gradients to avoid intractable expectations, enabling large-scale probabilistic inference in complex models. VI posits a family of approximating distributions q and then finds the member of…

Machine Learning · Statistics 2021-02-24 Christian A. Naesseth , Fredrik Lindsten , David Blei

Estimating mutual information (MI) between two continuous random variables $X$ and $Y$ allows to capture non-linear dependencies between them, non-parametrically. As such, MI estimation lies at the core of many data science applications.…

Information Theory · Computer Science 2022-01-19 Alexander Marx , Jonas Fischer

As modern neural networks get more complex, specifying a model with high predictive performance and sound uncertainty quantification becomes a more challenging task. Despite some promising theoretical results on the true posterior…

Machine Learning · Computer Science 2025-06-18 Alisa Sheinkman , Sara Wade

Variance parameter estimation in linear mixed models is a challenge for many classical nonlinear optimization algorithms due to the positive-definiteness constraint of the random effects covariance matrix. We take a completely novel view on…

Machine Learning · Statistics 2022-12-20 Lena Sembach , Jan Pablo Burgard , Volker H. Schulz

Varying coefficient models (VCMs) are widely used for estimating nonlinear regression functions for functional data. Their Bayesian variants using Gaussian process priors on the functional coefficients, however, have received limited…

Methodology · Statistics 2022-03-01 Rajarshi Guhaniyogi , Cheng Li , Terrance D. Savitsky , Sanvesh Srivastava

Variational inference (VI) is widely used as an efficient alternative to Markov chain Monte Carlo. It posits a family of approximating distributions $q$ and finds the closest member to the exact posterior $p$. Closeness is usually measured…

Machine Learning · Statistics 2017-11-15 Adji B. Dieng , Dustin Tran , Rajesh Ranganath , John Paisley , David M. Blei

Latent variable models are powerful tools for learning low-dimensional manifolds from high-dimensional data. However, when dealing with constrained data such as unit-norm vectors or symmetric positive-definite matrices, existing approaches…

Machine Learning · Computer Science 2025-03-10 Leonel Rozo , Miguel González-Duque , Noémie Jaquier , Søren Hauberg

Approximating complex probability distributions, such as Bayesian posterior distributions, is of central interest in many applications. We study the expressivity of geometric Gaussian approximations. These consist of approximations by…

Differential Geometry · Mathematics 2025-07-02 Nathaël Da Costa , Bálint Mucsányi , Philipp Hennig

This paper sheds light on the essential characteristics of geodesics, which frequently occur in considerations from motion in Euclidean space. Focus is mainly on a method of obtaining them from the calculus of variations, and an explicit…

General Mathematics · Mathematics 2017-03-21 Uchechukwu Michael Opara

Geometric quantiles are popular location functionals to build rank-based statistical procedures in multivariate settings. They are obtained through the minimization of a non-smooth convex objective function. As a result, the singularity of…

Statistics Theory · Mathematics 2026-02-11 Dimitri Konen , Gilles Stupfler

The spatial error model (SEM) is a type of simultaneous autoregressive (SAR) model for analysing spatially correlated data. Markov chain Monte Carlo (MCMC) is one of the most widely used Bayesian methods for estimating SEM, but it has…

Methodology · Statistics 2024-06-14 Anjana Wijayawardhana , David Gunawan , Thomas Suesse

To obtain high-resolution images of subsurface structures from seismic data, seismic imaging techniques such as Full Waveform Inversion (FWI) serve as crucial tools. However, FWI involves solving a nonlinear and often non-unique inverse…

Geophysics · Physics 2024-06-10 Yuke Xie , Hervé Chauris , Nicolas Desassis