English
Related papers

Related papers: Variational Inference with Holder Bounds

200 papers

Despite the advances in the representational capacity of approximate distributions for variational inference, the optimization process can still limit the density that is ultimately learned. We demonstrate the drawbacks of biasing the true…

Machine Learning · Computer Science 2018-10-29 Chin-Wei Huang , Shawn Tan , Alexandre Lacoste , Aaron Courville

Variational inference (VI) is a widely used framework in Bayesian estimation. For most of the non-Gaussian statistical models, it is infeasible to find an analytically tractable solution to estimate the posterior distributions of the…

Machine Learning · Statistics 2020-01-31 Zhanyu Ma , Jalil Taghia , Jun Guo

Deep learning potentials for complex many-body systems often face challenges of insufficient accuracy and a lack of physical realism. This paper proposes an "Observable-Constrained Variational Framework" (OCVF), a general top-down…

Materials Science · Physics 2026-05-11 Shaoliang Guo , Ziping Yang

Visual-inertial odometry (VIO) has demonstrated remarkable success due to its low-cost and complementary sensors. However, existing VIO methods lack the generalization ability to adjust to different environments and sensor attributes. In…

Robotics · Computer Science 2024-05-28 Youqi Pan , Wugen Zhou , Yingdian Cao , Hongbin Zha

Vanilla variational inference finds an optimal approximation to the Bayesian posterior distribution, but even the exact Bayesian posterior is often not meaningful under model misspecification. We propose predictive variational inference…

Machine Learning · Statistics 2026-03-31 Jinlin Lai , Antonio Linero , Yuling Yao

In recent years, there has been a growing trend of incorporating hyperbolic geometry methods into computer vision. While these methods have achieved state-of-the-art performance on various metric learning tasks using hyperbolic distance…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Yun Yue , Fangzhou Lin , Guanyi Mou , Ziming Zhang

A framework to boost the efficiency of Bayesian inference in probabilistic programs is introduced by embedding a sampler inside a variational posterior approximation. We call it the refined variational approximation. Its strength lies both…

Machine Learning · Computer Science 2020-02-25 Victor Gallego , David Rios Insua

In variational inference (VI), an approximation of the posterior distribution is selected from a family of distributions through numerical optimization. With the most common variational objective function, known as the evidence lower bound…

Machine Learning · Statistics 2025-01-15 Declan McNamara , Jackson Loper , Jeffrey Regier

Variational inference is an approximation framework for Bayesian inference that seeks to improve quantified uncertainty in predictions by optimizing a simplified distribution over parameters to stand in for the full posterior. Capturing…

Machine Learning · Computer Science 2023-09-12 Jed A. Duersch

Models of discrete-valued outcomes are easily misspecified if the data exhibit zero-inflation, overdispersion or contamination. Without additional knowledge about the existence and nature of this misspecification, model inference and…

Methodology · Statistics 2020-10-27 Jeremias Knoblauch , Lara Vomfell

Variational inference has become an increasingly attractive fast alternative to Markov chain Monte Carlo methods for approximate Bayesian inference. However, a major obstacle to the widespread use of variational methods is the lack of…

Machine Learning · Statistics 2020-03-03 Jonathan H. Huggins , Mikołaj Kasprzak , Trevor Campbell , Tamara Broderick

Semi-implicit variational inference (SIVI) enriches the expressiveness of variational families by utilizing a kernel and a mixing distribution to hierarchically define the variational distribution. Existing SIVI methods parameterize the…

Machine Learning · Statistics 2025-01-16 Jen Ning Lim , Adam M. Johansen

The main computational challenge in Bayesian inference is to compute integrals against a high-dimensional posterior distribution. In the past decades, variational inference (VI) has emerged as a tractable approximation to these integrals,…

Statistics Theory · Mathematics 2024-01-09 Anya Katsevich , Philippe Rigollet

In this paper, we present the Trifo Visual Inertial Odometry (Trifo-VIO), a tightly-coupled filtering-based stereo VIO system using both points and lines. Line features help improve system robustness in challenging scenarios when point…

Computer Vision and Pattern Recognition · Computer Science 2018-09-20 Feng Zheng , Grace Tsai , Zhe Zhang , Shaoshan Liu , Chen-Chi Chu , Hongbing Hu

We introduce an optimization framework for variational inference based on the coupled free energy, extending variational inference techniques to account for the curved geometry of the coupled exponential family. This family includes…

Machine Learning · Computer Science 2025-07-29 Kenric Nelson , Igor Oliveira , Amenah Al-Najafi , Fode Zhang , Hon Keung Tony Ng

Metric learning aims to learn a highly discriminative model encouraging the embeddings of similar classes to be close in the chosen metrics and pushed apart for dissimilar ones. The common recipe is to use an encoder to extract embeddings…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Aleksandr Ermolov , Leyla Mirvakhabova , Valentin Khrulkov , Nicu Sebe , Ivan Oseledets

Deep learning has revolutionized the last decade, being at the forefront of extraordinary advances in a wide range of tasks including computer vision, natural language processing, and reinforcement learning, to name but a few. However, it…

Machine Learning · Computer Science 2024-01-24 Sebastian W. Ober

Variational inference (VI) is a specific type of approximate Bayesian inference that approximates an intractable posterior distribution with a tractable one. VI casts the inference problem as an optimization problem, more specifically, the…

Machine Learning · Computer Science 2022-12-20 Felix Leibfried

Variational inference (VI) is widely used as an efficient alternative to Markov chain Monte Carlo. It posits a family of approximating distributions $q$ and finds the closest member to the exact posterior $p$. Closeness is usually measured…

Machine Learning · Statistics 2017-11-15 Adji B. Dieng , Dustin Tran , Rajesh Ranganath , John Paisley , David M. Blei

Generally, high-level features provide more geometrical information compared to point features, which can be exploited to further constrain motions. Planes are commonplace in man-made environments, offering an active means to reduce drift,…

Robotics · Computer Science 2025-05-20 Yidi Zhang , Fulin Tang , Zewen Xu , Yihong Wu , Pengju Ma