English
Related papers

Related papers: Variational Inference with Holder Bounds

200 papers

Variational Inference (VI) is an attractive alternative to Markov Chain Monte Carlo (MCMC) due to its computational efficiency in the case of large datasets and/or complex models with high-dimensional parameters. However, evaluating the…

Machine Learning · Statistics 2023-02-27 Yu Wang , Mikołaj Kasprzak , Jonathan H. Huggins

Visual-inertial odometry (VIO) is the pose estimation backbone for most AR/VR and autonomous robotic systems today, in both academia and industry. However, these systems are highly sensitive to the initialization of key parameters such as…

Variational Bayes (VB) is a popular and computationally efficient method to approximate the posterior distribution in Bayesian inference, especially when the exact posterior is analytically intractable and sampling-based approaches are…

Methodology · Statistics 2025-12-30 Jiaming Liu , Meng Li

Variational inference (VI) is a popular approach in Bayesian inference, that looks for the best approximation of the posterior distribution within a parametric family, minimizing a loss that is typically the (reverse) Kullback-Leibler (KL)…

Machine Learning · Statistics 2025-11-18 Marguerite Petit-Talamon , Marc Lambert , Anna Korba

Amortized variational inference (AVI) replaces instance-specific local inference with a global inference network. While AVI has enabled efficient training of deep generative models such as variational autoencoders (VAE), recent empirical…

Machine Learning · Statistics 2018-07-25 Yoon Kim , Sam Wiseman , Andrew C. Miller , David Sontag , Alexander M. Rush

Effective utilization of flexible loads for grid services, while satisfying end-user preferences and constraints, requires an accurate estimation of the aggregated predictive flexibility offered by the electrical loads. Virtual battery (VB)…

Systems and Control · Electrical Eng. & Systems 2020-03-20 Indrasis Chakraborty , Sai Pushpak Nandanoori , Soumya Kundu , Karanjit Kalsi

Prediction models are traditionally optimized independently from their use in the asset allocation decision-making process. We address this shortcoming and present a framework for integrating regression prediction models in a mean-variance…

Portfolio Management · Quantitative Finance 2022-12-01 Andrew Butler , Roy H. Kwon

Estimating and optimizing Mutual Information (MI) is core to many problems in machine learning; however, bounding MI in high dimensions is challenging. To establish tractable and scalable objectives, recent work has turned to variational…

Machine Learning · Computer Science 2019-05-17 Ben Poole , Sherjil Ozair , Aaron van den Oord , Alexander A. Alemi , George Tucker

Time-Varying Bayesian Optimization (TVBO) is the go-to framework for optimizing a time-varying, expensive, noisy black-box function $f$. However, most of the asymptotic guarantees offered by TVBO algorithms rely on the assumption that…

Machine Learning · Statistics 2025-10-21 Anthony Bardou , Patrick Thiran

Visual odometry (VO) plays a crucial role in autonomous driving, robotic navigation, and other related tasks by estimating the position and orientation of a camera based on visual input. Significant progress has been made in data-driven VO…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Dongzhihan Wang , Yang Yang , Liang Xu

The estimation of the Extreme Value Index (EVI) is fundamental in extreme value analysis but suffers from high variance due to reliance on only a few extreme observations. We propose a control variates based transfer learning approach in a…

Methodology · Statistics 2025-11-20 Louison Bocquet-Nouaille , Jérôme Morio , Benjamin Bobbia

Bayesian inference provides an attractive online-learning framework to analyze sequential data, and offers generalization guarantees which hold even with model mismatch and adversaries. Unfortunately, exact Bayesian inference is rarely…

Machine Learning · Statistics 2020-08-03 Badr-Eddine Chérief-Abdellatif , Pierre Alquier , Mohammad Emtiyaz Khan

Interpreting black-box machine learning models is challenging due to their strong dependence on data and inherently non-parametric nature. This paper reintroduces the concept of importance through "Marginal Variable Importance Metric"…

Machine Learning · Statistics 2025-01-30 Mohammad Kaviul Anam Khan , Olli Saarela , Rafal Kustra

Motivated by recent developments in Hamiltonian variational principles, Hamiltonian variational integrators, and their applications such as to optimization and control, we present a new Type II variational approach for Hamiltonian systems,…

Symplectic Geometry · Mathematics 2025-04-10 Brian K. Tran , Melvin Leok

Compared to the wide array of advanced Monte Carlo methods supported by modern probabilistic programming languages (PPLs), PPL support for variational inference (VI) is less developed: users are typically limited to a predefined selection…

Programming Languages · Computer Science 2024-06-25 McCoy R. Becker , Alexander K. Lew , Xiaoyan Wang , Matin Ghavami , Mathieu Huot , Martin C. Rinard , Vikash K. Mansinghka

We consider the problem of lossy image compression with deep latent variable models. State-of-the-art methods build on hierarchical variational autoencoders (VAEs) and learn inference networks to predict a compressible latent representation…

Image and Video Processing · Electrical Eng. & Systems 2021-01-11 Yibo Yang , Robert Bamler , Stephan Mandt

Learning interpretable and disentangled representations of data is a key topic in machine learning research. Variational Autoencoder (VAE) is a scalable method for learning directed latent variable models of complex data. It employs a clear…

Machine Learning · Computer Science 2020-06-04 Andriy Serdega , Dae-Shik Kim

We propose a novel deep visual odometry (VO) method that considers global information by selecting memory and refining poses. Existing learning-based methods take the VO task as a pure tracking problem via recovering camera poses from image…

Robotics · Computer Science 2020-08-05 Fei Xue , Xin Wang , Junqiu Wang , Hongbin Zha

Accurate thermal modeling of Terminal Test Masses (TTMs) is crucial for optimizing the sensitivity of gravitational wave interferometers like Virgo. In fact, in such gravitational wave detectors even minimal laser power absorption can…

Inference networks of traditional Variational Autoencoders (VAEs) are typically amortized, resulting in relatively inaccurate posterior approximation compared to instance-wise variational optimization. Recent semi-amortized approaches were…

Machine Learning · Computer Science 2020-11-18 Minyoung Kim , Vladimir Pavlovic