中文
相关论文

相关论文: Amortized Inference of Variational Bounds for Lear…

200 篇论文

Variational Bayesian Inference is a popular methodology for approximating posterior distributions over Bayesian neural network weights. Recent work developing this class of methods has explored ever richer parameterizations of the…

How can one perform Bayesian inference on stochastic simulators with intractable likelihoods? A recent approach is to learn the posterior from adaptively proposed simulations using neural network-based conditional density estimators.…

机器学习 · 计算机科学 2019-05-21 David S. Greenberg , Marcel Nonnenmacher , Jakob H. Macke

Variational methods are widely used for approximate posterior inference. However, their use is typically limited to families of distributions that enjoy particular conjugacy properties. To circumvent this limitation, we propose a family of…

机器学习 · 计算机科学 2012-06-22 Samuel Gershman , Matt Hoffman , David Blei

In variational inference, the benefits of Bayesian models rely on accurately capturing the true posterior distribution. We propose using neural samplers that specify implicit distributions, which are well-suited for approximating complex…

机器学习 · 计算机科学 2023-11-10 Anshuk Uppal , Kristoffer Stensbo-Smidt , Wouter Boomsma , Jes Frellsen

The analytic deep prior (ADP) approach was recently introduced for the theoretical analysis of deep image prior (DIP) methods with special network architectures. In this paper, we prove that ADP is in fact equivalent to classical…

数值分析 · 数学 2022-09-26 Clemens Arndt

Many tasks in explainable machine learning, such as data valuation and feature attribution, perform expensive computation for each data point and are intractable for large datasets. These methods require efficient approximations, and…

机器学习 · 计算机科学 2024-10-31 Ian Covert , Chanwoo Kim , Su-In Lee , James Zou , Tatsunori Hashimoto

Recent studies on inverse problems have proposed posterior samplers that leverage the pre-trained diffusion models as powerful priors. These attempts have paved the way for using diffusion models in a wide range of inverse problems.…

计算机视觉与模式识别 · 计算机科学 2024-07-24 Sojin Lee , Dogyun Park , Inho Kong , Hyunwoo J. Kim

Amortized Bayesian inference trains neural networks to solve stochastic inference problems using model simulations, thereby making it possible to rapidly perform Bayesian inference for any newly observed data. However, current…

机器学习 · 计算机科学 2024-07-16 Manuel Gloeckler , Michael Deistler , Christian Weilbach , Frank Wood , Jakob H. Macke

Zero-shot diffusion posterior sampling offers a flexible framework for inverse problems by accommodating arbitrary degradation operators at test time, but incurs high computational cost due to repeated likelihood-guided updates. In…

机器学习 · 统计学 2026-02-10 Léon Zheng , Thomas Hirtz , Yazid Janati , Eric Moulines

We propose a novel approximate inference algorithm that approximates a target distribution by amortising the dynamics of a user-selected MCMC sampler. The idea is to initialise MCMC using samples from an approximation network, apply the…

机器学习 · 统计学 2017-05-23 Yingzhen Li , Richard E. Turner , Qiang Liu

Machine learning models often suffer from catastrophic forgetting of previously learned knowledge when learning new classes. Various methods have been proposed to mitigate this issue. However, rehearsal-based learning, which retains samples…

机器学习 · 计算机科学 2024-10-10 Hossein Rezaei , Mohammad Sabokrou

Neural networks are popular state-of-the-art models for many different tasks.They are often trained via back-propagation to find a value of the weights that correctly predicts the observed data. Although back-propagation has shown good…

机器学习 · 统计学 2020-12-29 Simón Rodríguez Santana , Daniel Hernández-Lobato

Neural posterior estimation has emerged as a powerful tool for amortized inference, with growing adoption across scientific and applied domains. In many of these applications, the conditioning variable is a set of observations whose…

机器学习 · 计算机科学 2026-05-11 Antoine Wehenkel , Michael Kagan , Lukas Heinrich , Chris Pollard

This paper introduces an algorithm-agnostic approach to feature-based time series clustering via amortized neural inference. By training neural networks to approximate the optimal partitioning rule from simulated data, the proposed…

机器学习 · 统计学 2026-05-14 Ángel López-Oriona , Ying Sun

Graphs arise across diverse domains, from biology and chemistry to social and information networks, as well as in transportation and logistics. Inference on graph-structured data requires methods that are permutation-invariant, scalable…

机器学习 · 统计学 2026-05-05 Svenja Jedhoff , Elizaveta Semenova , Aura Raulo , Anne Meyer , Paul-Christian Bürkner

In this article, we propose a variational inference formulation of auto-associative memories, allowing us to combine perceptual inference and memory retrieval into the same mathematical framework. In this formulation, the prior probability…

机器学习 · 计算机科学 2022-10-18 Louis Annabi , Alexandre Pitti , Mathias Quoy

Safe active learning (AL) is a sequential scheme for learning unknown systems while respecting safety constraints during data acquisition. Existing methods often rely on Gaussian processes (GPs) to model the task and safety constraints,…

机器学习 · 计算机科学 2026-04-07 Cen-You Li , Marc Toussaint , Barbara Rakitsch , Christoph Zimmer

Bayesian inference often faces a trade-off between computational speed and sampling accuracy. We propose an adaptive workflow that integrates rapid amortized inference with gold-standard MCMC techniques to achieve a favorable combination of…

机器学习 · 计算机科学 2026-02-19 Chengkun Li , Aki Vehtari , Paul-Christian Bürkner , Stefan T. Radev , Luigi Acerbi , Marvin Schmitt

Optimization is a ubiquitous modeling tool and is often deployed in settings which repeatedly solve similar instances of the same problem. Amortized optimization methods use learning to predict the solutions to problems in these settings,…

机器学习 · 计算机科学 2025-10-07 Brandon Amos

Incorporating a deep generative model as the prior distribution in inverse problems has established substantial success in reconstructing images from corrupted observations. Notwithstanding, the existing optimization approaches use gradient…

机器学习 · 计算机科学 2023-01-31 Tianci Liu , Tong Yang , Quan Zhang , Qi Lei