中文
相关论文

相关论文: Theoretical guidelines for annealed Langevin dynam…

200 篇论文

We develop an efficient sampling method by simulating Langevin dynamics with an artificial force rather than a natural force by using the gradient of the potential energy. The standard technique for sampling following the predetermined…

统计力学 · 物理学 2015-09-30 M. Ohzeki , A. Ichiki

Score-based generative models (SGMs) are powerful tools to sample from complex data distributions. Their underlying idea is to (i) run a forward process for time $T_1$ by adding noise to the data, (ii) estimate its score function, and (iii)…

机器学习 · 计算机科学 2024-06-06 Francesco Pedrotti , Jan Maas , Marco Mondelli

Bayesian simulation-based inference (SBI) methods are used in statistical models where simulation is feasible but the likelihood is intractable. Standard SBI methods can perform poorly in cases of model misspecification, and there has been…

统计方法学 · 统计学 2025-04-15 Wang Yuyan , Michael Evans , David J. Nott

We introduce a constructive framework to learn effective Langevin equations from stationary time series. Unlike conventional approaches that require iterative calibration to match target statistics, our construction guarantees the observed…

混沌动力学 · 物理学 2026-02-16 Ludovico Theo Giorgini

We study zero-shot conditional sampling with pretrained diffusion models for linear inverse problems, including inpainting and super-resolution. In these problems, the observation determines only part of the unknown signal. The remaining…

机器学习 · 计算机科学 2026-05-08 Ahmad Aghapour , Erhan Bayraktar , Asaf Cohen

Amortized Bayesian inference (ABI) with neural networks has emerged as a powerful simulation-based approach for estimating complex mechanistic models. However, extending ABI to hierarchical models, a cornerstone of modern Bayesian analysis,…

Score-based Generative Models (SGMs) aim to sample from a target distribution by learning score functions using samples perturbed by Gaussian noise. Existing convergence bounds for SGMs in the W2-distance rely on stringent assumptions about…

机器学习 · 统计学 2025-12-12 Marta Gentiloni-Silveri , Antonio Ocello

Adaptive or dynamic signal sampling in sensing systems can adapt subsequent sampling strategies based on acquired signals, thereby potentially improving image quality and speed. This paper proposes a Bayesian method for adaptive sampling…

信号处理 · 电气工程与系统科学 2023-02-28 Guanhua Wang , Douglas C. Noll , Jeffrey A. Fessler

We present an unbiased method for Bayesian posterior means based on kinetic Langevin dynamics that combines advanced splitting methods with enhanced gradient approximations. Our approach avoids Metropolis correction by coupling Markov…

统计计算 · 统计学 2025-12-04 Neil K. Chada , Benedict Leimkuhler , Daniel Paulin , Peter A. Whalley

We exploit the observation that stochastic variational inference (SVI) is a form of annealing and present a modified SVI approach -- applicable to both large and small datasets -- that allows the amount of annealing done by SVI to be tuned.…

机器学习 · 计算机科学 2025-11-17 John Paisley , Ghazal Fazelnia , Brian Barr

In this paper we propose a new approach for sampling from probability measures in, possibly, high dimensional spaces. By perturbing the standard overdamped Langevin dynamics by a suitable Stratonovich perturbation that preserves the…

数值分析 · 数学 2019-04-23 Assyr Abdulle , Grigorios A. Pavliotis , Gilles Vilmart

We introduce a novel geometry-informed irreversible perturbation that accelerates convergence of the Langevin algorithm for Bayesian computation. It is well documented that there exist perturbations to the Langevin dynamics that preserve…

统计方法学 · 统计学 2022-09-02 Benjamin J. Zhang , Youssef M. Marzouk , Konstantinos Spiliopoulos

Score-based generative models provide state-of-the-art quality for image and audio synthesis. Sampling from these models is performed iteratively, typically employing a discretized series of noise levels and a predefined scheme. In this…

机器学习 · 计算机科学 2021-04-09 Joan Serrà , Santiago Pascual , Jordi Pons

We study the convergence of Langevin-Simulated Annealing type algorithms with multiplicative noise, i.e. for $V : \mathbb{R}^d \to \mathbb{R}$ a potential function to minimize, we consider the stochastic equation $dY_t = - \sigma…

概率论 · 数学 2022-04-26 Pierre Bras , Gilles Pagès

Score-based generative modeling (SGM) has grown to be a hugely successful method for learning to generate samples from complex data distributions such as that of images and audio. It is based on evolving an SDE that transforms white noise…

机器学习 · 计算机科学 2022-10-04 Holden Lee , Jianfeng Lu , Yixin Tan

We consider the constrained sampling problem where the goal is to sample from a target distribution on a constrained domain. We propose skew-reflected non-reversible Langevin dynamics (SRNLD), a continuous-time stochastic differential…

机器学习 · 计算机科学 2025-04-16 Hengrong Du , Qi Feng , Changwei Tu , Xiaoyu Wang , Lingjiong Zhu

In this paper, we consider the generalised (higher order) Langevin equation for the purpose of simulated annealing and optimisation of nonconvex functions. Our approach modifies the underdamped Langevin equation by replacing the Brownian…

概率论 · 数学 2023-11-01 Martin Chak , Nikolas Kantas , Grigorios A. Pavliotis

We introduce a new generative model where samples are produced via Langevin dynamics using gradients of the data distribution estimated with score matching. Because gradients can be ill-defined and hard to estimate when the data resides on…

机器学习 · 计算机科学 2020-10-13 Yang Song , Stefano Ermon

Motivated by the increasingly popular Score-based Generative Modeling (SGM), we study the Inexact Langevin Dynamics (ILD) and Inexact Langevin Algorithm (ILA) where a score function estimate is used in place of the exact score. We establish…

机器学习 · 计算机科学 2026-03-31 Kaylee Yingxi Yang , Andre Wibisono

We consider in this paper the problem of sampling a high-dimensional probability distribution $\pi$ having a density with respect to the Lebesgue measure on $\mathbb{R}^d$, known up to a normalization constant $x \mapsto \pi(x)=…

统计理论 · 数学 2018-07-17 Alain Durmus , Eric Moulines