English
Related papers

Related papers: Convergence analysis of Adaptive Biasing Potential…

200 papers

In this paper, we propose a sampling mechanism for adaptive diffusion networks that adaptively changes the amount of sampled nodes based on mean-squared error in the neighborhood of each node. It presents fast convergence during transient…

Signal Processing · Electrical Eng. & Systems 2020-07-16 Daniel Gilio Tiglea , Renato Candido , Magno T. M. Silva

As a highly expressive generative model, diffusion models have demonstrated exceptional success across various domains, including image generation, natural language processing, and combinatorial optimization. However, as data distributions…

Machine Learning · Computer Science 2025-10-27 Myunsoo Kim , Donghyeon Ki , Seong-Woong Shim , Byung-Jun Lee

The probabilistic diffusion model has become highly effective across various domains. Typically, sampling from a diffusion model involves using a denoising distribution characterized by a Gaussian with a learned mean and either fixed or…

Machine Learning · Computer Science 2025-02-20 Zijing Ou , Mingtian Zhang , Andi Zhang , Tim Z. Xiao , Yingzhen Li , David Barber

Diffusion models, a family of generative models based on deep learning, have become increasingly prominent in cutting-edge machine learning research. With a distinguished performance in generating samples that resemble the observed data,…

Machine Learning · Computer Science 2023-05-02 Lequan Lin , Zhengkun Li , Ruikun Li , Xuliang Li , Junbin Gao

Diffusion processes are a class of stochastic differential equations (SDEs) providing a rich family of expressive models that arise naturally in dynamic modelling tasks. Probabilistic inference and learning under generative models with…

Machine Learning · Computer Science 2024-02-28 Prakhar Verma , Vincent Adam , Arno Solin

We introduce a novel deep learning approach that harnesses the power of generative artificial intelligence to enhance the accuracy of contextual forecasting in sewerage systems. By developing a diffusion-based model that processes…

Machine Learning · Computer Science 2025-06-11 Nicholas A. Pearson , Francesca Cairoli , Luca Bortolussi , Davide Russo , Francesca Zanello

Uncertainty quantification and sensitivity analyses are a vital component for predictive modeling in the sciences and engineering. The adjoint approach to sensitivity analysis requires solving a primary system of equations and a…

Computational Physics · Physics 2016-12-08 Kelli D. Humbird , Ryan G. McClarren

Model-based reinforcement learning methods often use learning only for the purpose of estimating an approximate dynamics model, offloading the rest of the decision-making work to classical trajectory optimizers. While conceptually simple,…

Machine Learning · Computer Science 2022-12-22 Michael Janner , Yilun Du , Joshua B. Tenenbaum , Sergey Levine

Distributed adaptive networks achieve better estimation performance by exploiting temporal and as well spatial diversity while consuming few resources. Recent works have studied the single task distributed estimation problem, in which the…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-10-02 Vinay Chakravarthi Gogineni , Mrityunjoy Chakraborty

In this paper, an alternative approximation to the innovation method is introduced for the parameter estimation of diffusion processes from partial and noisy observations. This is based on a convergent approximation to the first two…

Optimization and Control · Mathematics 2013-12-19 J. C. Jimenez

We develop a diffusion approximation for systems subject to fast random resetting by small amplitudes. Equivalently, this describes systems with frequent but small catastrophes. We demonstrate the validity of the approximation by computing…

Statistical Mechanics · Physics 2026-02-26 Tobias Galla

We consider a generalization of the discrete-time Self Healing Umbrella Sampling method, which is an adaptive importance technique useful to sample multimodal target distributions. The importance function is based on the weights (namely the…

Probability · Mathematics 2017-09-04 Gersende Fort , Benjamin Jourdain , Tony Lelièvre , Gabriel Stoltz

Guided diffusion sampling relies on approximating often intractable likelihood scores, which introduces significant noise into the sampling dynamics. We propose using adaptive moment estimation to stabilize these noisy likelihood scores…

Machine Learning · Computer Science 2026-04-24 Christian Belardi , Justin Lovelace , Kilian Q. Weinberger , Carla P. Gomes

We prove convergence of the proximal policy gradient method for a class of constrained stochastic control problems with control in both the drift and diffusion of the state process. The problem requires either the running or terminal cost…

Optimization and Control · Mathematics 2025-05-27 Ashley Davey , Harry Zheng

We shall establish the convergence of an adaptive conforming finite element method for the reconstruction of the distributed flux in a diffusion system. The adaptive method is based on a posteriori error estimators for the distributed flux,…

Numerical Analysis · Mathematics 2013-09-10 Yifeng Xu , Jun Zou

Diffusion Models are probabilistic models that create realistic samples by simulating the diffusion process, gradually adding and removing noise from data. These models have gained popularity in domains such as image processing, speech…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Md Manjurul Ahsan , Shivakumar Raman , Yingtao Liu , Zahed Siddique

Due to their conjugate posteriors, Gaussian process priors are attractive for estimating the drift of stochastic differential equations with continuous time observations. However, their performance strongly depends on the choice of the…

Statistics Theory · Mathematics 2020-02-04 Jan van Waaij

With a view to statistical inference for discretely observed diffusion models, we propose simple methods of simulating diffusion bridges, approximately and exactly. Diffusion bridge simulation plays a fundamental role in likelihood and…

Statistics Theory · Mathematics 2014-03-10 Mogens Bladt , Michael Sørensen

Generative modeling within constrained sets is essential for scientific and engineering applications involving physical, geometric, or safety requirements (e.g., molecular generation, robotics). We present a unified framework for…

Machine Learning · Computer Science 2026-04-21 Kijung Jeon , Michael Muehlebach , Molei Tao

We introduce adaptive sampling methods for stochastic programs with deterministic constraints. First, we propose and analyze a variant of the stochastic projected gradient method where the sample size used to approximate the reduced…

Optimization and Control · Mathematics 2023-02-07 Florian Beiser , Brendan Keith , Simon Urbainczyk , Barbara Wohlmuth