English
Related papers

Related papers: Weak Generative Sampler to Efficiently Sample Inva…

200 papers

The goal of diffusion generative models is to align the learned distribution with the real data distribution through gradient score matching. However, inherent limitations in training data quality, modeling strategies, and architectural…

Machine Learning · Computer Science 2025-04-25 Lichen Bai , Masashi Sugiyama , Zeke Xie

We study Fokker--Planck equations with symmetric, positive definite mobility matrices capturing diffusion in heterogeneous environments. A weighted Wasserstein metric is introduced for which these equations are gradient flows. This metric…

Optimization and Control · Mathematics 2025-05-19 Hailiang Liu , Athanasios E. Tzavaras

We study the long-time dynamics of two-dimensional linear Fokker-Planck equations driven by a drift that can be decomposed in the sum of a large shear component and the gradient of a regular potential depending on one spatial variable. The…

Analysis of PDEs · Mathematics 2020-08-28 Michele Coti Zelati , Grigorios A. Pavliotis

Any explicit functional representation $f$ of a density is hampered by two main obstacles when we wish to use it as a generative model: designing $f$ so that sampling is fast, and estimating $Z = \int f$ so that $Z^{-1}f$ integrates to 1.…

Machine Learning · Computer Science 2022-06-23 Henry Li , Yuval Kluger

Peak counts have been shown to be an excellent tool to extract the non-Gaussian part of the weak lensing signal. Recently, we developped a fast stochastic forward model to predict weak-lensing peak counts. Our model is able to reconstruct…

Cosmology and Nongalactic Astrophysics · Physics 2015-11-16 Chieh-An Lin , Martin Kilbinger

We construct weak solutions to a class of distribution dependent SDE, of type $dX(t)=b\left( X(t), \displaystyle\frac{d\mathcal{L}_{X(t)}}{dx}(X(t))\right) dt+\sigma\left( X(t),\displaystyle\frac{d\mathcal{L}_{X(t)}}{dt}(X(t))\right) dW(t)$…

Probability · Mathematics 2019-08-23 Viorel Barbu , Michael Röckner

Diffusion models suffer from slow sample generation at inference time. Despite recent efforts, improving the sampling efficiency of stochastic samplers for diffusion models remains a promising direction. We propose Splitting Integrators for…

Machine Learning · Computer Science 2024-02-14 Kushagra Pandey , Maja Rudolph , Stephan Mandt

It is well-known that the posterior density of linear inverse problems with Gaussian prior and Gaussian likelihood is also Gaussian, hence completely described by its covariance and expectation. Sampling from a Gaussian posterior may be…

Numerical Analysis · Mathematics 2025-02-11 Daniela Calvetti , Erkki Somersalo

Diffusion models can generate a variety of high-quality images by modeling complex data distributions. Trained diffusion models can also be very effective image priors for solving inverse problems. Most of the existing diffusion-based…

Image and Video Processing · Electrical Eng. & Systems 2025-09-01 Nebiyou Yismaw , Ulugbek S. Kamilov , M. Salman Asif

We investigate well-posedness for martingale solutions of stochastic differential equations, under low regularity assumptions on their coefficients, widely extending some results first obtained by A. Figalli. Our main results are a very…

Probability · Mathematics 2015-08-26 Dario Trevisan

We present a novel simulation-free framework for training continuous-time diffusion processes over very general objective functions. Existing methods typically involve either prescribing the optimal diffusion process -- which only works for…

Machine Learning · Computer Science 2025-06-24 Mengjian Hua , Eric Vanden-Eijnden , Ricky T. Q. Chen

Deep generative models provide a systematic way to learn nonlinear data distributions, through a set of latent variables and a nonlinear "generator" function that maps latent points into the input space. The nonlinearity of the generator…

Machine Learning · Statistics 2021-12-14 Georgios Arvanitidis , Lars Kai Hansen , Søren Hauberg

Drawing from the theory of stochastic differential equations, we introduce a novel sampling method for known distributions and a new algorithm for diffusion generative models with unknown distributions. Our approach is inspired by the…

Statistics Theory · Mathematics 2024-07-12 Xicheng Zhang

Motivated by recent work on approximation of diffusion equations by deterministic interacting particle systems, we develop a nonlocal approximation for a range of linear and nonlinear diffusion equations and prove convergence of the method…

Analysis of PDEs · Mathematics 2024-04-05 Katy Craig , Matt Jacobs , Olga Turanova

In this paper we study simulation-based methods for estimating gradients in stochastic networks. We derive a new method of calculating weak derivative estimator using importance sampling transform, and our method has less computational cost…

Methodology · Statistics 2023-03-28 Cheng Jie , Michael C Fu

Diffusion models have emerged as a powerful framework for generative tasks in deep learning. They decompose generative modeling into two computational primitives: deterministic neural-network evaluation and stochastic sampling. Current…

Machine Learning · Computer Science 2026-03-31 Nihal Sanjay Singh , Mazdak Mohseni-Rajaee , Shaila Niazi , Kerem Y. Camsari

Imbalanced datasets widely exist in practice and area great challenge for training deep neural models with agood generalization on infrequent classes. In this work, wepropose a new rare-class sample generator (RSG) to solvethis problem. RSG…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Jianfeng Wang , Thomas Lukasiewicz , Xiaolin Hu , Jianfei Cai , Zhenghua Xu

We propose a model based on coupled multiplicative stochastic processes to understand the dynamics of competing species in an ecosystem. This process can be conveniently described by a Fokker-Planck equation. We provide an analytical…

Populations and Evolution · Quantitative Biology 2012-03-13 Simone Pigolotti , Alessandro Flammini , Amos Maritan

Sampling-based algorithms are classical approaches to perform Bayesian inference in inverse problems. They provide estimators with the associated credibility intervals to quantify the uncertainty on the estimators. Although these methods…

Methodology · Statistics 2023-11-28 Pierre-Antoine Thouvenin , Audrey Repetti , Pierre Chainais

Wasserstein gradient flows provide a powerful means of understanding and solving many diffusion equations. Specifically, Fokker-Planck equations, which model the diffusion of probability measures, can be understood as gradient descent over…

Machine Learning · Computer Science 2021-10-26 Petr Mokrov , Alexander Korotin , Lingxiao Li , Aude Genevay , Justin Solomon , Evgeny Burnaev