English
Related papers

Related papers: Generative Modeling by Minimizing the Wasserstein-…

200 papers

In this work, we propose a novel layerwise adaptive construction method for neural network architectures. Our approach is based on a goal--oriented dual-weighted residual technique for the optimal control of neural differential equations.…

Optimization and Control · Mathematics 2026-01-13 Michael Hintermüller , Michael Hinze , Denis Korolev

Flow matching has recently emerged as a promising alternative to diffusion-based generative models, offering faster sampling and simpler training by learning continuous flows governed by ordinary differential equations. Despite growing…

Machine Learning · Computer Science 2025-12-02 Mudit Gaur , Prashant Trivedi , Shuchin Aeron , Amrit Singh Bedi , George K. Atia , Vaneet Aggarwal

In this work, we propose a numerical method to compute the Wasserstein Hamiltonian flow (WHF), which is a Hamiltonian system on the probability density manifold. Many well-known PDE systems can be reformulated as WHFs. We use parameterized…

Numerical Analysis · Mathematics 2023-07-18 Hao Wu , Shu Liu , Xiaojing Ye , Haomin Zhou

Safeguarding privacy in sensitive training data is paramount, particularly in the context of generative modeling. This can be achieved through either differentially private stochastic gradient descent or a differentially private metric for…

Optimal experimental design (OED) aims to choose the observations in an experiment to be as informative as possible, according to certain statistical criteria. In the linear case (when the observations depend linearly on the unknown…

Numerical Analysis · Mathematics 2026-02-25 Ruhui Jin , Martin Guerra , Qin Li , Stephen Wright

Learning under a Wasserstein loss, a.k.a. Wasserstein loss minimization (WLM), is an emerging research topic for gaining insights from a large set of structured objects. Despite being conceptually simple, WLM problems are computationally…

Computation · Statistics 2017-06-07 Jianbo Ye , James Z. Wang , Jia Li

We propose a mathematically principled PDE gradient flow framework for distributionally robust optimization (DRO). Exploiting the recent advances in the intersection of Markov Chain Monte Carlo sampling and gradient flow theory, we show…

Optimization and Control · Mathematics 2026-05-27 Zusen Xu , Jia-Jie Zhu

The default Gaussian latent in flow-based generative models poses challenges when learning certain distributions such as heavy-tailed ones. We introduce a general framework for learning data-adaptive latent distributions using…

Machine Learning · Statistics 2026-02-11 Jannis Chemseddine , Gregor Kornhardt , Richard Duong , Gabriele Steidl

We propose a stable method to train Wasserstein generative adversarial networks. In order to enhance stability, we consider two objective functions using the $c$-transform based on Kantorovich duality which arises in the theory of optimal…

Machine Learning · Computer Science 2021-10-28 Dohyun Kwon , Yeoneung Kim , Guido Montúfar , Insoon Yang

Score-based generative models are a popular class of generative modelling techniques relying on stochastic differential equations (SDE). From their inception, it was realized that it was also possible to perform generation using ordinary…

Machine Learning · Statistics 2024-02-13 Joe Benton , George Deligiannidis , Arnaud Doucet

In this paper, we propose a novel numerical scheme to optimize the gradient flows for learning energy-based models (EBMs). From a perspective of physical simulation, we redefine the problem of approximating the gradient flow utilizing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Yang Wu , Pengxu Wei , Liang Lin

Although generative diffusion models (GDMs) are widely used in practice, their theoretical foundations remain limited, especially concerning the impact of different discretization schemes applied to the underlying stochastic differential…

Numerical Analysis · Mathematics 2026-01-27 Emanuel Pfarr , Radu Timofte , Frank Werner

We propose the Wasserstein Auto-Encoder (WAE)---a new algorithm for building a generative model of the data distribution. WAE minimizes a penalized form of the Wasserstein distance between the model distribution and the target distribution,…

Machine Learning · Statistics 2019-12-06 Ilya Tolstikhin , Olivier Bousquet , Sylvain Gelly , Bernhard Schoelkopf

We address the optimization problem of simultaneously minimizing multiple objective functionals over a family of probability distributions. This type of Multi-Objective Distributional Optimization commonly arises in machine learning and…

Machine Learning · Computer Science 2025-05-27 Dai Hai Nguyen , Hiroshi Mamitsuka , Atsuyoshi Nakamura

Recently, Deng et al. (2026) proposed Generative Modeling via Drifting (GMD), a novel framework for generative tasks. This note presents an analysis of GMD through the lens of Wasserstein Gradient Flows (WGF), i.e., the path of steepest…

Machine Learning · Computer Science 2026-05-22 Arthur Gretton , Li Kevin Wenliang , Alexandre Galashov , James Thornton , Valentin De Bortoli , Arnaud Doucet

Score-based Generative Models (SGMs) aim to sample from a target distribution by learning score functions using samples perturbed by Gaussian noise. Existing convergence bounds for SGMs in the W2-distance rely on stringent assumptions about…

Machine Learning · Statistics 2025-12-12 Marta Gentiloni-Silveri , Antonio Ocello

We present Ordinary Differential Equation Variational Auto-Encoder (ODE$^2$VAE), a latent second order ODE model for high-dimensional sequential data. Leveraging the advances in deep generative models, ODE$^2$VAE can simultaneously learn…

Machine Learning · Statistics 2019-10-25 Çağatay Yıldız , Markus Heinonen , Harri Lähdesmäki

Optimal transport is a foundational problem in optimization, that allows to compare probability distributions while taking into account geometric aspects. Its optimal objective value, the Wasserstein distance, provides an important loss…

Machine Learning · Computer Science 2020-02-21 Marin Ballu , Quentin Berthet , Francis Bach

In recent years, the machine learning community has increasingly embraced the optimal transport (OT) framework for modeling distributional relationships. In this work, we introduce a sample-based neural solver for computing the Wasserstein…

Machine Learning · Computer Science 2026-02-26 Hailiang Liu , Yan-Han Chen

Computing pairwise Wasserstein distances is a fundamental bottleneck in data analysis pipelines. Motivated by the classical Kuratowski embedding theorem, we propose two neural architectures for learning to approximate the Wasserstein-2…

Machine Learning · Computer Science 2026-04-07 Andrew Qing He