English
Related papers

Related papers: Deep JKO: time-implicit particle methods for gener…

200 papers

The Bayesian update step poses significant computational challenges in high-dimensional nonlinear estimation. While log-homotopy particle flow filters offer an alternative to stochastic sampling, existing formulations usually yield stiff…

Machine Learning · Computer Science 2026-05-14 Domonkos Csuzdi , Tamás Bécsi , Olivér Törő

We introduce a class of high order accurate, semi-implicit Runge-Kutta schemes in the general setting of evolution equations that arise as gradient flow for a cost function, possibly with respect to an inner product that depends on the…

Numerical Analysis · Mathematics 2021-10-04 Alexander Zaitzeff , Selim Esedoglu , Krishna Garikipati

We develop a spacetime neural network method with second order optimization for solving quantum dynamics from the high dimensional Schr\"{o}dinger equation. In contrast to the standard iterative first order optimization and the…

Disordered Systems and Neural Networks · Physics 2021-08-05 Jiangran Wang , Zhuo Chen , Di Luo , Zhizhen Zhao , Vera Mikyoung Hur , Bryan K. Clark

Nonlinear time-dependent partial differential equations are essential in modeling complex phenomena across diverse fields, yet they pose significant challenges due to their computational complexity, especially in higher dimensions. This…

Machine Learning · Computer Science 2025-02-20 Yuan Chen , Abdul Khaliq , Khaled M. Furati

Recently, Deng et al. (2026) proposed Generative Modeling via Drifting (GMD), a novel framework for generative tasks. This note presents an analysis of GMD through the lens of Wasserstein Gradient Flows (WGF), i.e., the path of steepest…

Machine Learning · Computer Science 2026-05-22 Arthur Gretton , Li Kevin Wenliang , Alexandre Galashov , James Thornton , Valentin De Bortoli , Arnaud Doucet

Particle-based variational inference offers a flexible way of approximating complex posterior distributions with a set of particles. In this paper we introduce a new particle-based variational inference method based on the theory of…

Machine Learning · Statistics 2019-05-16 Luca Ambrogioni , Umut Guclu , Marcel van Gerven

Classical neural ordinary differential equations (ODEs) are powerful tools for approximating the log-density functions in high-dimensional spaces along trajectories, where neural networks parameterize the velocity fields. This paper…

Optimization and Control · Mathematics 2025-01-30 Mo Zhou , Stanley Osher , Wuchen Li

Sampling a target probability distribution with an unknown normalization constant is a fundamental challenge in computational science and engineering. Recent work shows that algorithms derived by considering gradient flows in the space of…

Machine Learning · Statistics 2024-03-12 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M Stuart

We study the large deviation rate functional for the empirical distribution of independent Brownian particles with drift. In one dimension, it has been shown by Adams, Dirr, Peletier and Zimmer that this functional is asymptotically…

Probability · Mathematics 2016-01-11 Matthias Erbar , Jan Maas , Michiel Renger

This work is the third part of a program initiated in arXiv:2111.13258, arXiv:2302.06571 aiming at the development of an intrinsic geometric well-posedness theory for Hamilton-Jacobi equations related to controlled gradient flow problems in…

Analysis of PDEs · Mathematics 2024-02-02 Giovanni Conforti , Richard C. Kraaij , Luca Tamanini , Daniela Tonon

In this paper we provide novel closed-form expressions enabling differentiation of any scalar function of the Kalman filter's outputs with respect to all its tuning parameters and to the measurements. The approach differs from the previous…

Optimization and Control · Mathematics 2023-04-03 Colin Parellier , Axel Barrau , Silvere Bonnabel

Model reduction for fluid flow simulation continues to be of great interest across a number of scientific and engineering fields. In a previous work [arXiv:2104.13962], we explored the use of Neural Ordinary Differential Equations (NODE) as…

Machine Learning · Computer Science 2021-07-07 Sourav Dutta , Peter Rivera-Casillas , Orie M. Cecil , Matthew W. Farthing , Emma Perracchione , Mario Putti

Gaussian mixture models form a flexible and expressive parametric family of distributions that has found applications in a wide variety of applications. Unfortunately, fitting these models to data is a notoriously hard problem from a…

Statistics Theory · Mathematics 2023-01-05 Yuling Yan , Kaizheng Wang , Philippe Rigollet

In this work, we investigate links between the formulation of the flow of marginals of reversible diffusion processes as gradient flows in the space of probability measures and path wise large deviation principles for sequences of such…

Probability · Mathematics 2014-05-16 Max Fathi

Accurately predicting turbulent flows remains a central challenge in fluid dynamics due to their high dimensionality and intrinsic nonlinearity. Recent developments in quantum algorithms and machine learning offer new opportunities for…

Fluid Dynamics · Physics 2025-11-25 Han Li , Yutong Lou , Dunhui Xiao

We introduce a novel unit-time ordinary differential equation (ODE) flow called the preconditioned F\"{o}llmer flow, which efficiently transforms a Gaussian measure into a desired target measure at time 1. To discretize the flow, we apply…

Methodology · Statistics 2023-11-08 Zhao Ding , Yuling Jiao , Xiliang Lu , Zhijian Yang , Cheng Yuan

The autoencoder model typically uses an encoder to map data to a lower dimensional latent space and a decoder to reconstruct it. However, relying on an encoder for inversion can lead to suboptimal representations, particularly limiting in…

Machine Learning · Statistics 2025-01-07 Kyriakos Flouris , Anna Volokitin , Gustav Bredell , Ender Konukoglu

Derivative-free Riemannian optimization (DFRO) aims to minimize an objective function using only function evaluations, under the constraint that the decision variables lie on a Riemannian manifold. The rapid increase in problem dimensions…

Optimization and Control · Mathematics 2026-01-14 Timothé Taminiau , Estelle Massart , Geovani Nunes Grapiglia

Various machine learning tasks, from generative modeling to domain adaptation, revolve around the concept of dataset transformation and manipulation. While various methods exist for transforming unlabeled datasets, principled methods to do…

Machine Learning · Computer Science 2021-06-17 David Alvarez-Melis , Nicolò Fusi

The purpose of this paper is to answer a few open questions in the interface of kernel methods and PDE gradient flows. Motivated by recent advances in machine learning, particularly in generative modeling and sampling, we present a rigorous…

Machine Learning · Statistics 2024-10-29 Jia-Jie Zhu , Alexander Mielke