English
Related papers

Related papers: Hamiltonian Score Matching and Generative Flows

200 papers

We propose Pullback Flow Matching (PFM), a novel framework for generative modeling on data manifolds. Unlike existing methods that assume or learn restrictive closed-form manifold mappings for training Riemannian Flow Matching (RFM) models,…

Machine Learning · Computer Science 2025-07-10 Friso de Kruiff , Erik Bekkers , Ozan Öktem , Carola-Bibiane Schönlieb , Willem Diepeveen

Recently, there has been an increasing interest in modelling and computation of physical systems with neural networks. Hamiltonian systems are an elegant and compact formalism in classical mechanics, where the dynamics is fully determined…

Numerical Analysis · Mathematics 2022-06-28 Elena Celledoni , Andrea Leone , Davide Murari , Brynjulf Owren

While denoising diffusion and flow matching have driven major advances in generative modeling, their application to tabular data remains limited, despite its ubiquity in real-world applications. To this end, we develop TabbyFlow, a…

Machine Learning · Computer Science 2025-10-06 Andrés Guzmán-Cordero , Floor Eijkelboom , Jan-Willem van de Meent

Discrete-time diffusion-based generative models and score matching methods have shown promising results in modeling high-dimensional image data. Recently, Song et al. (2021) show that diffusion processes that transform data into noise can…

Machine Learning · Computer Science 2021-10-01 Chin-Wei Huang , Jae Hyun Lim , Aaron Courville

In this work, we investigated the application of score-based gradient learning in discriminative and generative classification settings. Score function can be used to characterize data distribution as an alternative to density. It can be…

Machine Learning · Computer Science 2022-07-25 Yongchao Huang

Hamiltonian Monte Carlo (HMC) is a Markov chain algorithm for sampling from a high-dimensional distribution with density $e^{-f(x)}$, given access to the gradient of $f$. A particular case of interest is that of a $d$-dimensional Gaussian…

Machine Learning · Statistics 2022-09-27 Simon Apers , Sander Gribling , Dániel Szilágyi

This paper introduces Higher Gauge Flow Models, a novel class of Generative Flow Models. Building upon ordinary Gauge Flow Models (arXiv:2507.13414), these Higher Gauge Flow Models leverage an L$_{\infty}$-algebra, effectively extending the…

Artificial Intelligence · Computer Science 2026-03-04 Alexander Strunk , Roland Assam

Recent work has explored a range of model families for human motion generation, including Variational Autoencoders (VAEs), Generative Adversarial Networks (GANs), and diffusion-based models. Despite their differences, many methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 David Björkstrand , Tiesheng Wang , Lars Bretzner , Josephine Sullivan

Efficiently analyzing maps from upcoming large-scale surveys requires gaining direct access to a high-dimensional likelihood and generating large-scale fields with high fidelity, which both represent major challenges. Using CAMELS…

Cosmology and Nongalactic Astrophysics · Physics 2023-11-03 Sultan Hassan , Sambatra Andrianomena

We introduce the \emph{Symplectic Generative Network (SGN)}, a deep generative model that leverages Hamiltonian mechanics to construct an invertible, volume-preserving mapping between a latent space and the data space. By endowing the…

Machine Learning · Statistics 2025-10-30 Agnideep Aich , Ashit Aich

The partial Hamiltonian systems of the form $\dot q^i=\frac{\partial H}{\partial p_i}, \dot p^i=-\frac{\partial H}{\partial q_i}+\Gamma^i(t,q^i,p_i)$ arise widely in different fields of the applied mathematics. The partial Hamiltonian…

Dynamical Systems · Mathematics 2016-08-24 Rehana Naz

Score-based Generative Models (SGMs) aim to sample from a target distribution by learning score functions using samples perturbed by Gaussian noise. Existing convergence bounds for SGMs in the W2-distance rely on stringent assumptions about…

Machine Learning · Statistics 2025-12-12 Marta Gentiloni-Silveri , Antonio Ocello

Flow Matching (FM) is a simulation-free method for learning a continuous and invertible flow to interpolate between two distributions, and in particular to generate data from noise. Inspired by the variational nature of the diffusion…

Machine Learning · Statistics 2025-07-14 Chen Xu , Xiuyuan Cheng , Yao Xie

Deep generative models (DGM) are neural networks with many hidden layers trained to approximate complicated, high-dimensional probability distributions using a large number of samples. When trained successfully, we can use the DGMs to…

Machine Learning · Computer Science 2021-04-13 Lars Ruthotto , Eldad Haber

We present Functional Mean Flow (FMF) as a one-step generative model defined in infinite-dimensional Hilbert space. FMF extends the one-step Mean Flow framework to functional domains by providing a theoretical formulation for Functional…

Machine Learning · Computer Science 2025-11-18 Zhiqi Li , Yuchen Sun , Greg Turk , Bo Zhu

High-dimensional integration with respect to complex target measures remains a fundamental challenge in computational science. While Flow Matching (FM) offers a powerful paradigm for constructing continuous-time transport maps, its…

Numerical Analysis · Mathematics 2026-01-06 Zhijun Zeng , Jianlong Chen

In this work, we propose a numerical method to compute the Wasserstein Hamiltonian flow (WHF), which is a Hamiltonian system on the probability density manifold. Many well-known PDE systems can be reformulated as WHFs. We use parameterized…

Numerical Analysis · Mathematics 2023-07-18 Hao Wu , Shu Liu , Xiaojing Ye , Haomin Zhou

Score-based model research in the last few years has produced state of the art generative models by employing Gaussian denoising score-matching (DSM). However, the Gaussian noise assumption has several high-dimensional limitations,…

Machine Learning · Computer Science 2022-04-13 Jacob Deasy , Nikola Simidjievski , Pietro Liò

Model precision in a classification task is highly dependent on the feature space that is used to train the model. Moreover, whether the features are sequential or static will dictate which classification method can be applied as most of…

Machine Learning · Computer Science 2017-12-25 Anna Leontjeva , Ilya Kuzovkin

Training deep neural networks remains computationally intensive due to the itera2 tive nature of gradient-based optimization. We propose Gradient Flow Matching (GFM), a continuous-time modeling framework that treats neural network training…

Machine Learning · Computer Science 2025-05-27 Xiao Shou , Yanna Ding , Jianxi Gao