English
Related papers

Related papers: Fisher Flow Matching for Generative Modeling over …

200 papers

This paper presents a novel method for analyzing the latent space geometry of generative models, including statistical physics models and diffusion models, by reconstructing the Fisher information metric. The method approximates the…

Machine Learning · Computer Science 2025-06-13 Alexander Lobashev , Dmitry Guskov , Maria Larchenko , Mikhail Tamm

Standard diffusion models for graph generation typically rely on uniform time-stepping, an approach that overlooks the non-homogeneous dynamics of distributional evolution on complex manifolds. In this paper, we present an…

Machine Learning · Statistics 2026-05-04 Yuhui Lu , Wenjing Liu , Kun Zhan

Generative modeling typically concerns transporting a single source distribution to a target distribution via simple probability flows. However, in fields like computer graphics and single-cell genomics, samples themselves can be viewed as…

Machine Learning · Computer Science 2025-05-20 Doron Haviv , Aram-Alexandre Pooladian , Dana Pe'er , Brandon Amos

Building efficient and effective generative models for neural network weights has been a research focus of significant interest that faces challenges posed by the high-dimensional weight spaces of modern neural networks and their…

Machine Learning · Computer Science 2026-05-01 Saumya Gupta , Scott Biggs , Moritz Laber , Zohair Shafi , Robin Walters , Ayan Paul

Recent advances in generative modeling -- particularly diffusion models and flow matching -- have achieved remarkable success in synthesizing discrete data such as images and videos. However, adapting these models to physical applications…

Machine Learning · Computer Science 2025-11-26 Sifan Wang , Zehao Dou , Siming Shan , Tong-Rui Liu , Lu Lu

Among these, D-peptides are resistant to proteolysis, exhibit greater in vivo stability, and are easier to synthesize. Despite advances in deep learning for peptide discovery, the scarcity of natural D-protein data limits the transfer of…

Computational Engineering, Finance, and Science · Computer Science 2026-05-04 Fang Wu , Shuting Jin , Xiangru Tang , Junlin Xu , Mark Gerstein , James Zou

Protein sequence generation for engineering requires samples that are biophysically plausible and, when targeting a family/domain, remain recognizable members while exploring within-family diversity. Current discrete generative models…

Computational Engineering, Finance, and Science · Computer Science 2026-05-25 Langzhang Liang , Ming Yang , Yi Feng , Junfan Li , Shirui Pan , Yinghui Xu , Tianlei Ying , Yizhen Zheng , Zenglin Xu

Conventional diffusion models typically relies on a fixed forward process, which implicitly defines complex marginal distributions over latent variables. This can often complicate the reverse process' task in learning generative…

Machine Learning · Statistics 2025-06-10 Grigory Bartosh , Dmitry Vetrov , Christian A. Naesseth

Diffusion models approximate the denoising distribution as a Gaussian and predict its mean, whereas flow matching models reparameterize the Gaussian mean as flow velocity. However, they underperform in few-step sampling due to…

Machine Learning · Computer Science 2025-09-03 Hansheng Chen , Kai Zhang , Hao Tan , Zexiang Xu , Fujun Luan , Leonidas Guibas , Gordon Wetzstein , Sai Bi

Flow matching casts sample generation as learning a continuous-time velocity field that transports noise to data. Existing flow matching networks typically predict each point's velocity independently, considering only its location and time…

Machine Learning · Computer Science 2025-11-11 Md Shahriar Rahim Siddiqui , Moshe Eliasof , Eldad Haber

The flow size distribution is a useful metric for traffic modeling and management. Its estimation based on sampled data, however, is problematic. Previous work has shown that flow sampling (FS) offers enormous statistical benefits over…

Information Theory · Computer Science 2011-06-21 Paul Tune , Darryl Veitch

Flow matching has shown state-of-the-art performance in various generative tasks, ranging from image generation to decision-making, where generation under energy guidance (abbreviated as guidance in the following) is pivotal. However, the…

Machine Learning · Computer Science 2025-05-27 Ruiqi Feng , Chenglei Yu , Wenhao Deng , Peiyan Hu , Tailin Wu

We propose Riemannian Flow Matching (RFM), a simple yet powerful framework for training continuous normalizing flows on manifolds. Existing methods for generative modeling on manifolds either require expensive simulation, are inherently…

Machine Learning · Computer Science 2024-02-27 Ricky T. Q. Chen , Yaron Lipman

Flow matching has emerged as a powerful generative modeling approach with flexible choices of source distribution. While Gaussian distributions are commonly used, the potential for better alternatives in high-dimensional data generation…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Junho Lee , Kwanseok Kim , Joonseok Lee

Modeling complex fluid systems, especially turbulence governed by partial differential equations (PDEs), remains a fundamental challenge in science and engineering. Recently, diffusion-based generative models have gained attention as a…

Machine Learning · Computer Science 2025-06-03 Haixin Wang , Jiashu Pan , Hao Wu , Fan Zhang , Tailin Wu

Modern generative modeling methods have demonstrated strong performance in learning complex data distributions from clean samples. In many scientific and imaging applications, however, clean samples are unavailable, and only noisy or…

Machine Learning · Computer Science 2026-05-29 Willem Diepeveen , Oscar Leong

Generative models have emerged as a powerful paradigm for solving physics systems and modeling complex spatiotemporal dynamics. However, achieving high physical accuracy without incurring high computational cost remains a fundamental…

Machine Learning · Computer Science 2026-05-27 Jiahe Huang , Sihan Xu , Sharvaree Vadgama , Rose Yu

Flow-based models typically define a latent space with dimensionality identical to the observational space. In many problems, however, the data does not populate the full ambient data space that they natively reside in, rather inhabiting a…

Machine Learning · Statistics 2023-02-24 Mingtian Zhang , Yitong Sun , Chen Zhang , Steven McDonagh

Generative modeling can be formulated as learning a mapping f such that its pushforward distribution matches the data distribution. The pushforward behavior can be carried out iteratively at inference time, for example in diffusion and…

Machine Learning · Computer Science 2026-02-09 Mingyang Deng , He Li , Tianhong Li , Yilun Du , Kaiming He

Current discriminative depth estimation methods often produce blurry artifacts, while generative approaches suffer from slow sampling due to curvatures in the noise-to-depth transport. Our method addresses these challenges by framing depth…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Ming Gui , Johannes Schusterbauer , Ulrich Prestel , Pingchuan Ma , Dmytro Kotovenko , Olga Grebenkova , Stefan Andreas Baumann , Vincent Tao Hu , Björn Ommer