中文
相关论文

相关论文: One-Step Generative Modeling via Wasserstein Gradi…

200 篇论文

Wasserstein Gradient Flows (WGF) with respect to specific functionals have been widely used in the machine learning literature. Recently, neural networks have been adopted to approximate certain intractable parts of the underlying…

机器学习 · 计算机科学 2024-01-26 Huminhao Zhu , Fangyikang Wang , Chao Zhang , Hanbin Zhao , Hui Qian

We develop a unified theoretical framework for data-free one-step sampling from unnormalized target distributions based on Wasserstein gradient flows. For a broad class of standard f-divergence objectives, we show that the induced velocity…

机器学习 · 计算机科学 2026-05-19 Chenguang Wang , Tianshu Yu

Generative modeling typically concerns transporting a single source distribution to a target distribution via simple probability flows. However, in fields like computer graphics and single-cell genomics, samples themselves can be viewed as…

机器学习 · 计算机科学 2025-05-20 Doron Haviv , Aram-Alexandre Pooladian , Dana Pe'er , Brandon Amos

We propose a principled and effective framework for one-step generative modeling. We introduce the notion of average velocity to characterize flow fields, in contrast to instantaneous velocity modeled by Flow Matching methods. A…

机器学习 · 计算机科学 2025-05-20 Zhengyang Geng , Mingyang Deng , Xingjian Bai , J. Zico Kolter , Kaiming He

Diffusion models and flow-matching models have enabled generating diverse and realistic images by learning to transfer noise to data. However, sampling from these models involves iterative denoising over many neural network passes, making…

机器学习 · 计算机科学 2025-06-24 Kevin Frans , Danijar Hafner , Sergey Levine , Pieter Abbeel

Recent advances in large multi-modal generative models have demonstrated impressive capabilities in multi-modal generation, including image and video generation. These models are typically built upon multi-step frameworks like diffusion and…

计算机视觉与模式识别 · 计算机科学 2026-01-29 Zhenglin Cheng , Peng Sun , Jianguo Li , Tao Lin

Diffusion models are commonly interpreted as learning the score function, i.e., the gradient of the log-density of noisy data. However, this assumption implies that the target of learning is a conservative vector field, which is not…

机器学习 · 计算机科学 2025-09-03 An B. Vuong , Michael T. McCann , Javier E. Santos , Yen Ting Lin

The conventional understanding of adversarial training in generative adversarial networks (GANs) is that the discriminator is trained to estimate a divergence, and the generator learns to minimize this divergence. We argue that despite the…

机器学习 · 统计学 2023-08-09 Mingxuan Yi , Zhanxing Zhu , Song Liu

Wasserstein Gradient Flow (WGF) describes the gradient dynamics of probability density within the Wasserstein space. WGF provides a promising approach for conducting optimization over the probability distributions. Numerically approximating…

机器学习 · 计算机科学 2024-06-04 Jaemoo Choi , Jaewoong Choi , Myungjoo Kang

Diffusion models generate high-quality images but require dozens of forward passes. We introduce Distribution Matching Distillation (DMD), a procedure to transform a diffusion model into a one-step image generator with minimal impact on…

计算机视觉与模式识别 · 计算机科学 2024-10-08 Tianwei Yin , Michaël Gharbi , Richard Zhang , Eli Shechtman , Fredo Durand , William T. Freeman , Taesung Park

Wasserstein gradient flows (WGFs) describe the evolution of probability distributions in Wasserstein space as steepest descent dynamics for a free energy functional. Computing the full path from an arbitrary initial distribution to…

机器学习 · 计算机科学 2026-04-14 Chengyu Liu , Xiang Zhou

Diffusion distillation is a widely used technique to reduce the sampling cost of diffusion models, yet it often requires extensive training, and the student performance tends to be degraded. Recent studies show that incorporating a GAN…

机器学习 · 计算机科学 2025-06-12 Bowen Zheng , Tianming Yang

Generative modeling can be formulated as learning a mapping f such that its pushforward distribution matches the data distribution. The pushforward behavior can be carried out iteratively at inference time, for example in diffusion and…

机器学习 · 计算机科学 2026-02-09 Mingyang Deng , He Li , Tianhong Li , Yilun Du , Kaiming He

Many applications in machine learning involve data represented as probability distributions. The emergence of such data requires radically novel techniques to design tractable gradient flows on probability distributions over this type of…

机器学习 · 计算机科学 2025-06-10 Clément Bonet , Christophe Vauthier , Anna Korba

Recently, Deng et al. (2026) proposed Generative Modeling via Drifting (GMD), a novel framework for generative tasks. This note presents an analysis of GMD through the lens of Wasserstein Gradient Flows (WGF), i.e., the path of steepest…

Flow matching has recently emerged as a promising alternative to diffusion-based generative models, offering faster sampling and simpler training by learning continuous flows governed by ordinary differential equations. Despite growing…

机器学习 · 计算机科学 2025-12-02 Mudit Gaur , Prashant Trivedi , Shuchin Aeron , Amrit Singh Bedi , George K. Atia , Vaneet Aggarwal

Reconstructing dynamical evolution from limited observations is a fundamental challenge in single-cell biology, where dynamic unbalanced optimal transport provides a principled framework for modeling coupled transport and mass variation.…

机器学习 · 计算机科学 2026-01-29 Xinyu Wang , Ruoyu Wang , Qiangwei Peng , Peijie Zhou , Tiejun Li

We propose the characteristic generator, a novel one-step generative model that combines the efficiency of sampling in Generative Adversarial Networks (GANs) with the stable performance of flow-based models. Our model is driven by…

机器学习 · 计算机科学 2025-12-29 Zhao Ding , Chenguang Duan , Yuling Jiao , Ruoxuan Li , Jerry Zhijian Yang , Pingwen Zhang

The multi-step denoising process in diffusion and Flow Matching models causes major efficiency issues, which motivates research on few-step generation. We present Solution Flow Models (SoFlow), a framework for one-step generation from…

机器学习 · 计算机科学 2026-03-03 Tianze Luo , Haotian Yuan , Zhuang Liu

Flow Matching has become a cornerstone of modern generative models like Stable Diffusion 3, largely due to the efficiency of its Rectified Flow (RF) variant. The success of RF hinges on iteratively learning straight trajectories, pushing…

机器学习 · 计算机科学 2026-05-19 Vansh Bansal , Saptarshi Roy , Purnamrita Sarkar , Alessandro Rinaldo
‹ 上一页 1 2 3 10 下一页 ›