中文
相关论文

相关论文: Gradient Flow Drifting: Generative Modeling via Wa…

200 篇论文

Recently, Deng et al. (2026) proposed Generative Modeling via Drifting (GMD), a novel framework for generative tasks. This note presents an analysis of GMD through the lens of Wasserstein Gradient Flows (WGF), i.e., the path of steepest…

Flow-based generative models enjoy certain advantages in computing the data generation and the likelihood, and have recently shown competitive empirical performance. Compared to the accumulating theoretical studies on related score-based…

机器学习 · 统计学 2025-06-30 Xiuyuan Cheng , Jianfeng Lu , Yixin Tan , Yao Xie

The purpose of this paper is to answer a few open questions in the interface of kernel methods and PDE gradient flows. Motivated by recent advances in machine learning, particularly in generative modeling and sampling, we present a rigorous…

机器学习 · 统计学 2024-10-29 Jia-Jie Zhu , Alexander Mielke

We study the Wasserstein gradient flow of semi-discrete energies in the space of probability measures, that is functionals depending on two measures-one being an absolutely continuous density and the other an atomic measure. These energies…

偏微分方程分析 · 数学 2026-03-05 Joao Miguel Machado

We study the quantitative convergence of Wasserstein gradient flows of Kernel Mean Discrepancy (KMD) (also known as Maximum Mean Discrepancy (MMD)) functionals. Our setting covers in particular the training dynamics of shallow neural…

偏微分方程分析 · 数学 2026-03-03 Lénaïc Chizat , Maria Colombo , Roberto Colombo , Xavier Fernández-Real

We propose a gradient flow procedure for generative modeling by transporting particles from an initial source distribution to a target distribution, where the gradient field on the particles is given by a noise-adaptive Wasserstein Gradient…

机器学习 · 计算机科学 2024-05-14 Alexandre Galashov , Valentin de Bortoli , Arthur Gretton

Wasserstein gradient flows of maximum mean discrepancy (MMD) functionals with non-smooth Riesz kernels show a rich structure as singular measures can become absolutely continuous ones and conversely. In this paper we contribute to the…

机器学习 · 计算机科学 2024-03-22 Fabian Altekrüger , Johannes Hertrich , Gabriele Steidl

Flow Matching has recently gained attention in generative modeling as a simple and flexible alternative to diffusion models. While existing statistical guarantees adapt tools from the analysis of diffusion models, we take a different…

机器学习 · 统计学 2026-03-18 Lea Kunkel , Mathias Trabs

Generative modeling typically concerns transporting a single source distribution to a target distribution via simple probability flows. However, in fields like computer graphics and single-cell genomics, samples themselves can be viewed as…

机器学习 · 计算机科学 2025-05-20 Doron Haviv , Aram-Alexandre Pooladian , Dana Pe'er , Brandon Amos

Generative Modeling via Drifting has recently achieved state-of-the-art one-step image generation through a kernel-based drift operator, yet the success is largely empirical and its theoretical foundations remain poorly understood. In this…

机器学习 · 计算机科学 2026-03-11 Erkan Turan , Maks Ovsjanikov

We propose kernel-gradient drifting, a one-step generative modeling framework that replaces the fixed Euclidean displacement direction in drifting models with directions induced by the kernel itself. Standard drifting is attractive because…

Diffusion models and flow-based methods have shown impressive generative capability, especially for images, but their sampling is expensive because it requires many iterative updates. We introduce W-Flow, a framework for training a…

机器学习 · 计算机科学 2026-05-28 Jiaqi Han , Puheng Li , Qiushan Guo , Renyuan Xu , Stefano Ermon , Emmanuel J. Candès

We propose Drifting Field Policy (DFP), a non-ODE one-step generative policy built on the drifting model paradigm. We frame the policy update as a reverse-KL Wasserstein-2 gradient flow toward a soft target policy, so that each DFP update…

机器学习 · 计算机科学 2026-05-11 Juil Koo , Mingue Park , Jiwon Choi , Yunhong Min , Minhyuk Sung

Flow matching has recently emerged as a promising alternative to diffusion-based generative models, offering faster sampling and simpler training by learning continuous flows governed by ordinary differential equations. Despite growing…

机器学习 · 计算机科学 2025-12-02 Mudit Gaur , Prashant Trivedi , Shuchin Aeron , Amrit Singh Bedi , George K. Atia , Vaneet Aggarwal

Diffusion-based generative models have emerged as highly effective methods for synthesizing high-quality samples. Recent works have focused on analyzing the convergence of their generation process with minimal assumptions, either through…

机器学习 · 统计学 2025-08-25 Nishant Jain , Tong Zhang

Vision-Language Latent Diffusion Models (LDMs) (Rombach et al., 2022) provide powerful generative priors for inverse problems. However, existing LDM-based inverse solvers typically require a large number of neural function evaluations…

机器学习 · 统计学 2026-05-11 Alessio Spagnoletti , Tim Y. J. Wang , Marcelo Pereyra , O. Deniz Akyildiz

In this paper, we propose a novel numerical scheme to optimize the gradient flows for learning energy-based models (EBMs). From a perspective of physical simulation, we redefine the problem of approximating the gradient flow utilizing…

计算机视觉与模式识别 · 计算机科学 2023-05-01 Yang Wu , Pengxu Wei , Liang Lin

We introduce a (de)-regularization of the Maximum Mean Discrepancy (DrMMD) and its Wasserstein gradient flow. Existing gradient flows that transport samples from source distribution to target distribution with only target samples, either…

Generative AI (GenAI) has revolutionized data-driven modeling by enabling the synthesis of high-dimensional data across various applications, including image generation, language modeling, biomedical signal processing, and anomaly…

机器学习 · 计算机科学 2025-09-09 Yao Xie , Xiuyuan Cheng

Variational inference is a technique that approximates a target distribution by optimizing within the parameter space of variational families. On the other hand, Wasserstein gradient flows describe optimization within the space of…

机器学习 · 统计学 2023-11-01 Mingxuan Yi , Song Liu
‹ 上一页 1 2 3 10 下一页 ›