中文
相关论文

相关论文: Generative Drifting is Secretly Score Matching: a …

200 篇论文

We propose kernel-gradient drifting, a one-step generative modeling framework that replaces the fixed Euclidean displacement direction in drifting models with directions induced by the kernel itself. Standard drifting is attractive because…

Drifting models train one-step generators by optimizing a kernel-induced mean-shift discrepancy between the data and model distributions, with Laplace kernels used by default in practice. At each point, this discrepancy compares the…

We establish a theoretical link between the recently proposed "drifting" generative dynamics and gradient flows induced by the Sinkhorn divergence. In a particle discretization, the drift field admits a cross-minus-self decomposition: an…

机器学习 · 计算机科学 2026-03-30 Ping He , Om Khangaonkar , Hamed Pirsiavash , Yikun Bai , Soheil Kolouri

This paper studies the identifiability and stability of drifting fields within the framework of Generative Modeling via Drifting. The motivating question is whether a zero-drift equilibrium identifies the target distribution, and whether an…

机器学习 · 统计学 2026-05-13 HakGeun Lee , Hyonho Chun

Drifting models have recently gained attention for generating high-quality samples in a single forward pass. During training, they learn a push-forward map by following a vector-valued field, the drift field. We ask whether this procedure…

机器学习 · 计算机科学 2026-05-11 Leonard T. Franz , Sebastian Hoffmann , Tim Weiland , Bernhard Schölkopf , Georg Martius

We reveal a precise mathematical framework about a new family of generative models which we call Gradient Flow Drifting. With this framework, we prove an equivalence between the recently proposed Drifting Model and the Wasserstein gradient…

机器学习 · 计算机科学 2026-03-12 Jiarui Cao , Zixuan Wei , Yuxin Liu

Generative modeling can be formulated as learning a mapping f such that its pushforward distribution matches the data distribution. The pushforward behavior can be carried out iteratively at inference time, for example in diffusion and…

机器学习 · 计算机科学 2026-02-09 Mingyang Deng , He Li , Tianhong Li , Yilun Du , Kaiming He

Conditional medical image generation plays an important role in many clinically relevant imaging tasks. However, existing methods still face a fundamental challenge in balancing inference efficiency, patient-specific fidelity, and…

计算机视觉与模式识别 · 计算机科学 2026-04-22 Zirong Li , Siyuan Mei , Weiwen Wu , Andreas Maier , Lina Gölz , Yan Xia

Recently, Deng et al. (2026) proposed Generative Modeling via Drifting (GMD), a novel framework for generative tasks. This note presents an analysis of GMD through the lens of Wasserstein Gradient Flows (WGF), i.e., the path of steepest…

Drifting Models [Deng et al., 2026] train a one-step generator by evolving samples under a kernel-based drift field, avoiding ODE integration at inference. The original analysis leaves two questions open. The drift-field iteration admits a…

机器学习 · 计算机科学 2026-04-21 Arkadii Kazanskii , Tatiana Petrova , Konstantin Bagrianskii , Aleksandr Puzikov , Radu State

Imperfect score-matching leads to a shift between the training and the sampling distribution of diffusion models. Due to the recursive nature of the generation process, errors in previous steps yield sampling iterates that drift away from…

机器学习 · 计算机科学 2023-02-20 Giannis Daras , Yuval Dagan , Alexandros G. Dimakis , Constantinos Daskalakis

Learning to sample from complex unnormalized distributions is a fundamental challenge in computational physics and machine learning. While score-based and variational methods have achieved success in continuous domains, extending them to…

机器学习 · 统计学 2026-03-11 Lei Li , Zhen Wang , Lishuo Zhang

We propose a new score-based model with one-step sampling. Previously, score-based models were burdened with heavy computations due to iterative sampling. For substituting the iterative process, we train a standalone generator to compress…

计算机视觉与模式识别 · 计算机科学 2023-09-21 Senmao Ye , Fei Liu

Creating noise from data is easy; creating data from noise is generative modeling. We present a stochastic differential equation (SDE) that smoothly transforms a complex data distribution to a known prior distribution by slowly injecting…

机器学习 · 计算机科学 2021-02-11 Yang Song , Jascha Sohl-Dickstein , Diederik P. Kingma , Abhishek Kumar , Stefano Ermon , Ben Poole

Drifting Models have emerged as a new paradigm for one-step generative modeling, achieving strong image quality without iterative inference. The premise is to replace the iterative denoising process in diffusion models with a single…

机器学习 · 计算机科学 2026-05-13 Ali Falahati , Elliot Creager , Gautam Kamath , Shubhankar Mohapatra

Diffusion models are commonly interpreted as learning the score function, i.e., the gradient of the log-density of noisy data. However, this assumption implies that the target of learning is a conservative vector field, which is not…

机器学习 · 计算机科学 2025-09-03 An B. Vuong , Michael T. McCann , Javier E. Santos , Yen Ting Lin

The notion of concept drift refers to the phenomenon that the data generating distribution changes over time; as a consequence machine learning models may become inaccurate and need adjustment. In this paper we consider the problem of…

机器学习 · 计算机科学 2022-05-16 Fabian Hinder , André Artelt , Valerie Vaquet , Barbara Hammer

We introduce Midpoint Generative Models (MGM), a principled framework for training one-step generative models. MGM is based on a simple symmetry of Flow Matching with linear interpolation: when the two endpoint distributions coincide, the…

机器学习 · 计算机科学 2026-05-29 Daniil Shlenskii , Nikita Gushchin , Lev Novitskiy , Dmitry V. Dylov , Alexander Korotin

Many data-driven decision problems are formulated using a nominal distribution estimated from historical data, while performance is ultimately determined by a deployment distribution that may be shifted, context-dependent, partially…

机器学习 · 计算机科学 2026-04-07 Xiuyuan Cheng , Yunqin Zhu , Yao Xie

Generative modeling of physical systems, such as molecules, requires learning distributions that are invariant under global symmetries, such as rotations in three-dimensional space. Equivariant diffusion and flow matching models can…

机器学习 · 计算机科学 2026-05-08 Samir Darouich , Vinh Tong , Lluís Pastor-Pérez , Tanja Bien , Loay Mualem , Mathias Niepert
‹ 上一页 1 2 3 10 下一页 ›