English
Related papers

Related papers: Generative Drifting is Secretly Score Matching: a …

200 papers

We propose kernel-gradient drifting, a one-step generative modeling framework that replaces the fixed Euclidean displacement direction in drifting models with directions induced by the kernel itself. Standard drifting is attractive because…

Drifting models train one-step generators by optimizing a kernel-induced mean-shift discrepancy between the data and model distributions, with Laplace kernels used by default in practice. At each point, this discrepancy compares the…

Machine Learning · Computer Science 2026-05-18 Chieh-Hsin Lai , Bac Nguyen , Naoki Murata , Yuhta Takida , Toshimitsu Uesaka , Yuki Mitsufuji , Stefano Ermon , Molei Tao

We establish a theoretical link between the recently proposed "drifting" generative dynamics and gradient flows induced by the Sinkhorn divergence. In a particle discretization, the drift field admits a cross-minus-self decomposition: an…

Machine Learning · Computer Science 2026-03-30 Ping He , Om Khangaonkar , Hamed Pirsiavash , Yikun Bai , Soheil Kolouri

This paper studies the identifiability and stability of drifting fields within the framework of Generative Modeling via Drifting. The motivating question is whether a zero-drift equilibrium identifies the target distribution, and whether an…

Machine Learning · Statistics 2026-05-13 HakGeun Lee , Hyonho Chun

Drifting models have recently gained attention for generating high-quality samples in a single forward pass. During training, they learn a push-forward map by following a vector-valued field, the drift field. We ask whether this procedure…

Machine Learning · Computer Science 2026-05-11 Leonard T. Franz , Sebastian Hoffmann , Tim Weiland , Bernhard Schölkopf , Georg Martius

We reveal a precise mathematical framework about a new family of generative models which we call Gradient Flow Drifting. With this framework, we prove an equivalence between the recently proposed Drifting Model and the Wasserstein gradient…

Machine Learning · Computer Science 2026-03-12 Jiarui Cao , Zixuan Wei , Yuxin Liu

Generative modeling can be formulated as learning a mapping f such that its pushforward distribution matches the data distribution. The pushforward behavior can be carried out iteratively at inference time, for example in diffusion and…

Machine Learning · Computer Science 2026-02-09 Mingyang Deng , He Li , Tianhong Li , Yilun Du , Kaiming He

Conditional medical image generation plays an important role in many clinically relevant imaging tasks. However, existing methods still face a fundamental challenge in balancing inference efficiency, patient-specific fidelity, and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Zirong Li , Siyuan Mei , Weiwen Wu , Andreas Maier , Lina Gölz , Yan Xia

Recently, Deng et al. (2026) proposed Generative Modeling via Drifting (GMD), a novel framework for generative tasks. This note presents an analysis of GMD through the lens of Wasserstein Gradient Flows (WGF), i.e., the path of steepest…

Machine Learning · Computer Science 2026-05-22 Arthur Gretton , Li Kevin Wenliang , Alexandre Galashov , James Thornton , Valentin De Bortoli , Arnaud Doucet

Drifting Models [Deng et al., 2026] train a one-step generator by evolving samples under a kernel-based drift field, avoiding ODE integration at inference. The original analysis leaves two questions open. The drift-field iteration admits a…

Machine Learning · Computer Science 2026-04-21 Arkadii Kazanskii , Tatiana Petrova , Konstantin Bagrianskii , Aleksandr Puzikov , Radu State

Imperfect score-matching leads to a shift between the training and the sampling distribution of diffusion models. Due to the recursive nature of the generation process, errors in previous steps yield sampling iterates that drift away from…

Machine Learning · Computer Science 2023-02-20 Giannis Daras , Yuval Dagan , Alexandros G. Dimakis , Constantinos Daskalakis

Learning to sample from complex unnormalized distributions is a fundamental challenge in computational physics and machine learning. While score-based and variational methods have achieved success in continuous domains, extending them to…

Machine Learning · Statistics 2026-03-11 Lei Li , Zhen Wang , Lishuo Zhang

We propose a new score-based model with one-step sampling. Previously, score-based models were burdened with heavy computations due to iterative sampling. For substituting the iterative process, we train a standalone generator to compress…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Senmao Ye , Fei Liu

Creating noise from data is easy; creating data from noise is generative modeling. We present a stochastic differential equation (SDE) that smoothly transforms a complex data distribution to a known prior distribution by slowly injecting…

Machine Learning · Computer Science 2021-02-11 Yang Song , Jascha Sohl-Dickstein , Diederik P. Kingma , Abhishek Kumar , Stefano Ermon , Ben Poole

Drifting Models have emerged as a new paradigm for one-step generative modeling, achieving strong image quality without iterative inference. The premise is to replace the iterative denoising process in diffusion models with a single…

Machine Learning · Computer Science 2026-05-13 Ali Falahati , Elliot Creager , Gautam Kamath , Shubhankar Mohapatra

Diffusion models are commonly interpreted as learning the score function, i.e., the gradient of the log-density of noisy data. However, this assumption implies that the target of learning is a conservative vector field, which is not…

Machine Learning · Computer Science 2025-09-03 An B. Vuong , Michael T. McCann , Javier E. Santos , Yen Ting Lin

The notion of concept drift refers to the phenomenon that the data generating distribution changes over time; as a consequence machine learning models may become inaccurate and need adjustment. In this paper we consider the problem of…

Machine Learning · Computer Science 2022-05-16 Fabian Hinder , André Artelt , Valerie Vaquet , Barbara Hammer

We introduce Midpoint Generative Models (MGM), a principled framework for training one-step generative models. MGM is based on a simple symmetry of Flow Matching with linear interpolation: when the two endpoint distributions coincide, the…

Machine Learning · Computer Science 2026-05-29 Daniil Shlenskii , Nikita Gushchin , Lev Novitskiy , Dmitry V. Dylov , Alexander Korotin

Many data-driven decision problems are formulated using a nominal distribution estimated from historical data, while performance is ultimately determined by a deployment distribution that may be shifted, context-dependent, partially…

Machine Learning · Computer Science 2026-04-07 Xiuyuan Cheng , Yunqin Zhu , Yao Xie

Generative modeling of physical systems, such as molecules, requires learning distributions that are invariant under global symmetries, such as rotations in three-dimensional space. Equivariant diffusion and flow matching models can…

Machine Learning · Computer Science 2026-05-08 Samir Darouich , Vinh Tong , Lluís Pastor-Pérez , Tanja Bien , Loay Mualem , Mathias Niepert
‹ Prev 1 2 3 10 Next ›