中文
相关论文

相关论文: A Unified Framework for Data-Free One-Step Samplin…

200 篇论文

We propose a principled and effective framework for one-step generative modeling. We introduce the notion of average velocity to characterize flow fields, in contrast to instantaneous velocity modeled by Flow Matching methods. A…

机器学习 · 计算机科学 2025-05-20 Zhengyang Geng , Mingyang Deng , Xingjian Bai , J. Zico Kolter , Kaiming He

Flow matching has emerged as a powerful generative framework, with recent few-step methods achieving remarkable inference acceleration. However, we identify a critical yet overlooked limitation: these models suffer from severe diversity…

机器学习 · 计算机科学 2026-04-15 Yexiong Lin , Jia Shi , Shanshan Ye , Wanyu Wang , Yu Yao , Tongliang Liu

We introduce a novel unit-time ordinary differential equation (ODE) flow called the preconditioned F\"{o}llmer flow, which efficiently transforms a Gaussian measure into a desired target measure at time 1. To discretize the flow, we apply…

统计方法学 · 统计学 2023-11-08 Zhao Ding , Yuling Jiao , Xiliang Lu , Zhijian Yang , Cheng Yuan

One-step generative modeling seeks to generate high-quality data samples in a single function evaluation, significantly improving efficiency over traditional diffusion or flow-based models. In this work, we introduce Modular MeanFlow (MMF),…

机器学习 · 计算机科学 2025-08-26 Haochen You , Baojing Liu , Hongyang He

Despite the remarkable empirical success of score-based diffusion models, their statistical guarantees remain underdeveloped. Existing analyses often provide pessimistic convergence rates that do not reflect the intrinsic low-dimensional…

机器学习 · 统计学 2026-04-24 Saptarshi Chakraborty , Quentin Berthet , Peter L. Bartlett

Wasserstein Gradient Flows (WGF) with respect to specific functionals have been widely used in the machine learning literature. Recently, neural networks have been adopted to approximate certain intractable parts of the underlying…

机器学习 · 计算机科学 2024-01-26 Huminhao Zhu , Fangyikang Wang , Chao Zhang , Hanbin Zhao , Hui Qian

Many machine learning problems can be seen as approximating a \textit{target} distribution using a \textit{particle} distribution by minimizing their statistical discrepancy. Wasserstein Gradient Flow can move particles along a path that…

机器学习 · 统计学 2024-06-07 Song Liu , Jiahao Yu , Jack Simons , Mingxuan Yi , Mark Beaumont

We study the convergence of gradient flow for the training of deep neural networks. If Residual Neural Networks are a popular example of very deep architectures, their training constitutes a challenging optimization problem due notably to…

机器学习 · 计算机科学 2025-07-22 Raphaël Barboni , Gabriel Peyré , François-Xavier Vialard

Flow Matching enables simulation-free training of generative models on Riemannian manifolds, yet sampling typically still relies on numerically integrating a probability-flow ODE. We propose Riemannian MeanFlow (RMF), extending MeanFlow to…

机器学习 · 计算机科学 2026-05-21 Zichen Zhong , Haoliang Sun , Yukun Zhao , Yongshun Gong , Yilong Yin

Diffusion-based generative models have achieved remarkable performance across various domains, yet their practical deployment is often limited by high sampling costs. While prior work focuses on training objectives or individual solvers,…

机器学习 · 计算机科学 2026-02-16 Sangwoo Jo , Sungjoon Choi

Many applications in machine learning involve data represented as probability distributions. The emergence of such data requires radically novel techniques to design tractable gradient flows on probability distributions over this type of…

机器学习 · 计算机科学 2025-06-10 Clément Bonet , Christophe Vauthier , Anna Korba

We develop a discrete optimal transport framework for analyzing simulated annealing algorithms on finite state spaces. Building on the discrete Wasserstein metric introduced by Maas (J. Funct. Anal., 2011), we define a generalized discrete…

数据结构与算法 · 计算机科学 2026-05-08 Yuchen He , Tianhui Jiang , Sihan Wang , Chihao Zhang

Domain adaptation aims to generalise a high-performance learner on target domain (non-labelled data) by leveraging the knowledge from source domain (rich labelled data) which comes from a different but related distribution. Assuming the…

计算机视觉与模式识别 · 计算机科学 2019-10-18 Jie Su

Flow matching has recently emerged as a flexible and efficient framework for generative modelling by learning deterministic transport dynamics between probability measures. In this work, we extend flow matching to the space of probability…

机器学习 · 计算机科学 2026-05-12 Moritz Piening , Richard Duong , Gabriele Steidl

Generative modeling can be formulated as learning a mapping f such that its pushforward distribution matches the data distribution. The pushforward behavior can be carried out iteratively at inference time, for example in diffusion and…

机器学习 · 计算机科学 2026-02-09 Mingyang Deng , He Li , Tianhong Li , Yilun Du , Kaiming He

Recently, Deng et al. (2026) proposed Generative Modeling via Drifting (GMD), a novel framework for generative tasks. This note presents an analysis of GMD through the lens of Wasserstein Gradient Flows (WGF), i.e., the path of steepest…

Variational inference, such as the mean-field (MF) approximation, requires certain conjugacy structures for efficient computation. These can impose unnecessary restrictions on the viable prior distribution family and further constraints on…

统计理论 · 数学 2023-09-11 Rentian Yao , Yun Yang

We introduce adaptive, tuning-free step size schedules for gradient-based sampling algorithms obtained as time-discretizations of Wasserstein gradient flows. The result is a suite of tuning-free sampling algorithms, including tuning-free…

统计方法学 · 统计学 2025-10-30 Louis Sharrock , Christopher Nemeth

Fitting a function by using linear combinations of a large number $N$ of `simple' components is one of the most fruitful ideas in statistical learning. This idea lies at the core of a variety of methods, from two-layer neural networks to…

统计理论 · 数学 2019-08-20 Adel Javanmard , Marco Mondelli , Andrea Montanari

Score-based generative modeling with probability flow ordinary differential equations (ODEs) has achieved remarkable success in a variety of applications. While various fast ODE-based samplers have been proposed in the literature and…

机器学习 · 统计学 2025-08-12 Xuefeng Gao , Lingjiong Zhu