中文
相关论文

相关论文: Discrete MeanFlow: One-Step Generation via Conditi…

200 篇论文

We present a comprehensive comparative study of three generative modeling paradigms: Denoising Diffusion Probabilistic Models (DDPM), Conditional Flow Matching (CFM), and MeanFlow. While DDPM and CFM require iterative sampling, MeanFlow…

计算机视觉与模式识别 · 计算机科学 2025-11-27 Umang Agarwal , Rudraksh Sangore , Sumit Laddha

The sequential nature of autoregressive next-token prediction imposes a fundamental speed limit on large language models. While continuous flow models offer a path to parallel generation, they traditionally demand expensive iterative…

Fluid approximations have seen great success in approximating the macro-scale behaviour of Markov systems with a large number of discrete states. However, these methods rely on the continuous-time Markov chain (CTMC) having a particular…

系统与控制 · 电气工程与系统科学 2019-10-29 Michalis Michaelides , Jane Hillston , Guido Sanguinetti

Real-time robotic control demands fast action generation. However, existing generative policies based on diffusion and flow matching require multi-step sampling, fundamentally limiting deployment in time-critical scenarios. We propose…

机器人学 · 计算机科学 2026-01-29 Guowei Zou , Haitao Wang , Hejun Wu , Yukun Qian , Yuhang Wang , Weibing Li

This paper introduces Discrete Markov Probabilistic Models (DMPMs), a novel discrete diffusion algorithm for discrete data generation. The algorithm operates in discrete bit space, where the noising process is a continuous-time Markov chain…

机器学习 · 统计学 2025-10-09 Le-Tuyet-Nhi Pham , Dario Shariatian , Antonio Ocello , Giovanni Conforti , Alain Durmus

Recent efforts have extended the flow-matching framework to discrete generative modeling. One strand of models directly works with the continuous probabilities instead of discrete tokens, which we colloquially refer to as Continuous-State…

机器学习 · 计算机科学 2025-04-15 Chaoran Cheng , Jiahan Li , Jiajun Fan , Ge Liu

We introduce Midpoint Generative Models (MGM), a principled framework for training one-step generative models. MGM is based on a simple symmetry of Flow Matching with linear interpolation: when the two endpoint distributions coincide, the…

机器学习 · 计算机科学 2026-05-29 Daniil Shlenskii , Nikita Gushchin , Lev Novitskiy , Dmitry V. Dylov , Alexander Korotin

Combining discrete and continuous data is an important capability for generative models. We present Discrete Flow Models (DFMs), a new flow-based model of discrete data that provides the missing link in enabling flow-based generative models…

机器学习 · 统计学 2024-06-07 Andrew Campbell , Jason Yim , Regina Barzilay , Tom Rainforth , Tommi Jaakkola

Analyses of serially-sampled data often begin with the assumption that the observations represent discrete samples from a latent continuous-time stochastic process. The continuous-time Markov chain (CTMC) is one such generative model whose…

应用统计 · 统计学 2009-10-12 Asger Hobolth , Eric A. Stone

Flow-based generative models have greatly improved text-to-speech (TTS) synthesis quality, but inference speed remains limited by the iterative sampling process and multiple function evaluations (NFE). The recent MeanFlow model accelerates…

声音 · 计算机科学 2025-10-10 Wei Wang , Rong Cao , Yi Guo , Zhengyang Chen , Kuan Chen , Yuanyuan Huo

One-step generative modeling has emerged as a leading approach to amortize the inference cost of diffusion and flow-matching models. Among distillation-free methods, MeanFlow training is notoriously unstable, with non-decreasing loss and…

机器学习 · 计算机科学 2026-05-12 Juanwu Lu , Ziran Wang

Flow matching has emerged as a powerful generative framework, with recent few-step methods achieving remarkable inference acceleration. However, we identify a critical yet overlooked limitation: these models suffer from severe diversity…

机器学习 · 计算机科学 2026-04-15 Yexiong Lin , Jia Shi , Shanshan Ye , Wanyu Wang , Yu Yao , Tongliang Liu

MeanFlow (MF) is a diffusion-motivated generative model that enables efficient few-step generation by learning long jumps directly from noise to data. In practice, it is often used as a latent MF by leveraging the pre-trained Stable…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Zheyuan Hu , Chieh-Hsin Lai , Ge Wu , Yuki Mitsufuji , Stefano Ermon

We propose kernel-gradient drifting, a one-step generative modeling framework that replaces the fixed Euclidean displacement direction in drifting models with directions induced by the kernel itself. Standard drifting is attractive because…

We present Functional Mean Flow (FMF) as a one-step generative model defined in infinite-dimensional Hilbert space. FMF extends the one-step Mean Flow framework to functional domains by providing a theoretical formulation for Functional…

机器学习 · 计算机科学 2025-11-18 Zhiqi Li , Yuchen Sun , Greg Turk , Bo Zhu

Graph-structured data jointly contain discrete topology and continuous geometry, which poses fundamental challenges for generative modeling due to heterogeneous distributions, incompatible noise dynamics, and the need for equivariant…

机器学习 · 计算机科学 2026-04-10 Rongjian Xu , Teng Pang , Zhiqiang Dong , Guoqiang Wu

Steering large-scale swarms with only limited control updates is often needed due to communication or computational constraints, yet most learning-based approaches do not account for this and instead model instantaneous velocity fields. As…

机器学习 · 计算机科学 2026-04-07 Anqi Dong , Yongxin Chen , Karl H. Johansson , Johan Karlsson

Safety validation for Level 4 autonomous vehicles (AVs) is currently bottlenecked by the inability to scale the detection of rare, high-risk long-tail scenarios using traditional rule-based heuristics. We present Deep-Flow, an unsupervised…

机器人学 · 计算机科学 2026-02-20 Antonio Guillen-Perez

Deep learning paradigms, such as PINNs and neural operators, have significantly advanced the solving of PDEs. However, they often struggle to capture the continuous integral nature of physical systems, relying either on pointwise residuals…

机器学习 · 计算机科学 2026-05-12 Hanru Bai , Yuncheng Zhou , Difan Zou

Denoising generative models, such as diffusion and flow-based models, produce high-quality samples but require many denoising steps due to discretization error. Flow maps, which estimate the average velocity between timesteps, mitigate this…

计算机视觉与模式识别 · 计算机科学 2025-10-29 Kyungmin Lee , Sihyun Yu , Jinwoo Shin