English
Related papers

Related papers: Elucidating Rectified Flow with Deterministic Samp…

200 papers

Diffusion policies have achieved great success in online reinforcement learning (RL) due to their strong expressive capacity. However, the inference of diffusion policy models relies on a slow iterative sampling process, which limits their…

Machine Learning · Computer Science 2025-10-17 Tianyi Chen , Haitong Ma , Na Li , Kai Wang , Bo Dai

Diffusion models (DMs) have significantly advanced the development of real-world image super-resolution (Real-ISR), but the computational cost of multi-step diffusion models limits their application. One-step diffusion models generate…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Jianze Li , Jiezhang Cao , Yong Guo , Wenbo Li , Yulun Zhang

Diffusion models produce high-quality text-to-image results, but their iterative denoising is computationally expensive.Distribution Matching Distillation (DMD) emerges as a promising path to few-step distillation, but suffers from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Haoyu Li , Tingyan Wen , Lin Qi , Zhe Wu , Yihuang Chen , Xing Zhou , Lifei Zhu , Xueqian Wang , Kai Zhang

Discrete diffusion models are a powerful class of generative models with strong performance across many domains. For efficiency, however, discrete diffusion typically parameterizes the generative (reverse) process with factorized…

Machine Learning · Statistics 2026-05-19 Grigory Bartosh , Teodora Pandeva , Sushrut Karmalkar , Javier Zazo

Recent progress in large-scale flow and diffusion models raised two fundamental algorithmic challenges: (i) control-based reward adaptation of pre-trained flows, and (ii) integration of multiple models, i.e., flow merging. While current…

Machine Learning · Computer Science 2026-02-10 Riccardo De Santi , Malte Franke , Ya-Ping Hsieh , Andreas Krause

Discrete flow models (DFMs) have been proposed to learn the data distribution on finite state space, offering a flexible framework as an alternative to discrete diffusion models. A line of recent work has studied samplers for discrete…

Machine Learning · Statistics 2026-05-28 Zhengyan Wan , Yidong Ouyang , Liyan Xie , Hongyuan Zha , Fang Fang , Guang Cheng

Flow-matching models have enabled high-quality text-to-speech synthesis, but their iterative sampling process during inference incurs substantial computational cost. Although distillation is widely used to reduce the number of inference…

Sound · Computer Science 2026-02-11 Bin Lin , Peng Yang , Chao Yan , Xiaochen Liu , Wei Wang , Boyong Wu , Pengfei Tan , Xuerui Yang

Flow based models such as Real NVP are an extremely powerful approach to density estimation. However, existing flow based models are restricted to transforming continuous densities over a continuous input space into similarly continuous…

Machine Learning · Computer Science 2020-08-27 Laurent Dinh , Jascha Sohl-Dickstein , Hugo Larochelle , Razvan Pascanu

Langevin Dynamics is a Stochastic Differential Equation (SDE) central to sampling and generative modeling and is implemented via time discretization. Langevin Monte Carlo (LMC), based on the Euler-Maruyama discretization, is the simplest…

Machine Learning · Computer Science 2025-10-10 Saravanan Kandasamy , Dheeraj Nagaraj

Diffusion models have shown great promise for image and video generation, but sampling from state-of-the-art models requires expensive numerical integration of a generative ODE. One approach for tackling this problem is rectified flows,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Sangyun Lee , Zinan Lin , Giulia Fanti

Flow-based image generative models exhibit stable training and produce high quality samples when using multi-step sampling procedures. One-step generative models can produce high quality image samples but can be difficult to optimize as…

Machine Learning · Computer Science 2026-04-13 Chia-Hong Hsu , Frank Wood

By formulating data samples' formation as a Markov denoising process, diffusion models achieve state-of-the-art performances in a collection of tasks. Recently, many variants of diffusion models have been proposed to enable controlled…

Machine Learning · Computer Science 2023-04-17 Hengtong Zhang , Tingyang Xu

Robustness is essential for deep neural networks, especially in security-sensitive applications. To this end, randomized smoothing provides theoretical guarantees for certifying robustness against adversarial perturbations. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Jiachen Lei , Julius Berner , Jiongxiao Wang , Zhongzhu Chen , Zhongjia Ba , Kui Ren , Jun Zhu , Anima Anandkumar

Recent advances in diffusion and flow-based generative models have demonstrated remarkable success in image restoration tasks, achieving superior perceptual quality compared to traditional deep learning approaches. However, these methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yuanzhi Zhu , Ruiqing Wang , Shilin Lu , Junnan Li , Hanshu Yan , Kai Zhang

Generative models have emerged as a powerful paradigm for solving physics systems and modeling complex spatiotemporal dynamics. However, achieving high physical accuracy without incurring high computational cost remains a fundamental…

Machine Learning · Computer Science 2026-05-27 Jiahe Huang , Sihan Xu , Sharvaree Vadgama , Rose Yu

The multi-step denoising process in diffusion and Flow Matching models causes major efficiency issues, which motivates research on few-step generation. We present Solution Flow Models (SoFlow), a framework for one-step generation from…

Machine Learning · Computer Science 2026-03-03 Tianze Luo , Haotian Yuan , Zhuang Liu

Diffusion-based models have achieved notable empirical successes in reinforcement learning (RL) due to their expressiveness in modeling complex distributions. Despite existing methods being promising, the key challenge of extending existing…

Machine Learning · Computer Science 2024-11-04 Dmitry Shribak , Chen-Xiao Gao , Yitong Li , Chenjun Xiao , Bo Dai

Recent work showed that large diffusion models can be reused as highly precise monocular depth estimators by casting depth estimation as an image-conditional image generation task. While the proposed model achieved state-of-the-art results,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Gonzalo Martin Garcia , Karim Knaebel , Christian Schmidt , Daan de Geus , Alexander Hermans , Bastian Leibe

Generating accurate and stable long rollouts is a notorious challenge for time-dependent PDEs (Partial Differential Equations). Recently, motivated by the importance of high-frequency accuracy, a refiner model called PDERefiner utilizes…

Computational Engineering, Finance, and Science · Computer Science 2025-06-16 Li Luo

Discrete diffusion models have emerged as a promising direction for vision-language tasks, offering bidirectional context modeling and theoretical parallelization. However, their practical application is severely hindered by a…

Computation and Language · Computer Science 2025-10-24 Yatai Ji , Teng Wang , Yuying Ge , Zhiheng Liu , Sidi Yang , Ying Shan , Ping Luo