English

Step-by-Step Diffusion: An Elementary Tutorial

Machine Learning 2024-06-25 v2 Artificial Intelligence Computer Vision and Pattern Recognition Machine Learning
Authors: Preetum Nakkiran , Arwen Bradley , Hattie Zhou , Madhu Advani
View on arXiv ↗ PDF ↗

Abstract

We present an accessible first course on diffusion models and flow matching for machine learning, aimed at a technical audience with no diffusion experience. We try to simplify the mathematical details as much as possible (sometimes heuristically), while retaining enough precision to derive correct algorithms.

Keywords

diffusion model optical flow machine learning

Cite

@article{arxiv.2406.08929,
  title  = {Step-by-Step Diffusion: An Elementary Tutorial},
  author = {Preetum Nakkiran and Arwen Bradley and Hattie Zhou and Madhu Advani},
  journal= {arXiv preprint arXiv:2406.08929},
  year   = {2024}
}

Comments

35 pages, 11 figures

Related papers

View all related →
Machine Learning · Computer Science
An Introduction to Flow Matching and Diffusion Models
Peter Holderrieth, Ezra Erives
2026-03-19
Machine Learning · Computer Science
Diffusion Models for Time Series Applications: A Survey
Lequan Lin, Zhengkun Li, Ruikun Li, Xuliang Li +1
2023-05-02
Machine Learning · Computer Science
Tutorial on Diffusion Models for Imaging and Vision
Stanley H. Chan
2025-01-09
Graphics · Computer Science
ProReflow: Progressive Reflow with Decomposed Velocity
Lei Ke, Haohang Xu, Xuefei Ning, Yu Li +6
2025-03-13
Machine Learning · Computer Science
Single-Step Consistent Diffusion Samplers
Pascal Jutras-Dubé, Patrick Pynadath, Ruqi Zhang
2025-02-17
Machine Learning · Computer Science
Demystifying Variational Diffusion Models
Fabio De Sousa Ribeiro, Ben Glocker
2025-05-23
Statistical Mechanics · Physics
Machine-Learning Solutions for the Analysis of Single-Particle Diffusion Trajectories
Henrik Seckler, Janusz Szwabinski, Ralf Metzler
2023-09-14
Computer Vision and Pattern Recognition · Computer Science
Diff2Flow: Training Flow Matching Models via Diffusion Model Alignment
Johannes Schusterbauer, Ming Gui, Frank Fundel, Björn Ommer
2025-06-04
Information Retrieval · Computer Science
A Survey on Diffusion Models for Recommender Systems
Jianghao Lin, Jiaqi Liu, Jiachen Zhu, Yunjia Xi +4
2024-09-17
Machine Learning · Computer Science
An overview of diffusion models for generative artificial intelligence
Davide Gallon, Arnulf Jentzen, Philippe von Wurstemberger
2024-12-03
Machine Learning · Computer Science
Diffusion Models for Generative Artificial Intelligence: An Introduction for Applied Mathematicians
Catherine F. Higham, Desmond J. Higham, Peter Grindrod
2023-12-27
Machine Learning · Statistics
Towards a mathematical theory for consistency training in diffusion models
Gen Li, Zhihan Huang, Yuting Wei
2024-02-13
Computer Vision and Pattern Recognition · Computer Science
Shortcutting Pre-trained Flow Matching Diffusion Models is Almost Free Lunch
Xu Cai, Yang Wu, Qianli Chen, Haoran Wu +2
2025-10-22
Machine Learning · Computer Science
Multistep Distillation of Diffusion Models via Moment Matching
Tim Salimans, Thomas Mensink, Jonathan Heek, Emiel Hoogeboom
2024-06-07
Machine Learning · Computer Science
On the Guidance of Flow Matching
Ruiqi Feng, Chenglei Yu, Wenhao Deng, Peiyan Hu +1
2025-05-27
Computer Vision and Pattern Recognition · Computer Science
MatchDiffusion: Training-free Generation of Match-cuts
Alejandro Pardo, Fabio Pizzati, Tong Zhang, Alexander Pondaven +3
2024-12-02
Machine Learning · Computer Science
Discrete Guidance Matching: Exact Guidance for Discrete Flow Matching
Zhengyan Wan, Yidong Ouyang, Liyan Xie, Fang Fang +2
2026-04-16
Machine Learning · Statistics
Training Latent Diffusion Models with Interacting Particle Algorithms
Tim Y. J. Wang, Juan Kuntz, O. Deniz Akyildiz
2026-03-31
Computation and Language · Computer Science
FlowLM: Few-Step Language Modeling via Diffusion-to-Flow Adaptation
Runzhe Zhang, Letian Chen, Wenpeng Zhang, Zhouhan Lin +1
2026-05-21
Machine Learning · Computer Science
On the Design of One-step Diffusion via Shortcutting Flow Paths
Haitao Lin, Peiyan Hu, Minsi Ren, Zhifeng Gao +4
2026-02-03
Machine Learning · Computer Science
Discrete Flow Matching
Itai Gat, Tal Remez, Neta Shaul, Felix Kreuk +4
2024-11-06
Computer Vision and Pattern Recognition · Computer Science
ProtoDiffusion: Classifier-Free Diffusion Guidance with Prototype Learning
Gulcin Baykal, Halil Faruk Karagoz, Taha Binhuraib, Gozde Unal
2023-07-06
Machine Learning · Computer Science
Machine Learning Analysis of Anomalous Diffusion
Wenjie Cai, Yi Hu, Xiang Qu, Hui Zhao +3
2025-04-01
Machine Learning · Computer Science
Exploring Diffusion and Flow Matching Under Generator Matching
Zeeshan Patel, James DeLoye, Lance Mathias
2024-12-18
Computer Vision and Pattern Recognition · Computer Science
LayoutFlow: Flow Matching for Layout Generation
Julian Jorge Andrade Guerreiro, Naoto Inoue, Kento Masui, Mayu Otani +1
2024-07-16
R2 v1 2026-06-28T17:04:16.117Z