English

Bezier Distillation

Machine Learning 2025-03-24 v1

Abstract

In Rectified Flow, by obtaining the rectified flow several times, the mapping relationship between distributions can be distilled into a neural network, and the target distribution can be directly predicted by the straight lines of the flow. However, during the pairing process of the mapping relationship, a large amount of error accumulation will occur, resulting in a decrease in performance after multiple rectifications. In the field of flow models, knowledge distillation of multi - teacher diffusion models is also a problem worthy of discussion in accelerating sampling. I intend to combine multi - teacher knowledge distillation with Bezier curves to solve the problem of error accumulation. Currently, the related paper is being written by myself.

Keywords

Cite

@article{arxiv.2503.16562,
  title  = {Bezier Distillation},
  author = {Ling Feng and SK Yang},
  journal= {arXiv preprint arXiv:2503.16562},
  year   = {2025}
}
R2 v1 2026-06-28T22:28:51.204Z