English

SD3.5-Flash: Distribution-Guided Distillation of Generative Flows

Computer Vision and Pattern Recognition 2025-09-26 v1 Artificial Intelligence

Abstract

We present SD3.5-Flash, an efficient few-step distillation framework that brings high-quality image generation to accessible consumer devices. Our approach distills computationally prohibitive rectified flow models through a reformulated distribution matching objective tailored specifically for few-step generation. We introduce two key innovations: "timestep sharing" to reduce gradient noise and "split-timestep fine-tuning" to improve prompt alignment. Combined with comprehensive pipeline optimizations like text encoder restructuring and specialized quantization, our system enables both rapid generation and memory-efficient deployment across different hardware configurations. This democratizes access across the full spectrum of devices, from mobile phones to desktop computers. Through extensive evaluation including large-scale user studies, we demonstrate that SD3.5-Flash consistently outperforms existing few-step methods, making advanced generative AI truly accessible for practical deployment.

Keywords

Cite

@article{arxiv.2509.21318,
  title  = {SD3.5-Flash: Distribution-Guided Distillation of Generative Flows},
  author = {Hmrishav Bandyopadhyay and Rahim Entezari and Jim Scott and Reshinth Adithyan and Yi-Zhe Song and Varun Jampani},
  journal= {arXiv preprint arXiv:2509.21318},
  year   = {2025}
}

Comments

Project Page: https://hmrishavbandy.github.io/sd35flash/

R2 v1 2026-07-01T05:56:35.176Z