English

LLaDA-o: An Effective and Length-Adaptive Omni Diffusion Model

Computer Vision and Pattern Recognition 2026-03-03 v1 Machine Learning

Abstract

We present \textbf{LLaDA-o}, an effective and length-adaptive omni diffusion model for multimodal understanding and generation. LLaDA-o is built on a Mixture of Diffusion (MoD) framework that decouples discrete masked diffusion for text understanding and continuous diffusion for visual generation, while coupling them through a shared, simple, and efficient attention backbone that reduces redundant computation for fixed conditions. Building on MoD, we further introduce a data-centric length adaptation strategy that enables flexible-length decoding in multimodal settings without architectural changes. Extensive experiments show that LLaDA-o achieves state-of-the-art performance among omni-diffusion models on multimodal understanding and generation benchmarks, and reaches 87.04 on DPG-Bench for text-to-image generation, supporting the effectiveness of unified omni diffusion modeling. Code is available at https://github.com/ML-GSAI/LLaDA-o.

Keywords

Cite

@article{arxiv.2603.01068,
  title  = {LLaDA-o: An Effective and Length-Adaptive Omni Diffusion Model},
  author = {Zebin You and Xiaolu Zhang and Jun Zhou and Chongxuan Li and Ji-Rong Wen},
  journal= {arXiv preprint arXiv:2603.01068},
  year   = {2026}
}
R2 v1 2026-07-01T10:57:55.459Z