English

ViewMask-1-to-3: Multi-View Consistent Image Generation via Multimodal Diffusion Models

Computer Vision and Pattern Recognition 2026-03-16 v2

Abstract

Motivated by discrete diffusion's success in language-vision modeling, we explore its potential for multi-view generation, a task dominated by continuous approaches. We introduce ViewMask-1-to-3, formulating multi-view synthesis as a discrete sequence modeling problem where each viewpoint is represented as visual tokens from MAGVIT-v2. Through masked token prediction, our approach enables progressive multi-view generation via iterative token unmasking, unifying language and vision in a shared token space. Importantly, simple random masking combined with self-attention naturally encourages cross-view consistency without specialized architectures or 3D geometric priors. Our method outperforms the baseline on the GSO and 3D-FUTURE benchmarks, ranking first on average across standard image metrics and improving IoU by 10.6% on 3D-FUTURE. This validates discrete diffusion as a promising candidate for multi-view generation.

Keywords

Cite

@article{arxiv.2512.14099,
  title  = {ViewMask-1-to-3: Multi-View Consistent Image Generation via Multimodal Diffusion Models},
  author = {Ruishu Zhu and Zhihao Huang and Jiacheng Sun and Ping Luo and Hongyuan Zhang and Xuelong Li},
  journal= {arXiv preprint arXiv:2512.14099},
  year   = {2026}
}
R2 v1 2026-07-01T08:26:47.471Z