English

CubeDiff: Repurposing Diffusion-Based Image Models for Panorama Generation

Computer Vision and Pattern Recognition 2025-01-29 v1 Machine Learning

Abstract

We introduce a novel method for generating 360{\deg} panoramas from text prompts or images. Our approach leverages recent advances in 3D generation by employing multi-view diffusion models to jointly synthesize the six faces of a cubemap. Unlike previous methods that rely on processing equirectangular projections or autoregressive generation, our method treats each face as a standard perspective image, simplifying the generation process and enabling the use of existing multi-view diffusion models. We demonstrate that these models can be adapted to produce high-quality cubemaps without requiring correspondence-aware attention layers. Our model allows for fine-grained text control, generates high resolution panorama images and generalizes well beyond its training set, whilst achieving state-of-the-art results, both qualitatively and quantitatively. Project page: https://cubediff.github.io/

Keywords

Cite

@article{arxiv.2501.17162,
  title  = {CubeDiff: Repurposing Diffusion-Based Image Models for Panorama Generation},
  author = {Nikolai Kalischek and Michael Oechsle and Fabian Manhardt and Philipp Henzler and Konrad Schindler and Federico Tombari},
  journal= {arXiv preprint arXiv:2501.17162},
  year   = {2025}
}

Comments

Accepted at ICLR 2025

R2 v1 2026-06-28T21:22:35.518Z