English

SonoWorld: From One Image to a 3D Audio-Visual Scene

Computer Vision and Pattern Recognition 2026-03-31 v1 Multimedia Sound

Abstract

Tremendous progress in visual scene generation now turns a single image into an explorable 3D world, yet immersion remains incomplete without sound. We introduce Image2AVScene, the task of generating a 3D audio-visual scene from a single image, and present SonoWorld, the first framework to tackle this challenge. From one image, our pipeline outpaints a 360{\deg} panorama, lifts it into a navigable 3D scene, places language-guided sound anchors, and renders ambisonics for point, areal, and ambient sources, yielding spatial audio aligned with scene geometry and semantics. Quantitative evaluations on a newly curated real-world dataset and a controlled user study confirm the effectiveness of our approach. Beyond free-viewpoint audio-visual rendering, we also demonstrate applications to one-shot acoustic learning and audio-visual spatial source separation. Project website: https://humathe.github.io/sonoworld/

Keywords

Cite

@article{arxiv.2603.28757,
  title  = {SonoWorld: From One Image to a 3D Audio-Visual Scene},
  author = {Derong Jin and Xiyi Chen and Ming C. Lin and Ruohan Gao},
  journal= {arXiv preprint arXiv:2603.28757},
  year   = {2026}
}

Comments

Accepted by CVPR 2026, project page: https://humathe.github.io/sonoworld/

R2 v1 2026-07-01T11:44:36.049Z