English

PixARMesh: Autoregressive Mesh-Native Single-View Scene Reconstruction

Computer Vision and Pattern Recognition 2026-03-09 v1 Graphics Machine Learning

Abstract

We introduce PixARMesh, a method to autoregressively reconstruct complete 3D indoor scene meshes directly from a single RGB image. Unlike prior methods that rely on implicit signed distance fields and post-hoc layout optimization, PixARMesh jointly predicts object layout and geometry within a unified model, producing coherent and artist-ready meshes in a single forward pass. Building on recent advances in mesh generative models, we augment a point-cloud encoder with pixel-aligned image features and global scene context via cross-attention, enabling accurate spatial reasoning from a single image. Scenes are generated autoregressively from a unified token stream containing context, pose, and mesh, yielding compact meshes with high-fidelity geometry. Experiments on synthetic and real-world datasets show that PixARMesh achieves state-of-the-art reconstruction quality while producing lightweight, high-quality meshes ready for downstream applications.

Keywords

Cite

@article{arxiv.2603.05888,
  title  = {PixARMesh: Autoregressive Mesh-Native Single-View Scene Reconstruction},
  author = {Xiang Zhang and Sohyun Yoo and Hongrui Wu and Chuan Li and Jianwen Xie and Zhuowen Tu},
  journal= {arXiv preprint arXiv:2603.05888},
  year   = {2026}
}

Comments

CVPR 2026. Project Page: https://mlpc-ucsd.github.io/PixARMesh

R2 v1 2026-07-01T11:06:07.408Z