English

ART: Articulated Reconstruction Transformer

Computer Vision and Pattern Recognition 2026-05-18 v3

Abstract

We introduce ART, Articulated Reconstruction Transformer -- a category-agnostic, feed-forward model that reconstructs complete 3D articulated objects from only sparse, multi-state RGB images. Previous methods for articulated object reconstruction either rely on slow optimization with fragile cross-state correspondences or use feed-forward models limited to specific object categories. In contrast, ART treats articulated objects as assemblies of rigid parts, formulating reconstruction as part-based prediction. Our newly designed transformer architecture maps sparse image inputs to a set of learnable part slots, from which ART jointly decodes unified representations for individual parts, including their 3D geometry, texture, and explicit articulation parameters. The resulting reconstructions are physically interpretable and readily exportable for simulation. Trained on a large-scale, diverse dataset with per-part supervision, and evaluated across diverse benchmarks, ART achieves significant improvements over existing baselines and establishes a new state of the art for articulated object reconstruction from image inputs.

Keywords

Cite

@article{arxiv.2512.14671,
  title  = {ART: Articulated Reconstruction Transformer},
  author = {Zizhang Li and Cheng Zhang and Zhengqin Li and Henry Howard-Jenkins and Zhaoyang Lv and Chen Geng and Jiajun Wu and Richard Newcombe and Jakob Engel and Zhao Dong},
  journal= {arXiv preprint arXiv:2512.14671},
  year   = {2026}
}

Comments

Project Page: https://kyleleey.github.io/ART/

R2 v1 2026-07-01T08:27:49.191Z