English

MoCA3D: Monocular 3D Bounding Box Prediction in the Image Plane

Computer Vision and Pattern Recognition 2026-05-19 v2

Abstract

Monocular 3D object understanding has largely been cast as a 2D RoI-to-3D box lifting problem. However, emerging downstream applications require image-plane geometry (e.g., projected 3D box corners) which cannot be easily obtained without known intrinsics, a problem for object detection in the wild. We introduce MoCA3D, a Monocular, Class-Agnostic 3D model that predicts projected 3D bounding box corners and per-corner depths without requiring camera intrinsics at inference time. MoCA3D formulates pixel-space localization and depth assignment as dense prediction via corner heatmaps and depth maps. To evaluate image-plane geometric fidelity, we propose Pixel-Aligned Geometry (PAG), which directly measures image-plane corner and depth consistency. Extensive experiments demonstrate that MoCA3D achieves state-of-the-art performance, improving image-plane corner PAG by 22.8% while remaining comparable on 3D IoU, using up to 57 times fewer trainable parameters. Finally, we apply MoCA3D to downstream tasks which were previously impractical under unknown intrinsics, highlighting its utility beyond standard baseline models.

Keywords

Cite

@article{arxiv.2603.19538,
  title  = {MoCA3D: Monocular 3D Bounding Box Prediction in the Image Plane},
  author = {Changwoo Jeon and Rishi Upadhyay and Achuta Kadambi},
  journal= {arXiv preprint arXiv:2603.19538},
  year   = {2026}
}

Comments

27 pages, 9 figures, including supplementary material

R2 v1 2026-07-01T11:29:09.220Z