English

Surface-Based Visibility-Guided Uncertainty for Continuous Active 3D Neural Reconstruction

Computer Vision and Pattern Recognition 2025-12-05 v3 Artificial Intelligence

Abstract

View selection is critical in active 3D neural reconstruction as it impacts the contents of training set and resulting final output quality. Recent view selection strategies emphasize the visibility when evaluating model uncertainty in active 3D reconstruction. However, existing approaches estimate visibility only after the model fully converges, which has confined their application primarily to non-continuous active learning settings. This paper proposes Surface-Based Visibility field (SBV) that successfully estimates the visibility-guided uncertainty in continuous active 3D neural reconstruction. During learning neural implicit surfaces, our model learns rendering uncertainties and infers surface confidence values derived from signed distance functions. It then updates surface confidences using a voxel grid, robustly deducing the surface-based visibility for uncertainties. This approach captures uncertainties across all regions, whether well-defined surfaces or ambiguous areas, ensuring accurate visibility measurement in continuous active learning. Experiments on benchmark datasets-Tanks and Temples, BlendedMVS, Blender, DTU-and the newly proposed imbalanced viewpoint dataset (ImBView) show that view selection based on SBV-guided uncertainty improves performance by up to 11.6% over existing methods, highlighting its effectiveness in challenging reconstruction scenarios.

Keywords

Cite

@article{arxiv.2405.02568,
  title  = {Surface-Based Visibility-Guided Uncertainty for Continuous Active 3D Neural Reconstruction},
  author = {Hyunseo Kim and Hyeonseo Yang and Taekyung Kim and YoonSung Kim and Minsu Lee and Jin-Hwa Kim and Byoung-Tak Zhang},
  journal= {arXiv preprint arXiv:2405.02568},
  year   = {2025}
}

Comments

The main claims are the same as in the previous version, but the naming and explanations have been changed. Accepted at AAAI 2026 Artificial Intelligence with Biased or Scarce Data workshop

R2 v1 2026-06-28T16:16:28.203Z