English

SpotlessSplats: Ignoring Distractors in 3D Gaussian Splatting

Computer Vision and Pattern Recognition 2024-07-31 v2 Machine Learning

Abstract

3D Gaussian Splatting (3DGS) is a promising technique for 3D reconstruction, offering efficient training and rendering speeds, making it suitable for real-time applications.However, current methods require highly controlled environments (no moving people or wind-blown elements, and consistent lighting) to meet the inter-view consistency assumption of 3DGS. This makes reconstruction of real-world captures problematic. We present SpotLessSplats, an approach that leverages pre-trained and general-purpose features coupled with robust optimization to effectively ignore transient distractors. Our method achieves state-of-the-art reconstruction quality both visually and quantitatively, on casual captures. Additional results available at: https://spotlesssplats.github.io

Keywords

Cite

@article{arxiv.2406.20055,
  title  = {SpotlessSplats: Ignoring Distractors in 3D Gaussian Splatting},
  author = {Sara Sabour and Lily Goli and George Kopanas and Mark Matthews and Dmitry Lagun and Leonidas Guibas and Alec Jacobson and David J. Fleet and Andrea Tagliasacchi},
  journal= {arXiv preprint arXiv:2406.20055},
  year   = {2024}
}