English

CL-Splats: Continual Learning of Gaussian Splatting with Local Optimization

Computer Vision and Pattern Recognition 2025-10-17 v2

Abstract

In dynamic 3D environments, accurately updating scene representations over time is crucial for applications in robotics, mixed reality, and embodied AI. As scenes evolve, efficient methods to incorporate changes are needed to maintain up-to-date, high-quality reconstructions without the computational overhead of re-optimizing the entire scene. This paper introduces CL-Splats, which incrementally updates Gaussian splatting-based 3D representations from sparse scene captures. CL-Splats integrates a robust change-detection module that segments updated and static components within the scene, enabling focused, local optimization that avoids unnecessary re-computation. Moreover, CL-Splats supports storing and recovering previous scene states, facilitating temporal segmentation and new scene-analysis applications. Our extensive experiments demonstrate that CL-Splats achieves efficient updates with improved reconstruction quality over the state-of-the-art. This establishes a robust foundation for future real-time adaptation in 3D scene reconstruction tasks.

Keywords

Cite

@article{arxiv.2506.21117,
  title  = {CL-Splats: Continual Learning of Gaussian Splatting with Local Optimization},
  author = {Jan Ackermann and Jonas Kulhanek and Shengqu Cai and Haofei Xu and Marc Pollefeys and Gordon Wetzstein and Leonidas Guibas and Songyou Peng},
  journal= {arXiv preprint arXiv:2506.21117},
  year   = {2025}
}

Comments

ICCV 2025, Project Page: https://cl-splats.github.io