English

CHROMA: Consistent Harmonization of Multi-View Appearance via Bilateral Grid Prediction

Computer Vision and Pattern Recognition 2025-10-01 v3

Abstract

Modern camera pipelines apply extensive on-device processing, such as exposure adjustment, white balance, and color correction, which, while beneficial individually, often introduce photometric inconsistencies across views. These appearance variations violate multi-view consistency and degrade novel view synthesis. Joint optimization of scene-specific representations and per-image appearance embeddings has been proposed to address this issue, but with increased computational complexity and slower training. In this work, we propose a generalizable, feed-forward approach that predicts spatially adaptive bilateral grids to correct photometric variations in a multi-view consistent manner. Our model processes hundreds of frames in a single step, enabling efficient large-scale harmonization, and seamlessly integrates into downstream 3D reconstruction models, providing cross-scene generalization without requiring scene-specific retraining. To overcome the lack of paired data, we employ a hybrid self-supervised rendering loss leveraging 3D foundation models, improving generalization to real-world variations. Extensive experiments show that our approach outperforms or matches the reconstruction quality of existing scene-specific optimization methods with appearance modeling, without significantly affecting the training time of baseline 3D models.

Keywords

Cite

@article{arxiv.2507.15748,
  title  = {CHROMA: Consistent Harmonization of Multi-View Appearance via Bilateral Grid Prediction},
  author = {Jisu Shin and Richard Shaw and Seunghyun Shin and Zhensong Zhang and Hae-Gon Jeon and Eduardo Perez-Pellitero},
  journal= {arXiv preprint arXiv:2507.15748},
  year   = {2025}
}
R2 v1 2026-07-01T04:11:40.870Z