English

GAINS: Gaussian-based Inverse Rendering from Sparse Multi-View Captures

Computer Vision and Pattern Recognition 2025-12-11 v1

Abstract

Recent advances in Gaussian Splatting-based inverse rendering extend Gaussian primitives with shading parameters and physically grounded light transport, enabling high-quality material recovery from dense multi-view captures. However, these methods degrade sharply under sparse-view settings, where limited observations lead to severe ambiguity between geometry, reflectance, and lighting. We introduce GAINS (Gaussian-based Inverse rendering from Sparse multi-view captures), a two-stage inverse rendering framework that leverages learning-based priors to stabilize geometry and material estimation. GAINS first refines geometry using monocular depth/normal and diffusion priors, then employs segmentation, intrinsic image decomposition (IID), and diffusion priors to regularize material recovery. Extensive experiments on synthetic and real-world datasets show that GAINS significantly improves material parameter accuracy, relighting quality, and novel-view synthesis compared to state-of-the-art Gaussian-based inverse rendering methods, especially under sparse-view settings. Project page: https://patrickbail.github.io/gains/

Keywords

Cite

@article{arxiv.2512.09925,
  title  = {GAINS: Gaussian-based Inverse Rendering from Sparse Multi-View Captures},
  author = {Patrick Noras and Jun Myeong Choi and Didier Stricker and Pieter Peers and Roni Sengupta},
  journal= {arXiv preprint arXiv:2512.09925},
  year   = {2025}
}

Comments

23 pages, 18 figures

R2 v1 2026-07-01T08:19:19.071Z