English

GHOST: Geometry-Guided Hallucination of Opaque Surface Textures

Computer Vision and Pattern Recognition 2026-07-13 v1

Abstract

Transparent objects pose a fundamental challenge for depth estimation and 3D reconstruction due to their violation of Lambertian assumptions, leading to severe geometry degradation in downstream tasks. To address this, we propose a novel geometry-guided preprocessing framework \textbf{GHOST} that leverages visual foundation models to transform transparent regions into opaque, structurally consistent representations without requiring downstream model retraining. Specifically, our pipeline utilizes (1) \textbf{TransDINO} and (2) \textbf{TransDecomp} to disentangle masks and transparency physical properties, while (3) \textbf{DAF-Net} recovers surface normal priors to encode geometric curvature. Subsequently, (4) \textbf{GeoSemTransNet} integrates these multi-modal cues to synthesize a texture-rich opaque RGB image that preserves the transparent object's 3D structure. Extensive experiments demonstrate that our method significantly enhances the accuracy of state-of-the-art depth estimation and reconstruction models on transparent objects by restoring essential photometric cues.

Keywords

Cite

@article{arxiv.2607.11118,
  title  = {GHOST: Geometry-Guided Hallucination of Opaque Surface Textures},
  author = {Langxu Zhao and Zuan Gu and Tianhan Gao},
  journal= {arXiv preprint arXiv:2607.11118},
  year   = {2026}
}