English
Related papers

Related papers: ReLi3D: Relightable Multi-view 3D Reconstruction w…

200 papers

Recent advances in implicit neural representations and differentiable rendering make it possible to simultaneously recover the geometry and materials of an object from multi-view RGB images captured under unknown static illumination.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Yuanqing Zhang , Jiaming Sun , Xingyi He , Huan Fu , Rongfei Jia , Xiaowei Zhou

We investigate the problem of learning category-specific 3D shape reconstruction from a variable number of RGB views of previously unobserved object instances. Most approaches for multiview shape reconstruction operate on sparse shape…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Srinath Sridhar , Davis Rempe , Julien Valentin , Sofien Bouaziz , Leonidas J. Guibas

Single-image 3D human reconstruction aims to reconstruct the 3D textured surface of the human body given a single image. While implicit function-based methods recently achieved reasonable reconstruction performance, they still bear…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Gyumin Shim , Minsoo Lee , Jaegul Choo

Multi-view 3D surface reconstruction using neural implicit representations has made notable progress by modeling the geometry and view-dependent radiance fields within a unified framework. However, their effectiveness in reconstructing…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Zijie Jiang , Tianhan Xu , Hiroharu Kato

Single-photon light detection and ranging (lidar) captures depth and intensity information of a 3D scene. Reconstructing a scene from observed photons is a challenging task due to spurious detections associated with background illumination…

Image and Video Processing · Electrical Eng. & Systems 2022-03-03 Julián Tachella , Michael P. Sheehan , Mike E. Davies

We present a volume rendering-based neural surface reconstruction method that takes as few as three disparate RGB images as input. Our key idea is to regularize the reconstruction, which is severely ill-posed and leaving significant gaps…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Aditya Vora , Akshay Gadi Patil , Hao Zhang

Intrinsic decomposition from a single image is a highly challenging task, due to its inherent ambiguity and the scarcity of training data. In contrast to traditional fully supervised learning approaches, in this paper we propose learning…

Computer Vision and Pattern Recognition · Computer Science 2018-02-07 Michael Janner , Jiajun Wu , Tejas D. Kulkarni , Ilker Yildirim , Joshua B. Tenenbaum

We propose SparseFusion, a sparse view 3D reconstruction approach that unifies recent advances in neural rendering and probabilistic image generation. Existing approaches typically build on neural rendering with re-projected features but…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Zhizhuo Zhou , Shubham Tulsiani

Efficiently reconstructing 3D scenes from monocular video remains a core challenge in computer vision, vital for applications in virtual reality, robotics, and scene understanding. Recently, frame-by-frame progressive reconstruction without…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Wenyan Cong , Hanqing Zhu , Kevin Wang , Jiahui Lei , Colton Stearns , Yuanhao Cai , Leonidas Guibas , Zhangyang Wang , Zhiwen Fan

Although diffusion-based models can generate high-quality and high-resolution video sequences from textual or image inputs, they lack explicit integration of geometric cues when controlling scene lighting and visual appearance across…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Yuanze Lin , Yi-Wen Chen , Yi-Hsuan Tsai , Ronald Clark , Ming-Hsuan Yang

This paper introduces 3DFIRES, a novel system for scene-level 3D reconstruction from posed images. Designed to work with as few as one view, 3DFIRES reconstructs the complete geometry of unseen scenes, including hidden surfaces. With…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Linyi Jin , Nilesh Kulkarni , David Fouhey

Previous image based relighting methods require capturing multiple images to acquire high frequency lighting effect under different lighting conditions, which needs nontrivial effort and may be unrealistic in certain practical use…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Di Qiu , Jin Zeng , Zhanghan Ke , Wenxiu Sun , Chengxi Yang

Reconstructing an object from photos and placing it virtually in a new environment goes beyond the standard novel view synthesis task as the appearance of the object has to not only adapt to the novel viewpoint but also to the new lighting…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Benjamin Ummenhofer , Sanskar Agrawal , Rene Sepulveda , Yixing Lao , Kai Zhang , Tianhang Cheng , Stephan Richter , Shenlong Wang , German Ros

Feed-forward 3D reconstruction has revolutionized 3D vision, providing a powerful baseline for downstream tasks such as novel-view synthesis with 3D Gaussian Splatting. Previous works explore fixing the corrupted rendering results with a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yiming Huang , Baixiang Huang , Beilei Cui , Chi Kit Ng , Long Bai , Hongliang Ren

Recovering the geometry and materials of objects from a single image is challenging due to its under-constrained nature. In this paper, we present Neural LightRig, a novel framework that boosts intrinsic estimation by leveraging auxiliary…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Zexin He , Tengfei Wang , Xin Huang , Xingang Pan , Ziwei Liu

Low-light 3D reconstruction from sparse views remains challenging due to exposure imbalance and degraded color fidelity. While existing methods struggle with view inconsistency and require per-scene training, we propose SplatBright, which…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Yue Wen , Liang Song , Hesheng Wang

Underwater image degradation poses significant challenges for 3D reconstruction, where simplified physical models often fail in complex scenes. We propose \textbf{R-Splatting}, a unified framework that bridges underwater image restoration…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Guoxi Huang , Haoran Wang , Zipeng Qi , Wenjun Lu , David Bull , Nantheera Anantrasirichai

The rapid development of Large Multimodal Models (LMMs) has led to remarkable progress in 2D visual understanding; however, extending these capabilities to 3D scene understanding remains a significant challenge. Existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Hongpei Zheng , Lintao Xiang , Qijun Yang , Qian Lin , Hujun Yin

Rendering realistic images from 3D reconstruction is an essential task of many Computer Vision and Robotics pipelines, notably for mixed-reality applications as well as training autonomous agents in simulated environments. However, the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Lukas Bösiger , Mihai Dusmanu , Marc Pollefeys , Zuria Bauer

Enhancing low-light traffic images is crucial for reliable perception in autonomous driving, intelligent transportation, and urban surveillance systems. Nighttime and dimly lit traffic scenes often suffer from poor visibility due to low…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Siddiqua Namrah