English
Related papers

Related papers: Self-calibrating Photometric Stereo by Neural Inve…

200 papers

Inverse rendering of an object under entirely unknown capture conditions is a fundamental challenge in computer vision and graphics. Neural approaches such as NeRF have achieved photorealistic results on novel view synthesis, but they…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Mark Boss , Andreas Engelhardt , Abhishek Kar , Yuanzhen Li , Deqing Sun , Jonathan T. Barron , Hendrik P. A. Lensch , Varun Jampani

Inverse rendering aims to estimate physical attributes of a scene, e.g., reflectance, geometry, and lighting, from image(s). Inverse rendering has been studied primarily for single objects or with methods that solve for only one of the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Soumyadip Sengupta , Jinwei Gu , Kihwan Kim , Guilin Liu , David W. Jacobs , Jan Kautz

Surface reconstruction with differentiable rendering has achieved impressive performance in recent years, yet the pervasive photometric ambiguities have strictly bottlenecked existing approaches. This paper presents AmbiSuR, a framework…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Jiahe Li , Jiawei Zhang , Xiao Bai , Jin Zheng , Xiaohan Yu , Lin Gu , Gim Hee Lee

Inverse rendering aims to reconstruct the scene properties of objects solely from multiview images. However, it is an ill-posed problem prone to producing ambiguous estimations deviating from physically accurate representations. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Georgios Kouros , Minye Wu , Sushruth Nagesh , Xianling Zhang , Tinne Tuytelaars

Reconstructing an object's high-quality 3D shape with inherent spectral reflectance property, beyond typical device-dependent RGB albedos, opens the door to applications requiring a high-fidelity 3D model in terms of both geometry and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Chunyu Li , Yusuke Monno , Masatoshi Okutomi

Fine-detailed reconstructions are in high demand in many applications. However, most of the existing RGB-D reconstruction methods rely on pre-calculated accurate camera poses to recover the detailed surface geometry, where the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Lu Sang , Bjoern Haefner , Xingxing Zuo , Daniel Cremers

The problem of estimating a surface shape from its observed reflectance properties still remains a challenging task in computer vision. The presence of global illumination effects such as inter-reflections or cast shadows makes the task…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 David Honzátko , Engin Türetken , Pascal Fua , L. Andrea Dunbar

This paper proposes a simple, accurate, and robust approach to single image nonparametric blind Super-Resolution (SR). This task is formulated as a functional to be minimized with respect to both an intermediate super-resolved image and a…

Computer Vision and Pattern Recognition · Computer Science 2015-03-17 Wen-Ze Shao , Michael Elad

We present a method for the accurate 3D reconstruction of partly-symmetric objects. We build on the strengths of recent advances in neural reconstruction and rendering such as Neural Radiance Fields (NeRF). A major shortcoming of such…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Eldar Insafutdinov , Dylan Campbell , João F. Henriques , Andrea Vedaldi

We present a method to edit complex indoor lighting from a single image with its predicted depth and light source segmentation masks. This is an extremely challenging problem that requires modeling complex light transport, and disentangling…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Zhengqin Li , Jia Shi , Sai Bi , Rui Zhu , Kalyan Sunkavalli , Miloš Hašan , Zexiang Xu , Ravi Ramamoorthi , Manmohan Chandraker

The most prevalent routine for camera calibration is based on the detection of well-defined feature points on a purpose-made calibration artifact. These could be checkerboard saddle points, circles, rings or triangles, often printed on a…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Morten Hannemose , Jakob Wilm , Jeppe Revall Frisvad

This paper addresses the problem of estimating the shape of objects that exhibit spatially-varying reflectance. We assume that multiple images of the object are obtained under a fixed view-point and varying illumination, i.e., the setting…

Computer Vision and Pattern Recognition · Computer Science 2016-09-22 Zhuo Hui , Aswin C Sankaranarayanan

We introduce a novel learning-based method to reconstruct the high-quality geometry and complex, spatially-varying BRDF of an arbitrary object from a sparse set of only six images captured by wide-baseline cameras under collocated point…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Sai Bi , Zexiang Xu , Kalyan Sunkavalli , David Kriegman , Ravi Ramamoorthi

Multiview photometric stereo (MVPS) seeks to recover high-fidelity surface shapes and reflectances from images captured under varying views and illuminations. However, existing MVPS methods often require controlled darkroom settings for…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Songyun Yang , Yufei Han , Jilong Zhang , Kongming Liang , Peng Yu , Zhaowei Qu , Heng Guo

This study explores the use of photometric techniques (shape-from-shading and uncalibrated photometric stereo) for upsampling the low-resolution depth map from an RGB-D sensor to the higher resolution of the companion RGB image. A…

Computer Vision and Pattern Recognition · Computer Science 2019-06-26 Bjoern Haefner , Songyou Peng , Alok Verma , Yvain Quéau , Daniel Cremers

Precise calibration is a must for high reliance 3D computer vision algorithms. A challenging case is when the camera is behind a protective glass or transparent object: due to refraction, the image is heavily distorted; the pinhole camera…

Computer Vision and Pattern Recognition · Computer Science 2019-09-25 Szabolcs Pável , Csanád Sándor , Lehel Csató

Active-stereo-based 3D shape measurement is crucial for various purposes, such as industrial inspection, reverse engineering, and medical systems, due to its strong ability to accurately acquire the shape of textureless objects. Active…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Ryo Furukawa , Kota Nishihara , Hiroshi Kawasaki

A novel depth super-resolution approach for RGB-D sensors is presented. It disambiguates depth super-resolution through high-resolution photometric clues and, symmetrically, it disambiguates uncalibrated photometric stereo through…

Computer Vision and Pattern Recognition · Computer Science 2017-08-25 Songyou Peng , Bjoern Haefner , Yvain Quéau , Daniel Cremers

Implicit neural representation has opened up new possibilities for inverse rendering. However, existing implicit neural inverse rendering methods struggle to handle strongly illuminated scenes with significant shadows and indirect…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Ziyi Yang , Yanzhen Chen , Xinyu Gao , Yazhen Yuan , Yu Wu , Xiaowei Zhou , Xiaogang Jin

Photometric stereo refers to the process to compute the 3D shape of an object using information on illumination and reflectance from several input images from the same point of view. The most often used reflectance model is the Lambertian…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Georg Radow , Michael Breuß