English
Related papers

Related papers: Robust Photometric Stereo via Dictionary Learning

200 papers

This paper proposes an uncalibrated photometric stereo method for non-Lambertian scenes based on deep learning. Unlike previous approaches that heavily rely on assumptions of specific reflectances and light source distributions, our method…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Guanying Chen , Kai Han , Boxin Shi , Yasuyuki Matsushita , Kwan-Yee K. Wong

Highly accurate 3D volumetric reconstruction is still an open research topic where the main difficulty is usually related to merging some rough estimations with high frequency details. One of the most promising methods is the fusion between…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 Fotios Logothetis , Roberto Mecca , Roberto Cipolla

Reconstructing the 3D shape of an object using several images under different light sources is a very challenging task, especially when realistic assumptions such as light propagation and attenuation, perspective viewing geometry and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Fotios Logothetis , Ignas Budvytis , Roberto Mecca , Roberto Cipolla

This paper presents a technique for finding the surface normal of an object from a set of images obtained under different lighting positions. The method presented is based on the principles of Photometric Stereo (PS) combined with Optimum…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Hamza Gardi , Sebastian F. Walter , Christoph S. Garbe

Dictionary learning is the task of determining a data-dependent transform that yields a sparse representation of some observed data. The dictionary learning problem is non-convex, and usually solved via computationally complex iterative…

Machine Learning · Computer Science 2016-11-30 Cristian Rusu , Nuria Gonzalez-Prelcic , Robert Heath

This paper addresses the problem of estimating the shape of objects that exhibit spatially-varying reflectance. We assume that multiple images of the object are obtained under a fixed view-point and varying illumination, i.e., the setting…

Computer Vision and Pattern Recognition · Computer Science 2016-09-22 Zhuo Hui , Aswin C Sankaranarayanan

Photometric stereo, a problem of recovering 3D surface normals using images of an object captured under different lightings, has been of great interest and importance in computer vision research. Despite the success of existing traditional…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Ashish Tiwari , Shanmuganathan Raman

This paper introduces a versatile paradigm for integrating multi-view reflectance (optional) and normal maps acquired through photometric stereo. Our approach employs a pixel-wise joint re-parameterization of reflectance and normal,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Baptiste Brument , Robin Bruneau , Yvain Quéau , Jean Mélou , François Bernard Lauze , Jean-Denis , Jean-Denis Durou , Lilian Calvet

Multiview photometric stereo (MVPS) seeks to recover high-fidelity surface shapes and reflectances from images captured under varying views and illuminations. However, existing MVPS methods often require controlled darkroom settings for…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Songyun Yang , Yufei Han , Jilong Zhang , Kongming Liang , Peng Yu , Zhaowei Qu , Heng Guo

Multispectral photometric stereo(MPS) aims at recovering the surface normal of a scene from a single-shot multispectral image captured under multispectral illuminations. Existing MPS methods adopt the Lambertian reflectance model to make…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Jipeng Lv , Heng Guo , Guanying Chen , Jinxiu Liang , Boxin Shi

Most conventional photometric stereo algorithms inversely solve a BRDF-based image formation model. However, the actual imaging process is often far more complex due to the global light transport on the non-convex surfaces. This paper…

Computer Vision and Pattern Recognition · Computer Science 2018-08-31 Satoshi Ikehata

The problem of estimating a surface shape from its observed reflectance properties still remains a challenging task in computer vision. The presence of global illumination effects such as inter-reflections or cast shadows makes the task…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 David Honzátko , Engin Türetken , Pascal Fua , L. Andrea Dunbar

This paper proposes a novel approach to image deblurring and digital zooming using sparse local models of image appearance. These models, where small image patches are represented as linear combinations of a few elements drawn from some…

Machine Learning · Computer Science 2011-10-07 Florent Couzinie-Devy , Julien Mairal , Francis Bach , Jean Ponce

Methods for 3D reconstruction such as Photometric stereo recover the shape and reflectance properties using multiple images of an object taken with variable lighting conditions from a fixed viewpoint. Photometric stereo assumes that a scene…

Computer Vision and Pattern Recognition · Computer Science 2018-11-07 Anish R. Khadka , Paolo Remagnino , Vasileios Argyriou

This study explores the use of photometric techniques (shape-from-shading and uncalibrated photometric stereo) for upsampling the low-resolution depth map from an RGB-D sensor to the higher resolution of the companion RGB image. A…

Computer Vision and Pattern Recognition · Computer Science 2019-06-26 Bjoern Haefner , Songyou Peng , Alok Verma , Yvain Quéau , Daniel Cremers

Traditional reflection removal algorithms either use a single image as input, which suffers from intrinsic ambiguities, or use multiple images from a moving camera, which is inconvenient for users. We instead propose a learning-based…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Simon Niklaus , Xuaner Cecilia Zhang , Jonathan T. Barron , Neal Wadhwa , Rahul Garg , Feng Liu , Tianfan Xue

Retrieving accurate 3D reconstructions of objects from the way they reflect light is a very challenging task in computer vision. Despite more than four decades since the definition of the Photometric Stereo problem, most of the literature…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Fotios Logothetis , Ignas Budvytis , Roberto Mecca , Roberto Cipolla

Photometric stereo provides an important method for high-fidelity 3D reconstruction based on multiple intensity images captured under different illumination directions. In this paper, we present a complete framework, including a multilight…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Yanlong Cao , Binjie Ding , Zewei He , Jiangxin Yang , Jingxi Chen , Yanpeng Cao , Xin Li

Recent state-of-the-art algorithms in photometric stereo rely on neural networks and operate either through prior learning or inverse rendering optimization. Here, we revisit the problem of calibrated photometric stereo by leveraging recent…

Image and Video Processing · Electrical Eng. & Systems 2025-07-10 Matéo Ducastel , David Tschumperlé , Yvain Quéau

State-of-the-art learned reconstruction methods often rely on black-box modules that, despite their strong performance, raise questions about their interpretability and robustness. Here, we build on a recently proposed image reconstruction…

Image and Video Processing · Electrical Eng. & Systems 2026-05-19 Joshua Schulz , David Schote , Christoph Kolbitsch , Kostas Papafitsoros , Andreas Kofler