English
Related papers

Related papers: Differentiable Mobile Display Photometric Stereo

200 papers

In this work we present a novel multi-view photometric stereo (MVPS) method. Like many works in 3D reconstruction we are leveraging neural shape representations and learnt renderers. However, our work differs from the state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Fotios Logothetis , Ignas Budvytis , Roberto Cipolla

With the developments of dual-lens camera modules,depth information representing the third dimension of thecaptured scenes becomes available for smartphones. It isestimated by stereo matching algorithms, taking as input thetwo views…

Computer Vision and Pattern Recognition · Computer Science 2018-09-27 Ruichao Xiao , Wenxiu Sun , Jiahao Pang , Qiong Yan , Jimmy Ren

Images captured in participating media such as murky water, fog, or smoke are degraded by scattered light. Thus, the use of traditional three-dimensional (3D) reconstruction techniques in such environments is difficult. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2018-04-11 Yuki Fujimura , Masaaki Iiyama , Atsushi Hashimoto , Michihiko Minoh

In this paper, we present a groundbreaking spectrally multiplexed photometric stereo approach for recovering surface normals of dynamic surfaces without the need for calibrated lighting or sensors, a notable advancement in the field…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Satoshi Ikehata , Yuta Asano

Photometric stereo is a method for estimating the normal vectors of an object from images of the object under varying lighting conditions. Motivated by several recent works that extend photometric stereo to more general objects and lighting…

Computer Vision and Pattern Recognition · Computer Science 2017-10-03 Andrew J. Wagenmaker , Brian E. Moore , Raj Rao Nadakuditi

Hyperspectral 3D imaging captures both depth maps and hyperspectral images, enabling comprehensive geometric and material analysis. Recent methods achieve high spectral and depth accuracy; however, they require long acquisition times often…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Suhyun Shin , Seungwoo Yoon , Ryota Maeda , Seung-Hwan Baek

Photometric stereo (PS) is a fundamental technique in computer vision known to produce 3-D shape with high accuracy. The setting of PS is defined by using several input images of a static scene taken from one and the same camera position…

Computer Vision and Pattern Recognition · Computer Science 2017-09-06 Maryam Khanian , Ali Sharifi Boroujerdi , Michael Breuß

Uncalibrated photometric stereo is proposed to estimate the detailed surface normal from images under varying and unknown lightings. Recently, deep learning brings powerful data priors to this underdetermined problem. This paper presents a…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Fangzhou Gao , Meng Wang , Lianghao Zhang , Li Wang , Jiawan Zhang

Photometric stereo is a method that seeks to reconstruct the normal vectors of an object from a set of images of the object illuminated under different light sources. While effective in some situations, classical photometric stereo relies…

Computer Vision and Pattern Recognition · Computer Science 2018-08-09 Andrew J. Wagenmaker , Brian E. Moore , Raj Rao Nadakuditi

We present a 3D printed adapter with planar mirrors for stereo reconstruction using front and back smartphone camera. The adapter presents a practical and low-cost solution for enabling any smartphone to be used as a stereo camera, which is…

Computer Vision and Pattern Recognition · Computer Science 2021-09-27 Kristijan Bartol , David Bojanić , Tomislav Petković , Tomislav Pribanić

Multispectral photometric stereo(MPS) aims at recovering the surface normal of a scene from a single-shot multispectral image captured under multispectral illuminations. Existing MPS methods adopt the Lambertian reflectance model to make…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Jipeng Lv , Heng Guo , Guanying Chen , Jinxiu Liang , Boxin Shi

Depth from defocus (DfD) and stereo matching are two most studied passive depth sensing schemes. The techniques are essentially complementary: DfD can robustly handle repetitive textures that are problematic for stereo matching whereas…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Zhang Chen , Xinqing Guo , Siyuan Li , Xuan Cao , Jingyi Yu

We conduct a thorough study of photometric stereo under nearby point light source illumination, from modeling to numerical solution, through calibration. In the classical formulation of photometric stereo, the luminous fluxes are assumed to…

Computer Vision and Pattern Recognition · Computer Science 2017-09-05 Yvain Quéau , Bastien Durix , Tao Wu , Daniel Cremers , François Lauze , Jean-Denis Durou

This paper proposes an uncalibrated photometric stereo method for non-Lambertian scenes based on deep learning. Unlike previous approaches that heavily rely on assumptions of specific reflectances and light source distributions, our method…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Guanying Chen , Kai Han , Boxin Shi , Yasuyuki Matsushita , Kwan-Yee K. Wong

Neural approaches have shown a significant progress on camera-based reconstruction. But they require either a fairly dense sampling of the viewing sphere, or pre-training on an existing dataset, thereby limiting their generalizability. In…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Mohammed Brahimi , Bjoern Haefner , Zhenzhang Ye , Bastian Goldluecke , Daniel Cremers

Reconstruction-based methods have been commonly used for unsupervised anomaly detection, in which a normal image is reconstructed and compared with the given test image to detect and locate anomalies. Recently, diffusion models have shown…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Di Wu , Shicai Fan , Xue Zhou , Li Yu , Yuzhong Deng , Jianxiao Zou , Baihong Lin

This study explores the use of photometric techniques (shape-from-shading and uncalibrated photometric stereo) for upsampling the low-resolution depth map from an RGB-D sensor to the higher resolution of the companion RGB image. A…

Computer Vision and Pattern Recognition · Computer Science 2019-06-26 Bjoern Haefner , Songyou Peng , Alok Verma , Yvain Quéau , Daniel Cremers

Achieving robust stereo 3D imaging under diverse illumination conditions is an important however challenging task, due to the limited dynamic ranges (DRs) of cameras, which are significantly smaller than real world DR. As a result, the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Juhyung Choi , Jinnyeong Kim , Seokjun Choi , Jinwoo Lee , Samuel Brucker , Mario Bijelic , Felix Heide , Seung-Hwan Baek

We propose Stereo Direct Sparse Odometry (Stereo DSO) as a novel method for highly accurate real-time visual odometry estimation of large-scale environments from stereo cameras. It jointly optimizes for all the model parameters within the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-29 Rui Wang , Martin Schwörer , Daniel Cremers

This paper proposes a novel approach to spectral computed tomography (CT) material decomposition that uses the recent advances in generative diffusion models (DMs) for inverse problems. Spectral CT and more particularly photon-counting CT…