English
Related papers

Related papers: Uncalibrated Neural Inverse Rendering for Photomet…

200 papers

In this paper, we present a groundbreaking spectrally multiplexed photometric stereo approach for recovering surface normals of dynamic surfaces without the need for calibrated lighting or sensors, a notable advancement in the field…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Satoshi Ikehata , Yuta Asano

Reconstructing an object's geometry and appearance from multiple images, also known as inverse rendering, is a fundamental problem in computer graphics and vision. Inverse rendering is inherently ill-posed because the captured image is an…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Akshat Dave , Yongyi Zhao , Ashok Veeraraghavan

We introduce InverseFaceNet, a deep convolutional inverse rendering framework for faces that jointly estimates facial pose, shape, expression, reflectance and illumination from a single input image. By estimating all parameters from just a…

Computer Vision and Pattern Recognition · Computer Science 2018-05-17 Hyeongwoo Kim , Michael Zollhöfer , Ayush Tewari , Justus Thies , Christian Richardt , Christian Theobalt

We propose a deep inverse rendering framework for indoor scenes. From a single RGB image of an arbitrary indoor scene, we create a complete scene reconstruction, estimating shape, spatially-varying lighting, and spatially-varying,…

Computer Vision and Pattern Recognition · Computer Science 2019-05-09 Zhengqin Li , Mohammad Shafiei , Ravi Ramamoorthi , Kalyan Sunkavalli , Manmohan Chandraker

We present a modern solution to the multi-view photometric stereo problem (MVPS). Our work suitably exploits the image formation model in a MVPS experimental setup to recover the dense 3D reconstruction of an object from images. We procure…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Berk Kaya , Suryansh Kumar , Francesco Sarno , Vittorio Ferrari , Luc Van Gool

Implicit neural representation has opened up new possibilities for inverse rendering. However, existing implicit neural inverse rendering methods struggle to handle strongly illuminated scenes with significant shadows and indirect…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Ziyi Yang , Yanzhen Chen , Xinyu Gao , Yazhen Yuan , Yu Wu , Xiaowei Zhou , Xiaogang Jin

Integrating inverse rendering with multi-view photometric stereo (MVPS) yields more accurate 3D reconstructions than the inverse rendering approaches that rely on fixed environment illumination. However, efficient inverse rendering with…

Graphics · Computer Science 2025-07-25 Yixiao Chen , Bin Liang , Hanzhi Guo , Yongqing Cheng , Jiayi Zhao , Dongdong Weng

Photometric stereo (PS) endeavors to ascertain surface normals using shading clues from photometric images under various illuminations. Recent deep learning-based PS methods often overlook the complexity of object surfaces. These neural…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Kaixuan Wang , Lin Qi , Shiyu Qin , Kai Luo , Yakun Ju , Xia Li , Junyu Dong

Deep neural networks have become a foundational tool for addressing imaging inverse problems. They are typically trained for a specific task, with a supervised loss to learn a mapping from the observations to the image to recover. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Matthieu Terris , Thomas Moreau

Many interesting tasks in image restoration can be cast as linear inverse problems. A recent family of approaches for solving these problems uses stochastic algorithms that sample from the posterior distribution of natural images given the…

Image and Video Processing · Electrical Eng. & Systems 2022-10-14 Bahjat Kawar , Michael Elad , Stefano Ermon , Jiaming Song

Ground-based solar image restoration is a computationally expensive procedure that involves nonlinear optimization techniques. The presence of atmospheric turbulence produces perturbations in individual images that make it necessary to…

Instrumentation and Methods for Astrophysics · Physics 2023-07-26 A. Asensio Ramos , S. Esteban Pozuelo , C. Kuckein

We introduce a new, integrated approach to uncalibrated photometric stereo. We perform 3D reconstruction of Lambertian objects using multiple images produced by unknown, directional light sources. We show how to formulate a single…

Computer Vision and Pattern Recognition · Computer Science 2017-02-03 Soumyadip Sengupta , Hao Zhou , Walter Forkel , Ronen Basri , Tom Goldstein , David W. Jacobs

Inverse Problems in medical imaging and computer vision are traditionally solved using purely model-based methods. Among those variational regularization models are one of the most popular approaches. We propose a new framework for applying…

Computer Vision and Pattern Recognition · Computer Science 2019-01-14 Sebastian Lunz , Ozan Öktem , Carola-Bibiane Schönlieb

In this paper we present a generalized Deep Learning-based approach for solving ill-posed large-scale inverse problems occuring in medical image reconstruction. Recently, Deep Learning methods using iterative neural networks and cascaded…

Image and Video Processing · Electrical Eng. & Systems 2020-08-26 Andreas Kofler , Markus Haltmeier , Tobias Schaeffter , Marc Kachelrieß , Marc Dewey , Christian Wald , Christoph Kolbitsch

This paper is concerned with the inverse problem of reconstructing an inhomogeneous medium from the acoustic far-field data at a fixed frequency in two dimensions. This inverse problem is severely ill-posed (and also strongly nonlinear),…

Numerical Analysis · Mathematics 2023-09-21 Kai Li , Bo Zhang , Haiwen Zhang

This paper introduces a versatile paradigm for integrating multi-view reflectance (optional) and normal maps acquired through photometric stereo. Our approach employs a pixel-wise joint re-parameterization of reflectance and normal,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Baptiste Brument , Robin Bruneau , Yvain Quéau , Jean Mélou , François Bernard Lauze , Jean-Denis , Jean-Denis Durou , Lilian Calvet

Intrinsic image decomposition, which is an essential task in computer vision, aims to infer the reflectance and shading of the scene. It is challenging since it needs to separate one image into two components. To tackle this, conventional…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Yunfei Liu , Yu Li , Shaodi You , Feng Lu

In recent years, deep neural networks have emerged as a solution for inverse imaging problems. These networks are generally trained using pairs of images: one degraded and the other of high quality, the latter being called 'ground truth'.…

Information Retrieval · Computer Science 2025-10-01 Victor Sechaud , Patrice Abry , Laurent Jacques , Julián Tachella

We aim to improve the Inverted Neural Radiance Fields (iNeRF) algorithm which defines the image pose estimation problem as a NeRF based iterative linear optimization. NeRFs are novel neural space representation models that can synthesize…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Ágoston István Csehi , Csaba Máté Józsa

The goal of photometric stereo is to measure the precise surface normal of a 3D object from observations with various shading cues. However, non-Lambertian surfaces influence the measurement accuracy due to irregular shading cues. Despite…

Computer Vision and Pattern Recognition · Computer Science 2021-07-16 Yakun Ju , Muwei Jian , Shaoxiang Guo , Yingyu Wang , Huiyu Zhou , Junyu Dong