English
Related papers

Related papers: Shape, Light, and Material Decomposition from Imag…

200 papers

We present MatDecompSDF, a novel framework for recovering high-fidelity 3D shapes and decomposing their physically-based material properties from multi-view images. The core challenge of inverse rendering lies in the ill-posed…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Chengyu Wang , Isabella Bennett , Henry Scott , Liang Zhang , Mei Chen , Hao Li , Rui Zhao

Image denoising is still a challenging issue in many computer vision sub-domains. Recent studies show that significant improvements are made possible in a supervised setting. However, few challenges, such as spatial fidelity and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Masud An Nur Islam Fahim , Nazmus Saqib , Shafkat Khan Siam , Ho Yub Jung

The validation of a previous work on the optimization of material discrimination in spectral x-ray imaging is reported. Using Monte Carlo simulations based on the BEAMnrc package, material decomposition was performed on the projection…

Medical Physics · Physics 2015-06-18 Syen J. Nik , Rune S. Thing , Richard Watts , Tony Dale , Bryn Currie , Juergen Meyer

Existing time-resolved non-line-of-sight (NLOS) imaging methods reconstruct hidden scenes by inverting the optical paths of indirect illumination measured at visible relay surfaces. These methods are prone to reconstruction artifacts due to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Kiseok Choi , Inchul Kim , Dongyoung Choi , Julio Marco , Diego Gutierrez , Min H. Kim

Intrinsic decomposition is a fundamental mid-level vision problem that plays a crucial role in various inverse rendering and computational photography pipelines. Generating highly accurate intrinsic decompositions is an inherently…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Chris Careaga , Yağız Aksoy

Inverse rendering is the problem of decomposing an image into its intrinsic components, i.e. albedo, normal and lighting. To solve this ill-posed problem from single image, state-of-the-art methods in shape from shading mostly resort to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Mona Zehni , Shaona Ghosh , Krishna Sridhar , Sethu Raman

Implicit neural representation has opened up new possibilities for inverse rendering. However, existing implicit neural inverse rendering methods struggle to handle strongly illuminated scenes with significant shadows and indirect…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Ziyi Yang , Yanzhen Chen , Xinyu Gao , Yazhen Yuan , Yu Wu , Xiaowei Zhou , Xiaogang Jin

Imaging in low light is challenging due to low photon count and low SNR. Short-exposure images suffer from noise, while long exposure can induce blur and is often impractical. A variety of denoising, deblurring, and enhancement techniques…

Computer Vision and Pattern Recognition · Computer Science 2018-05-08 Chen Chen , Qifeng Chen , Jia Xu , Vladlen Koltun

In this paper, we address the problem of dense 3D reconstruction from multiple view images subject to strong lighting variations. In this regard, a new piecewise framework is proposed to explicitly take into account the change of…

Computer Vision and Pattern Recognition · Computer Science 2015-03-18 Reza Sabzevari , Vittori Murino , Alessio Del Bue

A fundamental problem in computer vision is that of inferring the intrinsic, 3D structure of the world from flat, 2D images of that world. Traditional methods for recovering scene properties such as shape, reflectance, or illumination rely…

Computer Vision and Pattern Recognition · Computer Science 2020-10-09 Jonathan T. Barron , Jitendra Malik

In this work we address the challenging problem of multiview 3D surface reconstruction. We introduce a neural network architecture that simultaneously learns the unknown geometry, camera parameters, and a neural renderer that approximates…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Lior Yariv , Yoni Kasten , Dror Moran , Meirav Galun , Matan Atzmon , Ronen Basri , Yaron Lipman

Intrinsic image decomposition, which is an essential task in computer vision, aims to infer the reflectance and shading of the scene. It is challenging since it needs to separate one image into two components. To tackle this, conventional…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Yunfei Liu , Yu Li , Shaodi You , Feng Lu

Reconstructing 3D assets from images has long required separate pipelines for geometry reconstruction, material estimation, and illumination recovery, each with distinct limitations and computational overhead. We present ReLi3D, the first…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Jan-Niklas Dihlmann , Mark Boss , Simon Donne , Andreas Engelhardt , Hendrik P. A. Lensch , Varun Jampani

Multi-view 3D object detection systems often struggle with generating precise predictions due to the challenges in estimating depth from images, increasing redundant and incorrect detections. Our paper presents Ray Denoising, an innovative…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Feng Liu , Tengteng Huang , Qianjing Zhang , Haotian Yao , Chi Zhang , Fang Wan , Qixiang Ye , Yanzhao Zhou

We develop a method that recovers the surface, materials, and illumination of a scene from its posed multi-view images. In contrast to prior work, it does not require any additional data and can handle glossy objects or bright lighting. It…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Yue Fan , Ningjing Fan , Ivan Skorokhodov , Oleg Voynov , Savva Ignatyev , Evgeny Burnaev , Peter Wonka , Yiqun Wang

Infrared image helps improve the perception capabilities of autonomous driving in complex weather conditions such as fog, rain, and low light. However, infrared image often suffers from low contrast, especially in non-heat-emitting targets…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Siyuan Chai , Xiaodong Guo , Tong Liu

Geometry reconstruction of textureless, non-Lambertian objects under unknown natural illumination (i.e., in the wild) remains challenging as correspondences cannot be established and the reflectance cannot be expressed in simple analytical…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Kohei Yamashita , Shohei Nobuhara , Ko Nishino

In this paper, we propose a novel end-to-end relightable neural inverse rendering system that achieves high-quality reconstruction of geometry and material properties, thus enabling high-quality relighting. The cornerstone of our method is…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Deheng Zhang , Jingyu Wang , Shaofei Wang , Marko Mihajlovic , Sergey Prokudin , Hendrik P. A. Lensch , Siyu Tang

In this paper, we present a novel differentiable point-based rendering framework to achieve photo-realistic relighting. To make the reconstructed scene relightable, we enhance vanilla 3D Gaussians by associating extra properties, including…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Jian Gao , Chun Gu , Youtian Lin , Zhihao Li , Hao Zhu , Xun Cao , Li Zhang , Yao Yao

We propose a scene-level inverse rendering framework that uses multi-view images to decompose the scene into geometry, a SVBRDF, and 3D spatially-varying lighting. Because multi-view images provide a variety of information about the scene,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 JunYong Choi , SeokYeong Lee , Haesol Park , Seung-Won Jung , Ig-Jae Kim , Junghyun Cho