English
Related papers

Related papers: SupeRVol: Super-Resolution Shape and Reflectance E…

200 papers

We present a differentiable volume rendering solution that provides differentiability of all continuous parameters of the volume rendering process. This differentiable renderer is used to steer the parameters towards a setting with an…

Graphics · Computer Science 2022-07-26 Sebastian Weiss , Rüdiger Westermann

Various SDF-based neural implicit surface reconstruction methods have been proposed recently, and have demonstrated remarkable modeling capabilities. However, due to the global nature and limited representation ability of a single network,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Leyuan Yang , Bailin Deng , Juyong Zhang

Indoor scenes typically exhibit complex, spatially-varying appearance from global illumination, making inverse rendering a challenging ill-posed problem. This work presents an end-to-end, learning-based inverse rendering framework…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Jingsen Zhu , Fujun Luan , Yuchi Huo , Zihao Lin , Zhihua Zhong , Dianbing Xi , Jiaxiang Zheng , Rui Tang , Hujun Bao , Rui Wang

Reconstruction and intrinsic decomposition of scenes from captured imagery would enable many applications such as relighting and virtual object insertion. Recent NeRF based methods achieve impressive fidelity of 3D reconstruction, but bake…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Zian Wang , Tianchang Shen , Jun Gao , Shengyu Huang , Jacob Munkberg , Jon Hasselgren , Zan Gojcic , Wenzheng Chen , Sanja Fidler

Image super-resolution (SR) is a field in computer vision that focuses on reconstructing high-resolution images from the respective low-resolution image. However, super-resolution is a well-known ill-posed problem as most methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Athiya Deviyani , Efe Sinan Hoplamaz , Alan Savio Paul

Neural reconstruction and rendering strategies have demonstrated state-of-the-art performances due, in part, to their ability to preserve high level shape details. Existing approaches, however, either represent objects as implicit surface…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Angtian Wang , Yuanlu Xu , Nikolaos Sarafianos , Robert Maier , Edmond Boyer , Alan Yuille , Tony Tung

Mathematically representing the shape of an object is a key ingredient for solving inverse rendering problems. Explicit representations like meshes are efficient to render in a differentiable fashion but have difficulties handling topology…

Graphics · Computer Science 2022-07-12 Guangyan Cai , Kai Yan , Zhao Dong , Ioannis Gkioulekas , Shuang Zhao

Estimating surface reflectance (BRDF) is one key component for complete 3D scene capture, with wide applications in virtual reality, augmented reality, and human computer interaction. Prior work is either limited to controlled environments…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Kihwan Kim , Jinwei Gu , Stephen Tyree , Pavlo Molchanov , Matthias Nießner , Jan Kautz

We propose SDFDiff, a novel approach for image-based shape optimization using differentiable rendering of 3D shapes represented by signed distance functions (SDFs). Compared to other representations, SDFs have the advantage that they can…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Yue Jiang , Dantong Ji , Zhizhong Han , Matthias Zwicker

Monte Carlo rendering of translucent objects with heterogeneous scattering properties is often expensive both in terms of memory and computation. If we do path tracing and use a high dynamic range lighting environment, the rendering becomes…

Graphics · Computer Science 2025-03-28 Thomson TG , Jeppe Revall Frisvad , Ravi Ramamoorthi , Henrik Wann Jensen

We present NeRSP, a Neural 3D reconstruction technique for Reflective surfaces with Sparse Polarized images. Reflective surface reconstruction is extremely challenging as specular reflections are view-dependent and thus violate the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Yufei Han , Heng Guo , Koki Fukai , Hiroaki Santo , Boxin Shi , Fumio Okura , Zhanyu Ma , Yunpeng Jia

We present a topology-informed inverse rendering approach for reconstructing high-genus surface meshes from multi-view images. Compared to 3D representations like voxels and point clouds, mesh-based representations are preferred as they…

Inverse rendering of an object under entirely unknown capture conditions is a fundamental challenge in computer vision and graphics. Neural approaches such as NeRF have achieved photorealistic results on novel view synthesis, but they…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Mark Boss , Andreas Engelhardt , Abhishek Kar , Yuanzhen Li , Deqing Sun , Jonathan T. Barron , Hendrik P. A. Lensch , Varun Jampani

Inverse rendering seeks to reconstruct both geometry and spatially varying BRDFs (SVBRDFs) from captured images. To address the inherent ill-posedness of inverse rendering, basis BRDF representations are commonly used, modeling SVBRDFs as…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Hoon-Gyu Chung , Seokjun Choi , Seung-Hwan Baek

In this work, we address the problem of jointly estimating albedo, normals, depth and 3D spatially-varying lighting from a single image. Most existing methods formulate the task as image-to-image translation, ignoring the 3D properties of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Zian Wang , Jonah Philion , Sanja Fidler , Jan Kautz

In this paper, we propose a novel end-to-end relightable neural inverse rendering system that achieves high-quality reconstruction of geometry and material properties, thus enabling high-quality relighting. The cornerstone of our method is…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Deheng Zhang , Jingyu Wang , Shaofei Wang , Marko Mihajlovic , Sergey Prokudin , Hendrik P. A. Lensch , Siyu Tang

We introduce InverseFaceNet, a deep convolutional inverse rendering framework for faces that jointly estimates facial pose, shape, expression, reflectance and illumination from a single input image. By estimating all parameters from just a…

Computer Vision and Pattern Recognition · Computer Science 2018-05-17 Hyeongwoo Kim , Michael Zollhöfer , Ayush Tewari , Justus Thies , Christian Richardt , Christian Theobalt

In this paper we explain a process of super-resolution reconstruction allowing to increase the resolution of an image.The need for high-resolution digital images exists in diverse domains, for example the medical and spatial domains. The…

Image and Video Processing · Electrical Eng. & Systems 2022-12-07 Sebastien Lablanche , Gerard Lablanche

Most single image super-resolution (SR) methods are developed on synthetic low-resolution (LR) and high-resolution (HR) image pairs, which are simulated by a predetermined degradation operation, e.g., bicubic downsampling. However, these…

Image and Video Processing · Electrical Eng. & Systems 2021-10-22 Rui Ma , Johnathan Czernik , Xian Du

In this work, we use multi-view aerial images to reconstruct the geometry, lighting, and material of facades using neural signed distance fields (SDFs). Without the requirement of complex equipment, our method only takes simple RGB images…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Zixuan Xie , Rengan Xie , Rong Li , Kai Huang , Pengju Qiao , Jingsen Zhu , Xu Yin , Qi Ye , Wei Hua , Yuchi Huo , Hujun Bao