English
Related papers

Related papers: Path Verification for Dynamic Indirect Illuminatio…

200 papers

We present a method to estimate lighting from a single image of an indoor scene. Previous work has used an environment map representation that does not account for the localized nature of indoor lighting. Instead, we represent lighting as a…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Marc-André Gardner , Yannick Hold-Geoffroy , Kalyan Sunkavalli , Christian Gagné , Jean-François Lalonde

While ray tracing has become increasingly common and path tracing is well understood by now, a major challenge lies in crafting an easy-to-use and efficient system implementing these technologies. Following a purely physically-based…

We present a differentiable ray-tracing based novel face reconstruction approach where scene attributes - 3D geometry, reflectance (diffuse, specular and roughness), pose, camera parameters, and scene illumination - are estimated from…

Computer Vision and Pattern Recognition · Computer Science 2021-01-15 Abdallah Dib , Gaurav Bharaj , Junghyun Ahn , Cédric Thébault , Philippe-Henri Gosselin , Marco Romeo , Louis Chevallier

We show how to insert an object from one image to another and get realistic results in the hard case, where the shading of the inserted object clashes with the shading of the scene. Rendering objects using an illumination model of the scene…

Computer Vision and Pattern Recognition · Computer Science 2022-09-14 Anand Bhattad , David A. Forsyth

In this paper, we present a novel differentiable point-based rendering framework to achieve photo-realistic relighting. To make the reconstructed scene relightable, we enhance vanilla 3D Gaussians by associating extra properties, including…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Jian Gao , Chun Gu , Youtian Lin , Zhihao Li , Hao Zhu , Xun Cao , Li Zhang , Yao Yao

In inverse rendering, accurately modeling visibility and indirect radiance for incident light is essential for capturing secondary effects. Due to the absence of a powerful Gaussian ray tracer, previous 3DGS-based methods have either…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Chun Gu , Xiaofei Wei , Zixuan Zeng , Yuxuan Yao , Li Zhang

Recently neural volumetric representations such as neural reflectance fields have been widely applied to faithfully reproduce the appearance of real-world objects and scenes under novel viewpoints and lighting conditions. However, it…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Mohammad Shafiei , Sai Bi , Zhengqin Li , Aidas Liaudanskas , Rodrigo Ortiz-Cayon , Ravi Ramamoorthi

Research on differentiable scene representations is consistently moving towards more efficient, real-time models. Recently, this has led to the popularization of splatting methods, which eschew the traditional ray-based rendering of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Shrisudhan Govindarajan , Daniel Rebain , Kwang Moo Yi , Andrea Tagliasacchi

Reconstruction and intrinsic decomposition of scenes from captured imagery would enable many applications such as relighting and virtual object insertion. Recent NeRF based methods achieve impressive fidelity of 3D reconstruction, but bake…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Zian Wang , Tianchang Shen , Jun Gao , Shengyu Huang , Jacob Munkberg , Jon Hasselgren , Zan Gojcic , Wenzheng Chen , Sanja Fidler

Inverse rendering pipelines are gaining prominence in realizing photo-realistic reconstruction of real-world objects for emulating them in virtual reality scenes. Apart from material reflectances, spectral rendering and in-scene…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Parisha Joshi , Daljit Singh J. Dhillon

In this manuscript, we introduce a novel technique for sampling and integrating direct illumination in the presence of many lights. Unlike previous work, the presented technique importance samples the product distribution of radiance and…

Graphics · Computer Science 2019-11-28 Jacopo Pantaleoni

Particle-based representations of radiance fields such as 3D Gaussian Splatting have found great success for reconstructing and re-rendering of complex scenes. Most existing methods render particles via rasterization, projecting them to…

Differentiable rendering has received increasing interest for image-based inverse problems. It can benefit traditional optimization-based solutions to inverse problems, but also allows for self-supervision of learning-based approaches for…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Linjie Lyu , Marc Habermann , Lingjie Liu , Mallikarjun B R , Ayush Tewari , Christian Theobalt

This paper addresses the problem of inverse rendering from photometric images. Existing approaches for this problem suffer from the effects of self-shadows, inter-reflections, and lack of constraints on the surface reflectance, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Jingzhi Bao , Guanying Chen , Shuguang Cui

Rendering volumetric scattering media, including clouds, fog, smoke, and other complex materials, is crucial for realism in computer graphics. Traditional path tracing, while unbiased, requires many long path samples to converge in scenes…

Graphics · Computer Science 2024-04-19 Becky Hu , Xi Deng , Fujun Luan , Miloš Hašan , Steve Marschner

Indoor scenes typically exhibit complex, spatially-varying appearance from global illumination, making inverse rendering a challenging ill-posed problem. This work presents an end-to-end, learning-based inverse rendering framework…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Jingsen Zhu , Fujun Luan , Yuchi Huo , Zihao Lin , Zhihua Zhong , Dianbing Xi , Jiaxiang Zheng , Rui Tang , Hujun Bao , Rui Wang

Interactive global illumination remains a challenge in radiometrically- and geometrically-complex scenes. Specialized sampling strategies are effective for specular and near-specular transport because the scattering has relatively low…

Graphics · Computer Science 2021-08-12 Zander Majercik , Thomas Müller , Alexander Keller , Derek Nowrouzezahrai , Morgan McGuire

The high computational expense of simulating light through ray-tracing in large, sparsely instrumented particle detectors such as IceCube and Antares is a critical outstanding problem in particle physics. When the detector is sparsely…

High Energy Physics - Experiment · Physics 2018-11-13 Gabriel H. Collin

The correct insertion of virtual objects in images of real-world scenes requires a deep understanding of the scene's lighting, geometry and materials, as well as the image formation process. While recent large-scale diffusion models have…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Ruofan Liang , Zan Gojcic , Merlin Nimier-David , David Acuna , Nandita Vijaykumar , Sanja Fidler , Zian Wang

We present TraceFlow, a novel framework for high-fidelity rendering of dynamic specular scenes by addressing two key challenges: precise reflection direction estimation and physically accurate reflection modeling. To achieve this, we…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Jiachen Tao , Junyi Wu , Haoxuan Wang , Zongxin Yang , Dawen Cai , Yan Yan