English
Related papers

Related papers: Relative Illumination Fields: Learning Medium and …

200 papers

We present a learning-based method for synthesizing novel views of complex scenes using only unstructured collections of in-the-wild photographs. We build on Neural Radiance Fields (NeRF), which uses the weights of a multilayer perceptron…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Ricardo Martin-Brualla , Noha Radwan , Mehdi S. M. Sajjadi , Jonathan T. Barron , Alexey Dosovitskiy , Daniel Duckworth

Neural radiance fields (NeRFs) produce state-of-the-art view synthesis results. However, they are slow to render, requiring hundreds of network evaluations per pixel to approximate a volume rendering integral. Baking NeRFs into explicit…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Benjamin Attal , Jia-Bin Huang , Michael Zollhoefer , Johannes Kopf , Changil Kim

Object detection and semantic segmentation are two of the most widely adopted deep learning algorithms in agricultural applications. One of the major sources of variability in image quality acquired in the outdoors for such tasks is…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Abhisesh Silwal , Tanvir Parhar , Francisco Yandun , George Kantor

In recent years, Neural Radiance Fields (NeRFs) have demonstrated significant potential in encoding highly-detailed 3D geometry and environmental appearance, positioning themselves as a promising alternative to traditional explicit…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Tianxiang Ye , Qi Wu , Junyuan Deng , Guoqing Liu , Liu Liu , Songpengcheng Xia , Liang Pang , Wenxian Yu , Ling Pei

We present an imaging and neural rendering technique that seeks to synthesize videos of light propagating through a scene from novel, moving camera viewpoints. Our approach relies on a new ultrafast imaging setup to capture a first-of-its…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Anagh Malik , Noah Juravsky , Ryan Po , Gordon Wetzstein , Kiriakos N. Kutulakos , David B. Lindell

Unlike opaque object, novel view synthesis of transparent object is a challenging task, because transparent object refracts light of background causing visual distortions on the transparent object surface along the viewpoint change.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Heechan Yoon , Seungkyu Lee

Given a set of images of a scene, the re-rendering of this scene from novel views and lighting conditions is an important and challenging problem in Computer Vision and Graphics. On the one hand, most existing works in Computer Vision…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Linjie Lyu , Ayush Tewari , Thomas Leimkuehler , Marc Habermann , Christian Theobalt

Decomposing a scene into its shape, reflectance, and illumination is a challenging but important problem in computer vision and graphics. This problem is inherently more challenging when the illumination is not a single light source under…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Mark Boss , Raphael Braun , Varun Jampani , Jonathan T. Barron , Ce Liu , Hendrik P. A. Lensch

Although there has been significant progress in neural radiance fields, an issue on dynamic illumination changes still remains unsolved. Different from relevant works that parameterize time-variant/-invariant components in scenes, subjects'…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Changyeon Won , Hyunjun Jung , Jungu Cho , Seonmi Park , Chi-Hoon Lee , Hae-Gon Jeon

To image in high resolution large and occlusion-prone scenes, a camera must move above and around. Degradation of visibility due to geometric occlusions and distances is exacerbated by scattering, when the scene is in a participating…

Computer Vision and Pattern Recognition · Computer Science 2015-12-08 Mark Sheinin , Yoav Y. Schechner

Reconstruction and intrinsic decomposition of scenes from captured imagery would enable many applications such as relighting and virtual object insertion. Recent NeRF based methods achieve impressive fidelity of 3D reconstruction, but bake…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Zian Wang , Tianchang Shen , Jun Gao , Shengyu Huang , Jacob Munkberg , Jon Hasselgren , Zan Gojcic , Wenzheng Chen , Sanja Fidler

The optical medium analogy of a radiation field generated by either an exact gravitational plane wave or an exact electromagnetic wave in the framework of general relativity is developed. The equivalent medium of the associated background…

General Relativity and Quantum Cosmology · Physics 2015-06-22 Donato Bini , Pierluigi Fortini , Andrea Geralico , Maria Haney , Antonello Ortolan

We present a method, Neural Radiance Flow (NeRFlow),to learn a 4D spatial-temporal representation of a dynamic scene from a set of RGB images. Key to our approach is the use of a neural implicit representation that learns to capture the 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Yilun Du , Yinan Zhang , Hong-Xing Yu , Joshua B. Tenenbaum , Jiajun Wu

Neural Radiance Fields (NeRF) achieve impressive view synthesis results for a variety of capture settings, including 360 capture of bounded scenes and forward-facing capture of bounded and unbounded scenes. NeRF fits multi-layer perceptrons…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Kai Zhang , Gernot Riegler , Noah Snavely , Vladlen Koltun

We present a deep learning approach to reconstruct scene appearance from unstructured images captured under collocated point lighting. At the heart of Deep Reflectance Volumes is a novel volumetric scene representation consisting of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Sai Bi , Zexiang Xu , Kalyan Sunkavalli , Miloš Hašan , Yannick Hold-Geoffroy , David Kriegman , Ravi Ramamoorthi

Photo-realistic modeling and rendering of fuzzy objects with complex opacity are critical for numerous immersive VR/AR applications, but it suffers from strong view-dependent brightness, color. In this paper, we propose a novel scheme to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Haimin Luo , Anpei Chen , Qixuan Zhang , Bai Pang , Minye Wu , Lan Xu , Jingyi Yu

Neural volumetric representations have become a widely adopted model for radiance fields in 3D scenes. These representations are fully implicit or hybrid function approximators of the instantaneous volumetric radiance in a scene, which are…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Yuval Bahat , Yuxuan Zhang , Hendrik Sommerhoff , Andreas Kolb , Felix Heide

Neural Radiance Fields (NeRFs) provide a high fidelity, continuous scene representation that can realistically represent complex behaviour of light. Despite works like Ref-NeRF improving geometry through physics-inspired models, the ability…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Jack Naylor , Viorela Ila , Donald G. Dansereau

We propose an automatic method to infer high dynamic range illumination from a single, limited field-of-view, low dynamic range photograph of an indoor scene. In contrast to previous work that relies on specialized image capture, user…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Marc-André Gardner , Kalyan Sunkavalli , Ersin Yumer , Xiaohui Shen , Emiliano Gambaretto , Christian Gagné , Jean-François Lalonde

Neural radiance fields (NeRF) excel at synthesizing new views given multi-view, calibrated images of a static scene. When scenes include distractors, which are not persistent during image capture (moving objects, lighting variations,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Sara Sabour , Suhani Vora , Daniel Duckworth , Ivan Krasin , David J. Fleet , Andrea Tagliasacchi