English
Related papers

Related papers: ESR-NeRF: Emissive Source Reconstruction Using LDR…

200 papers

We develop a method that recovers the surface, materials, and illumination of a scene from its posed multi-view images. In contrast to prior work, it does not require any additional data and can handle glossy objects or bright lighting. It…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Yue Fan , Ningjing Fan , Ivan Skorokhodov , Oleg Voynov , Savva Ignatyev , Evgeny Burnaev , Peter Wonka , Yiqun Wang

Fully unsupervised 3D representation learning has gained attention owing to its advantages in data collection. A successful approach involves a viewpoint-aware approach that learns an image distribution based on generative models (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Takuhiro Kaneko

Transparent objects are ubiquitous in industry, pharmaceuticals, and households. Grasping and manipulating these objects is a significant challenge for robots. Existing methods have difficulty reconstructing complete depth maps for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Bardienus P. Duisterhof , Yuemin Mao , Si Heng Teng , Jeffrey Ichnowski

Radio-Frequency (RF) imaging concerns the digital recreation of the surfaces of scene objects based on the scattered field at distributed receivers. To solve this difficult inverse scattering problems, data-driven methods are often employed…

Machine Learning · Computer Science 2025-03-19 Kyriakos Stylianopoulos , Panagiotis Gavriilidis , Gabriele Gradoni , George C. Alexandropoulos

Novel view synthesis is a long-standing problem. In this work, we consider a variant of the problem where we are given only a few context views sparsely covering a scene or an object. The goal is to predict novel viewpoints in the scene,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Jonáš Kulhánek , Erik Derner , Torsten Sattler , Robert Babuška

Neural radiance fields provide state-of-the-art view synthesis quality but tend to be slow to render. One reason is that they make use of volume rendering, thus requiring many samples (and model queries) per ray at render time. Although…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Haithem Turki , Vasu Agrawal , Samuel Rota Bulò , Lorenzo Porzi , Peter Kontschieder , Deva Ramanan , Michael Zollhöfer , Christian Richardt

Neural radiance fields (NeRF) bring a new wave for 3D interactive experiences. However, as an important part of the immersive experiences, the defocus effects have not been fully explored within NeRF. Some recent NeRF-based methods generate…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Yinhuai Wang , Shuzhou Yang , Yujie Hu , Jian Zhang

Neural Radiance Field (NeRF) has achieved remarkable success in creating immersive media representations through its exceptional reconstruction capabilities. However, the computational demands of dense forward passes and volume rendering…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Weixiang Zhang , Shuzhao Xie , Shijia Ge , Wei Yao , Chen Tang , Zhi Wang

In this work, we propose an inverse rendering model that estimates 3D shape, spatially-varying reflectance, homogeneous subsurface scattering parameters, and an environment illumination jointly from only a pair of captured images of a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Chenhao Li , Trung Thanh Ngo , Hajime Nagahara

NeRF provides unparalleled fidelity of novel view synthesis: rendering a 3D scene from an arbitrary viewpoint. NeRF requires training on a large number of views that fully cover a scene, which limits its applicability. While these issues…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Pol Moreno , Adam R. Kosiorek , Heiko Strathmann , Daniel Zoran , Rosalia G. Schneider , Björn Winckler , Larisa Markeeva , Théophane Weber , Danilo J. Rezende

3D reconstruction from images has wide applications in Virtual Reality and Automatic Driving, where the precision requirement is very high. Ground-breaking research in the neural radiance field (NeRF) by utilizing Multi-Layer Perceptions…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Jiaming Shen , Bolin Song , Zirui Wu , Yi Xu

Recent advances in Neural Radiance Fields (NeRF) have shown great potential in 3D reconstruction and novel view synthesis, particularly for indoor and small-scale scenes. However, extending NeRF to large-scale outdoor environments presents…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yizhou Li , Yusuke Monno , Masatoshi Okutomi , Yuuichi Tanaka , Seiichi Kataoka , Teruaki Kosiba

Inverse rendering is an ill-posed problem. Previous work has sought to resolve this by focussing on priors for object or scene shape or appearance. In this work, we instead focus on a prior for natural illuminations. Current methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 James A. D. Gardner , Bernhard Egger , William A. P. Smith

Neural radiance fields (NeRFs) have shown impressive results for novel view synthesis. However, they depend on the repetitive use of a single-input single-output multilayer perceptron (SISO MLP) that maps 3D coordinates and view direction…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Takuhiro Kaneko

In this paper, we propose SpectralNeRF, an end-to-end Neural Radiance Field (NeRF)-based architecture for high-quality physically based rendering from a novel spectral perspective. We modify the classical spectral rendering into two main…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Ru Li , Jia Liu , Guanghui Liu , Shengping Zhang , Bing Zeng , Shuaicheng Liu

Most Neural Radiance Fields (NeRFs) exhibit limited generalization capabilities, which restrict their applicability in representing multiple scenes using a single model. To address this problem, existing generalizable NeRF methods simply…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Ganlin Yang , Guoqiang Wei , Zhizheng Zhang , Yan Lu , Dong Liu

Neural radiance fields (NeRFs) have emerged as an effective method for novel-view synthesis and 3D scene reconstruction. However, conventional training methods require access to all training views during scene optimization. This assumption…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Ryan Po , Zhengyang Dong , Alexander W. Bergman , Gordon Wetzstein

Several variants of Neural Radiance Fields (NeRFs) have significantly improved the accuracy of synthesized images and surface reconstruction of 3D scenes/objects. In all of these methods, a key characteristic is that none can train the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Gonçalo Dias Pais , Valter Piedade , Moitreya Chatterjee , Marcus Greiff , Pedro Miraldo

Recently, Neural Radiance Fields (NeRF) have emerged as a potent method for synthesizing novel views from a dense set of images. Despite its impressive performance, NeRF is plagued by its necessity for numerous calibrated views and its…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Jiayang Bai , Letian Huang , Wen Gong , Jie Guo , Yanwen Guo

Recent research explosion on Neural Radiance Field (NeRF) shows the encouraging potential to represent complex scenes with neural networks. One major drawback of NeRF is its prohibitive inference time: Rendering a single pixel requires…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Huan Wang , Jian Ren , Zeng Huang , Kyle Olszewski , Menglei Chai , Yun Fu , Sergey Tulyakov