English
Related papers

Related papers: NeMF: Inverse Volume Rendering with Neural Microfl…

200 papers

While neural radiance fields (NeRF) led to a breakthrough in photorealistic novel view synthesis, handling mirroring surfaces still denotes a particular challenge as they introduce severe inconsistencies in the scene representation.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Leif Van Holland , Michael Weinmann , Jan U. Müller , Patrick Stotko , Reinhard Klein

We present a novel method for performing flexible, 3D-aware image content manipulation while enabling high-quality novel view synthesis. While NeRF-based approaches are effective for novel view synthesis, such models memorize the radiance…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Verica Lazova , Vladimir Guzov , Kyle Olszewski , Sergey Tulyakov , Gerard Pons-Moll

View synthesis methods using implicit continuous shape representations learned from a set of images, such as the Neural Radiance Field (NeRF) method, have gained increasing attention due to their high quality imagery and scalability to high…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Guo-Wei Yang , Wen-Yang Zhou , Hao-Yang Peng , Dun Liang , Tai-Jiang Mu , Shi-Min Hu

Rendering diffuse global illumination in real-time is often approximated by pre-computing and storing irradiance in a 3D grid of probes. As long as most of the scene remains static, probes approximate irradiance for all surfaces immersed in…

Fluorescence Molecular Tomography (FMT) is a promising technique for non-invasive 3D visualization of fluorescent probes, but its reconstruction remains challenging due to the inherent ill-posedness and reliance on inaccurate or…

Image and Video Processing · Electrical Eng. & Systems 2025-11-07 Shihan Zhao , Jianru Zhang , Yanan Wu , Linlin Li , Siyuan Shen , Xingjun Zhu , Guoyan Zheng , Jiahua Jiang , Wuwei Ren

Existing Neural Radiance Fields (NeRF) methods suffer from the existence of reflective objects, often resulting in blurry or distorted rendering. Instead of calculating a single radiance field, we propose a multi-space neural radiance field…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Ze-Xin Yin , Peng-Yi Jiao , Jiaxiong Qiu , Ming-Ming Cheng , Bo Ren

Neural radiance fields enable state-of-the-art photorealistic view synthesis. However, existing radiance field representations are either too compute-intensive for real-time rendering or require too much memory to scale to large scenes. We…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Christian Reiser , Richard Szeliski , Dor Verbin , Pratul P. Srinivasan , Ben Mildenhall , Andreas Geiger , Jonathan T. Barron , Peter Hedman

We present a neural modeling framework for Non-Line-of-Sight (NLOS) imaging. Previous solutions have sought to explicitly recover the 3D geometry (e.g., as point clouds) or voxel density (e.g., within a pre-defined volume) of the hidden…

Image and Video Processing · Electrical Eng. & Systems 2023-04-05 Siyuan Shen , Zi Wang , Ping Liu , Zhengqing Pan , Ruiqian Li , Tian Gao , Shiying Li , Jingyi Yu

We have recently seen tremendous progress in neural rendering (NR) advances, i.e., NeRF, for photo-real free-view synthesis. Yet, as a local technique based on a single computer/GPU, even the best-engineered Instant-NGP or i-NGP cannot…

Neural radiance fields (NeRF) rely on volume rendering to synthesize novel views. Volume rendering requires evaluating an integral along each ray, which is numerically approximated with a finite sum that corresponds to the exact integral…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 Mikaela Angelina Uy , Kiyohiro Nakayama , Guandao Yang , Rahul Krishna Thomas , Leonidas Guibas , Ke Li

This work tackles the challenging task of achieving real-time novel view synthesis for reflective surfaces across various scenes. Existing real-time rendering methods, especially those based on meshes, often have subpar performance in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Chaojie Ji , Yufeng Li , Yiyi Liao

Multi-view inverse rendering is the problem of estimating the scene parameters such as shapes, materials, or illuminations from a sequence of images captured under different viewpoints. Many approaches, however, assume single light bounce…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Chenhao Li , Taishi Ono , Takeshi Uemori , Hajime Mihara , Alexander Gatto , Hajime Nagahara , Yusuke Moriuchi

Recently, neural implicit surfaces learning by volume rendering has become popular for multi-view reconstruction. However, one key challenge remains: existing approaches lack explicit multi-view geometry constraints, hence usually fail to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Qiancheng Fu , Qingshan Xu , Yew-Soon Ong , Wenbing Tao

We present a method for composing photorealistic scenes from captured images of objects. Our work builds upon neural radiance fields (NeRFs), which implicitly model the volumetric density and directionally-emitted radiance of a scene. While…

Computer Vision and Pattern Recognition · Computer Science 2020-12-16 Michelle Guo , Alireza Fathi , Jiajun Wu , Thomas Funkhouser

Reconstructing objects from posed images is a crucial and complex task in computer graphics and computer vision. While NeRF-based neural reconstruction methods have exhibited impressive reconstruction ability, they tend to be…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Shuichang Lai , Letian Huang , Jie Guo , Kai Cheng , Bowen Pan , Xiaoxiao Long , Jiangjing Lyu , Chengfei Lv , Yanwen Guo

Creating functional Digital Twins, simulatable 3D replicas of the real world, is a central challenge in computer vision. Current methods like NeRF produce visually rich but functionally incomplete twins. The key barrier is the lack of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Zhe Chen , Peilin Zheng , Wenshuo Chen , Xiucheng Wang , Yutao Yue , Nan Cheng

Inspired by the recent advances in implicitly representing signals with trained neural networks, we aim to learn a continuous representation for narrow-baseline 4D light fields. We propose an implicit representation model for 4D light…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Paramanand Chandramouli , Hendrik Sommerhoff , Andreas Kolb

We present a physics-based inverse rendering method that learns the illumination, geometry, and materials of a scene from posed multi-view RGB images. To model the illumination of a scene, existing inverse rendering works either completely…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Youming Deng , Xueting Li , Sifei Liu , Ming-Hsuan Yang

Traditional inverse rendering techniques are based on textured meshes, which naturally adapts to modern graphics pipelines, but costly differentiable multi-bounce Monte Carlo (MC) ray tracing poses challenges for modeling global…

Graphics · Computer Science 2025-06-09 Jiakai Sun , Weijing Zhang , Zhanjie Zhang , Tianyi Chu , Guangyuan Li , Lei Zhao , Wei Xing

Novel view synthesis is a challenging and ill-posed inverse rendering problem. Neural rendering techniques have recently achieved photorealistic image quality for this task. State-of-the-art (SOTA) neural volume rendering approaches,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Petr Kellnhofer , Lars Jebe , Andrew Jones , Ryan Spicer , Kari Pulli , Gordon Wetzstein