English
Related papers

Related papers: Neural Volume Rendering: NeRF And Beyond

200 papers

In recent years, neural networks showed unprecedented growth that ultimately influenced dozens of different industries, including signal processing for the electroencephalography (EEG) process. Electroencephalography, although it appeared…

Signal Processing · Electrical Eng. & Systems 2021-03-30 Rakhmatulin Ildar

Creating high-quality controllable 3D human models from multi-view RGB videos poses a significant challenge. Neural radiance fields (NeRFs) have demonstrated remarkable quality in reconstructing and free-viewpoint rendering of static as…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Paul Knoll , Wieland Morgenstern , Anna Hilsmann , Peter Eisert

The widespread availability of electronic health records (EHRs) promises to usher in the era of personalized medicine. However, the problem of extracting useful clinical representations from longitudinal EHR data remains challenging. In…

Machine Learning · Computer Science 2017-01-27 Zhengping Che , Yu Cheng , Zhaonan Sun , Yan Liu

In this paper, we address the challenge of decomposing Neural Radiance Fields (NeRF) into objects from an open vocabulary, a critical task for object manipulation in 3D reconstruction and view synthesis. Current techniques for NeRF…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Hao Zhang , Fang Li , Narendra Ahuja

Neural radiance fields (NeRF) have shown great potentials in representing 3D scenes and synthesizing novel views, but the computational overhead of NeRF at the inference stage is still heavy. To alleviate the burden, we delve into the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Jiemin Fang , Lingxi Xie , Xinggang Wang , Xiaopeng Zhang , Wenyu Liu , Qi Tian

The novel coronavirus disease (COVID-19) began in Wuhan, China, in late 2019 and to date has infected over 148M people worldwide, resulting in 3.12M deaths. On March 10, 2020, the World Health Organisation (WHO) declared it as a global…

Information Retrieval · Computer Science 2022-05-31 Sanku Satya Uday , Satti Thanuja Pavani , T. Jaya Lakshmi , Rohit Chivukula

In volume visualization, visualization synthesis has attracted much attention due to its ability to generate novel visualizations without following the conventional rendering pipeline. However, existing solutions based on generative…

Graphics · Computer Science 2024-08-02 Kaiyuan Tang , Chaoli Wang

We established a Spatio-Temporal Neural Network, namely STNN, to forecast the spread of the coronavirus COVID-19 outbreak worldwide in 2020. The basic structure of STNN is similar to the Recurrent Neural Network (RNN) incorporating with not…

Machine Learning · Computer Science 2021-03-23 Yi-Shuai Niu , Wentao Ding , Junpeng Hu , Wenxu Xu , Stephane Canu

We present a neural network for rendering binaural speech from given monaural audio, position, and orientation of the source. Most of the previous works have focused on synthesizing binaural speeches by conditioning the positions and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-02 Jin Woo Lee , Kyogu Lee

Implicit surfaces via neural radiance fields (NeRF) have shown surprising accuracy in surface reconstruction. Despite their success in reconstructing richly textured surfaces, existing methods struggle with planar regions with weak…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Albert Gassol Puigjaner , Edoardo Mello Rella , Erik Sandström , Ajad Chhatkuli , Luc Van Gool

Neural radiance fields enable state-of-the-art photorealistic view synthesis. However, existing radiance field representations are either too compute-intensive for real-time rendering or require too much memory to scale to large scenes. We…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Christian Reiser , Richard Szeliski , Dor Verbin , Pratul P. Srinivasan , Ben Mildenhall , Andreas Geiger , Jonathan T. Barron , Peter Hedman

Volume Rendering is an important technique for visualizing three-dimensional scalar data grids and is commonly employed for scientific and medical image data. Direct Volume Rendering (DVR) is a well established and efficient rendering…

Graphics · Computer Science 2021-06-11 Jakob Weiss , Nassir Navab

Neural Radiance Fields (NeRFs) are a powerful representation for modeling a 3D scene as a continuous function. Though NeRF is able to render complex 3D scenes with view-dependent effects, few efforts have been devoted to exploring its…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Yifan Jiang , Peter Hedman , Ben Mildenhall , Dejia Xu , Jonathan T. Barron , Zhangyang Wang , Tianfan Xue

Recent work has demonstrated that volumetric scene representations combined with differentiable volume rendering can enable photo-realistic rendering for challenging scenes that mesh reconstruction fails on. However, these methods entangle…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Fanbo Xiang , Zexiang Xu , Miloš Hašan , Yannick Hold-Geoffroy , Kalyan Sunkavalli , Hao Su

Recent history has seen a tremendous growth of work exploring implicit representations of geometry and radiance, popularized through Neural Radiance Fields (NeRF). Such works are fundamentally based on a (implicit) volumetric representation…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Jason Y. Zhang , Gengshan Yang , Shubham Tulsiani , Deva Ramanan

Neural Radiance Field (NeRF) based rendering has attracted growing attention thanks to its state-of-the-art (SOTA) rendering quality and wide applications in Augmented and Virtual Reality (AR/VR). However, immersive real-time (> 30 FPS)…

Hardware Architecture · Computer Science 2025-03-31 Chaojian Li , Sixu Li , Yang Zhao , Wenbo Zhu , Yingyan Celine Lin

We present TimeNeRF, a generalizable neural rendering approach for rendering novel views at arbitrary viewpoints and at arbitrary times, even with few input views. For real-world applications, it is expensive to collect multiple views and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Hsiang-Hui Hung , Huu-Phu Do , Yung-Hui Li , Ching-Chun Huang

Neural Radiance Field (NeRF) has emerged as a leading technique for novel view synthesis, owing to its impressive photorealistic reconstruction and rendering capability. Nevertheless, achieving real-time NeRF rendering in large-scale scenes…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Chaojian Li , Bichen Wu , Peter Vajda , Yingyan Celine Lin

The recent COVID-19 pandemic has thrown the importance of accurately forecasting contagion dynamics and learning infection parameters into sharp focus. At the same time, effective policy-making requires knowledge of the uncertainty on such…

Machine Learning · Computer Science 2025-07-04 Thomas Gaskin , Tim Conrad , Grigorios A. Pavliotis , Christof Schütte

This paper presents the first significant work on directly predicting 3D face landmarks on neural radiance fields (NeRFs). Our 3D coarse-to-fine Face Landmarks NeRF (FLNeRF) model efficiently samples from a given face NeRF with individual…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Hao Zhang , Tianyuan Dai , Yu-Wing Tai , Chi-Keung Tang