English
Related papers

Related papers: DGNR: Density-Guided Neural Point Rendering of Lar…

200 papers

Neural Radiance Fields (NeRF) achieve photo-realistic view synthesis with densely captured input images. However, the geometry of NeRF is extremely under-constrained given sparse views, resulting in significant degradation of novel view…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Zheng Chen , Chen Wang , Yuan-Chen Guo , Song-Hai Zhang

In this work we develop a generalizable and efficient Neural Radiance Field (NeRF) pipeline for high-fidelity free-viewpoint human body synthesis under settings with sparse camera views. Though existing NeRF-based methods can synthesize…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Mingfei Chen , Jianfeng Zhang , Xiangyu Xu , Lijuan Liu , Yujun Cai , Jiashi Feng , Shuicheng Yan

Indoor scene understanding is central to applications such as robot navigation and human companion assistance. Over the last years, data-driven deep neural networks have outperformed many traditional approaches thanks to their…

Computer Vision and Pattern Recognition · Computer Science 2017-07-04 Yinda Zhang , Shuran Song , Ersin Yumer , Manolis Savva , Joon-Young Lee , Hailin Jin , Thomas Funkhouser

We propose a differentiable rendering algorithm for efficient novel view synthesis. By departing from volume-based representations in favor of a learned point representation, we improve on existing methods more than an order of magnitude in…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Qiang Zhang , Seung-Hwan Baek , Szymon Rusinkiewicz , Felix Heide

In this work, we focus on synthesizing high-fidelity novel view images for arbitrary human performers, given a set of sparse multi-view images. It is a challenging task due to the large variation among articulated body poses and heavy…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Jianchuan Chen , Wentao Yi , Liqian Ma , Xu Jia , Huchuan Lu

Neural Radiance Fields (NeRF) has been wildly applied to various tasks for its high-quality representation of 3D scenes. It takes long per-scene training time and per-image testing time. In this paper, we present EfficientNeRF as an…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Tao Hu , Shu Liu , Yilun Chen , Tiancheng Shen , Jiaya Jia

Neural Radiance Field~(NeRF) achieves extremely high quality in object-scaled and indoor scene reconstruction. However, there exist some challenges when reconstructing large-scale scenes. MLP-based NeRFs suffer from limited network…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Sidun Liu , Peng Qiao , Zongxin Ye , Wenyu Li , Yong Dou

Deferred neural rendering (DNR) is an emerging computer graphics pipeline designed for high-fidelity rendering and robotic perception. However, DNR heavily relies on datasets composed of numerous ray-traced images and demands substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Dongli Wu , Haochen Li , Xiaobao Wei

Recent approaches to render photorealistic views from a limited set of photographs have pushed the boundaries of our interactions with pictures of static scenes. The ability to recreate moments, that is, time-varying sequences, is perhaps…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Chaoyang Wang , Ben Eckart , Simon Lucey , Orazio Gallo

A long-standing goal in scene understanding is to obtain interpretable and editable representations that can be directly constructed from a raw monocular RGB-D video, without requiring specialized hardware setup or priors. The problem is…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Yu-Shiang Wong , Niloy J. Mitra

Neural Radiance Fields (NeRF) have shown remarkable performance in neural rendering-based novel view synthesis. However, NeRF suffers from severe visual quality degradation when the input images have been captured under imperfect…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Byeonghyeon Lee , Howoong Lee , Usman Ali , Eunbyung Park

Neural radiance fields (NeRF) encode a scene into a neural representation that enables photo-realistic rendering of novel views. However, a successful reconstruction from RGB images requires a large number of input views taken under static…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Barbara Roessle , Jonathan T. Barron , Ben Mildenhall , Pratul P. Srinivasan , Matthias Nießner

Neural Radiance Fields (NeRFs), despite their outstanding performance on novel view synthesis, often need dense input views. Many papers train one model for each scene respectively and few of them explore incorporating multi-modal data into…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Haoyi Zhu , Hao-Shu Fang , Cewu Lu

Recently, Neural Radiance Fields (NeRF) achieved impressive results in novel view synthesis. Block-NeRF showed the capability of leveraging NeRF to build large city-scale models. For large-scale modeling, a mass of image data is necessary.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Tong Qin , Changze Li , Haoyang Ye , Shaowei Wan , Minzhen Li , Hongwei Liu , Ming Yang

We present Generalizable NeRF Transformer (GNT), a transformer-based architecture that reconstructs Neural Radiance Fields (NeRFs) and learns to renders novel views on the fly from source views. While prior works on NeRFs optimize a scene…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Mukund Varma T , Peihao Wang , Xuxi Chen , Tianlong Chen , Subhashini Venugopalan , Zhangyang Wang

In this paper, we propose a One-Point-One NeRF (OPONeRF) framework for robust scene rendering. Existing NeRFs are designed based on a key assumption that the target scene remains unchanged between the training and test time. However, small…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Yu Zheng , Yueqi Duan , Kangfu Zheng , Hongru Yan , Jiwen Lu , Jie Zhou

We present a new point-based approach for modeling the appearance of real scenes. The approach uses a raw point cloud as the geometric representation of a scene, and augments each point with a learnable neural descriptor that encodes local…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Kara-Ali Aliev , Artem Sevastopolsky , Maria Kolos , Dmitry Ulyanov , Victor Lempitsky

Lane detection in driving scenes is an important module for autonomous vehicles and advanced driver assistance systems. In recent years, many sophisticated lane detection methods have been proposed. However, most methods focus on detecting…

Computer Vision and Pattern Recognition · Computer Science 2020-04-30 Qin Zou , Hanwen Jiang , Qiyu Dai , Yuanhao Yue , Long Chen , Qian Wang

Volume Rendering is an important technique for visualizing three-dimensional scalar data grids and is commonly employed for scientific and medical image data. Direct Volume Rendering (DVR) is a well established and efficient rendering…

Graphics · Computer Science 2021-06-11 Jakob Weiss , Nassir Navab

Photorealistic simulation plays a crucial role in applications such as autonomous driving, where advances in neural radiance fields (NeRFs) may allow better scalability through the automatic creation of digital 3D assets. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Shanlin Sun , Bingbing Zhuang , Ziyu Jiang , Buyu Liu , Xiaohui Xie , Manmohan Chandraker