English
Related papers

Related papers: Neural directional distance field object represent…

200 papers

Neural radiance fields (NeRF) have revolutionized the field of image-based view synthesis. However, NeRF uses straight rays and fails to deal with complicated light path changes caused by refraction and reflection. This prevents NeRF from…

Computer Vision and Pattern Recognition · Computer Science 2023-09-25 Xiaoxue Chen , Junchen Liu , Hao Zhao , Guyue Zhou , Ya-Qin Zhang

Despite the potential of neural scene representations to effectively compress 3D scalar fields at high reconstruction quality, the computational complexity of the training and data reconstruction step using scene representation networks…

Graphics · Computer Science 2022-07-26 Sebastian Weiss , Philipp Hermüller , Rüdiger Westermann

Data-driven methods such as convolutional neural networks (CNNs) are known to deliver state-of-the-art performance on image recognition tasks when the training data are abundant. However, in some instances, such as change detection in…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Maria Kolos , Anton Marin , Alexey Artemov , Evgeny Burnaev

Neural scene representations, such as Neural Radiance Fields (NeRF), are based on training a multilayer perceptron (MLP) using a set of color images with known poses. An increasing number of devices now produce RGB-D(color + depth)…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Arnab Dey , Yassine Ahmine , Andrew I. Comport

Inverse rendering aims to reconstruct the scene properties of objects solely from multiview images. However, it is an ill-posed problem prone to producing ambiguous estimations deviating from physically accurate representations. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Georgios Kouros , Minye Wu , Sushruth Nagesh , Xianling Zhang , Tinne Tuytelaars

Recent works on implicit neural representations have shown promising results for multi-view surface reconstruction. However, most approaches are limited to relatively simple geometries and usually require clean object masks for…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Jingyang Zhang , Yao Yao , Long Quan

Deep neural networks (DNNs) are widely applied for nowadays 3D surface reconstruction tasks and such methods can be further divided into two categories, which respectively warp templates explicitly by moving vertices or represent 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Xianghui Yang , Guosheng Lin , Zhenghao Chen , Luping Zhou

Temporal interpolation often plays a crucial role to learn meaningful representations in dynamic scenes. In this paper, we propose a novel method to train spatiotemporal neural radiance fields of dynamic scenes based on temporal…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Sungheon Park , Minjung Son , Seokhwan Jang , Young Chun Ahn , Ji-Yeon Kim , Nahyup Kang

Problems in differentiable rendering often involve optimizing scene parameters that cause motion in image space. The gradients for such parameters tend to be sparse, leading to poor convergence. While existing methods address this sparsity…

Graphics · Computer Science 2025-03-31 Ishit Mehta , Manmohan Chandraker , Ravi Ramamoorthi

The representation of parallax on virtual environment is still a problem to be studied. Common algorithms, such as Bump Mapping, Parallax Mapping and Displacement Mapping, treats this problem for small disparity between a real object and a…

Graphics · Computer Science 2024-02-27 Alexandre Yip Gonçalves Dias , Marcelo Knörich Zuffo

Deep neural networks implement a sequence of layer-by-layer operations that are each relatively easy to understand, but the resulting overall computation is generally difficult to understand. We consider a simple hypothesis for interpreting…

Machine Learning · Computer Science 2022-11-29 Richard D. Lange , Devin Kwok , Jordan Matelsky , Xinyue Wang , David S. Rolnick , Konrad P. Kording

Recent advances in Neural Radiance Fields (NeRF) have demonstrated significant potential for representing 3D scene appearances as implicit neural networks, enabling the synthesis of high-fidelity novel views. However, the lengthy training…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Tong Wang , Shuichi Kurabayashi

Neural Radiance Fields (NeRF) is a novel implicit 3D reconstruction method that shows immense potential and has been gaining increasing attention. It enables the reconstruction of 3D scenes solely from a set of photographs. However, its…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Jiaming Gu , Minchao Jiang , Hongsheng Li , Xiaoyuan Lu , Guangming Zhu , Syed Afaq Ali Shah , Liang Zhang , Mohammed Bennamoun

Neural rendering has garnered substantial attention owing to its capacity for creating realistic 3D scenes. However, its applicability to extensive scenes remains challenging, with limitations in effectiveness. In this work, we propose the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Zhihao Jia , Bing Wang , Changhao Chen

Representing and rendering dynamic scenes from 2D images is a fundamental yet challenging problem in computer vision and graphics. This survey provides a comprehensive review of the evolution and advancements in dynamic scene representation…

Graphics · Computer Science 2025-03-12 Jiaxuan Zhu , Hao Tang

We propose a new method for realistic real-time novel-view synthesis (NVS) of large scenes. Existing neural rendering methods generate realistic results, but primarily work for small scale scenes (<50 square meters) and have difficulty at…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Jeffrey Yunfan Liu , Yun Chen , Ze Yang , Jingkang Wang , Sivabalan Manivasagam , Raquel Urtasun

We consider the problem of tracking the 6D pose of a moving RGB-D camera in a neural scene representation. Different such representations have recently emerged, and we investigate the suitability of them for the task of camera tracking. In…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Leonard Bruns , Fereidoon Zangeneh , Patric Jensfelt

Recent advancements in 4D scene reconstruction using neural radiance fields (NeRF) have demonstrated the ability to represent dynamic scenes from multi-view videos. However, they fail to reconstruct the dynamic scenes and struggle to fit…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Seoha Kim , Jeongmin Bae , Youngsik Yun , Hahyun Lee , Gun Bang , Youngjung Uh

Neural Radiance Fields (NeRF) has gained significant attention for its prominent implicit 3D representation and realistic novel view synthesis capabilities. Available works unexceptionally employ straight-line volume rendering, which…

Graphics · Computer Science 2025-08-20 Nan Luo , Chenglin Ye , Jiaxu Li , Gang Liu , Bo Wan , Di Wang , Lupeng Liu , Jun Xiao

We present a novel method, called NeuralUDF, for reconstructing surfaces with arbitrary topologies from 2D images via volume rendering. Recent advances in neural rendering based reconstruction have achieved compelling results. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Xiaoxiao Long , Cheng Lin , Lingjie Liu , Yuan Liu , Peng Wang , Christian Theobalt , Taku Komura , Wenping Wang