中文
相关论文

相关论文: Semantically-aware Neural Radiance Fields for Visu…

200 篇论文

Acquiring accurate depth information of transparent objects using off-the-shelf RGB-D cameras is a well-known challenge in Computer Vision and Robotics. Depth estimation/completion methods are typically employed and trained on datasets with…

机器人学 · 计算机科学 2024-03-29 Avinash Ummadisingu , Jongkeum Choi , Koki Yamane , Shimpei Masuda , Naoki Fukaya , Kuniyuki Takahashi

We present Neural Reflectance Fields, a novel deep scene representation that encodes volume density, normal and reflectance properties at any 3D point in a scene using a fully-connected neural network. We combine this representation with a…

计算机视觉与模式识别 · 计算机科学 2020-08-18 Sai Bi , Zexiang Xu , Pratul Srinivasan , Ben Mildenhall , Kalyan Sunkavalli , Miloš Hašan , Yannick Hold-Geoffroy , David Kriegman , Ravi Ramamoorthi

A neural radiance field (NeRF) is a scene model supporting high-quality view synthesis, optimized per scene. In this paper, we explore enabling user editing of a category-level NeRF - also known as a conditional radiance field - trained on…

计算机视觉与模式识别 · 计算机科学 2021-06-07 Steven Liu , Xiuming Zhang , Zhoutong Zhang , Richard Zhang , Jun-Yan Zhu , Bryan Russell

Research on neural radiance fields (NeRFs) for novel view generation is exploding with new models and extensions. However, a question that remains unanswered is what happens in underwater or foggy scenes where the medium strongly influences…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Deborah Levy , Amit Peleg , Naama Pearl , Dan Rosenbaum , Derya Akkaynak , Simon Korman , Tali Treibitz

Reconstruction of deformable scenes from endoscopic videos is important for many applications such as intraoperative navigation, surgical visual perception, and robotic surgery. It is a foundational requirement for realizing autonomous…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Shreya Saha , Zekai Liang , Shan Lin , Jingpei Lu , Michael Yip , Sainan Liu

We introduce ViewNeRF, a Neural Radiance Field-based viewpoint estimation method that learns to predict category-level viewpoints directly from images during training. While NeRF is usually trained with ground-truth camera poses, multiple…

计算机视觉与模式识别 · 计算机科学 2022-12-02 Octave Mariotti , Oisin Mac Aodha , Hakan Bilen

Understanding sources of uncertainty is fundamental to trustworthy three-dimensional scene modeling. While recent advances in neural radiance fields (NeRFs) achieve impressive accuracy in scene reconstruction and novel view synthesis, the…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Ruxiao Duan , Alex Wong

Neural Radiance Fields (NeRFs) have revolutionized scene novel view synthesis, offering visually realistic, precise, and robust implicit reconstructions. While recent approaches enable NeRF editing, such as object removal, 3D shape…

计算机视觉与模式识别 · 计算机科学 2023-09-11 Robin Courant , Xi Wang , Marc Christie , Vicky Kalogeiton

Estimating neural radiance fields (NeRFs) from "ideal" images has been extensively studied in the computer vision community. Most approaches assume optimal illumination and slow camera motion. These assumptions are often violated in robotic…

计算机视觉与模式识别 · 计算机科学 2023-01-25 Simon Klenk , Lukas Koestler , Davide Scaramuzza , Daniel Cremers

The recent popular radiance field models, exemplified by Neural Radiance Fields (NeRF), Instant-NGP and 3D Gaussian Splatting, are designed to represent 3D content by that training models for each individual scene. This unique…

计算机视觉与模式识别 · 计算机科学 2024-10-31 Weihang Liu , Xue Xian Zheng , Jingyi Yu , Xin Lou

We present radiance field propagation (RFP), a novel approach to segmenting objects in 3D during reconstruction given only unlabeled multi-view images of a scene. RFP is derived from emerging neural radiance field-based techniques, which…

计算机视觉与模式识别 · 计算机科学 2022-10-20 Xinhang Liu , Jiaben Chen , Huai Yu , Yu-Wing Tai , Chi-Keung Tang

Neural radiance fields enable state-of-the-art photorealistic view synthesis. However, existing radiance field representations are either too compute-intensive for real-time rendering or require too much memory to scale to large scenes. We…

计算机视觉与模式识别 · 计算机科学 2023-02-24 Christian Reiser , Richard Szeliski , Dor Verbin , Pratul P. Srinivasan , Ben Mildenhall , Andreas Geiger , Jonathan T. Barron , Peter Hedman

Neural Radiance Fields (NeRF) have emerged as a powerful representation for the task of novel view synthesis due to their simplicity and state-of-the-art performance. Though NeRF can produce photorealistic renderings of unseen viewpoints…

计算机视觉与模式识别 · 计算机科学 2021-12-02 Michael Niemeyer , Jonathan T. Barron , Ben Mildenhall , Mehdi S. M. Sajjadi , Andreas Geiger , Noha Radwan

Domain scientists often face I/O and storage challenges when keeping raw data from large-scale simulations. Saving visualization images, albeit practical, is limited to preselected viewpoints, transfer functions, and simulation parameters.…

图形学 · 计算机科学 2025-02-25 Siyuan Yao , Yunfei Lu , Chaoli Wang

In this paper, we propose a Neural Radiance Fields (NeRF) based framework, referred to as Novel View Synthesis Framework (NVSF). It jointly learns the implicit neural representation of space and time-varying scene for both LiDAR and Camera.…

计算机视觉与模式识别 · 计算机科学 2025-06-26 Gaurav Sharma , Ravi Kothari , Josef Schmid

Neural radiance fields (NeRF) has achieved outstanding performance in modeling 3D objects and controlled scenes, usually under a single scale. In this work, we focus on multi-scale cases where large changes in imagery are observed at…

计算机视觉与模式识别 · 计算机科学 2023-05-10 Yuanbo Xiangli , Linning Xu , Xingang Pan , Nanxuan Zhao , Anyi Rao , Christian Theobalt , Bo Dai , Dahua Lin

We present a learning-based method for synthesizing novel views of complex scenes using only unstructured collections of in-the-wild photographs. We build on Neural Radiance Fields (NeRF), which uses the weights of a multilayer perceptron…

计算机视觉与模式识别 · 计算机科学 2021-01-07 Ricardo Martin-Brualla , Noha Radwan , Mehdi S. M. Sajjadi , Jonathan T. Barron , Alexey Dosovitskiy , Daniel Duckworth

Neural Radiance Fields (NeRF) has achieved unprecedented view synthesis quality using coordinate-based neural scene representations. However, NeRF's view dependency can only handle simple reflections like highlights but cannot deal with…

计算机视觉与模式识别 · 计算机科学 2022-04-07 Yuan-Chen Guo , Di Kang , Linchao Bao , Yu He , Song-Hai Zhang

We present High Dynamic Range Neural Radiance Fields (HDR-NeRF) to recover an HDR radiance field from a set of low dynamic range (LDR) views with different exposures. Using the HDR-NeRF, we are able to generate both novel HDR views and…

计算机视觉与模式识别 · 计算机科学 2023-04-26 Xin Huang , Qi Zhang , Ying Feng , Hongdong Li , Xuan Wang , Qing Wang

Recently 3D-aware GAN methods with neural radiance field have developed rapidly. However, current methods model the whole image as an overall neural radiance field, which limits the partial semantic editability of synthetic results. Since…

计算机视觉与模式识别 · 计算机科学 2023-04-11 Tianxiang Ma , Bingchuan Li , Qian He , Jing Dong , Tieniu Tan