中文
相关论文

相关论文: Semantically-aware Neural Radiance Fields for Visu…

200 篇论文

Neural Radiation Field (NeRF) technology can learn a 3D implicit model of a scene from 2D images and synthesize realistic novel view images. This technology has received widespread attention from the industry and has good application…

计算机视觉与模式识别 · 计算机科学 2024-04-19 Shun Fang , Ming Cui , Xing Feng , Yanna Lv

Neural Radiance Fields employ simple volume rendering as a way to overcome the challenges of differentiating through ray-triangle intersections by leveraging a probabilistic notion of visibility. This is achieved by assuming the scene is…

计算机视觉与模式识别 · 计算机科学 2022-09-07 Andrea Tagliasacchi , Ben Mildenhall

Neural radiance field (NeRF) attracts attention as a promising approach to reconstructing the 3D scene. As NeRF emerges, subsequent studies have been conducted to model dynamic scenes, which include motions or topological changes. However,…

计算机视觉与模式识别 · 计算机科学 2022-12-07 Hankyu Jang , Daeyoung Kim

In this paper, we address the "dual problem" of multi-view scene reconstruction in which we utilize single-view images captured under different point lights to learn a neural scene representation. Different from existing single-view methods…

计算机视觉与模式识别 · 计算机科学 2022-10-18 Wenqi Yang , Guanying Chen , Chaofeng Chen , Zhenfang Chen , Kwan-Yee K. Wong

In this work, we pioneer Semantic Flow, a neural semantic representation of dynamic scenes from monocular videos. In contrast to previous NeRF methods that reconstruct dynamic scenes from the colors and volume densities of individual…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Fengrui Tian , Yueqi Duan , Angtian Wang , Jianfei Guo , Shaoyi Du

While Neural Radiance Fields (NeRFs) had achieved unprecedented novel view synthesis results, they have been struggling in dealing with large-scale cluttered scenes with sparse input views and highly view-dependent appearances.…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Xinhang Liu , Yu-Wing Tai , Chi-Keung Tang

We present a unified and compact scene representation for robotics, where each object in the scene is depicted by a latent code capturing geometry and appearance. This representation can be decoded for various tasks such as novel view…

机器人学 · 计算机科学 2023-08-10 Valts Blukis , Taeyeop Lee , Jonathan Tremblay , Bowen Wen , In So Kweon , Kuk-Jin Yoon , Dieter Fox , Stan Birchfield

Neural volumetric representations such as Neural Radiance Fields (NeRF) have emerged as a compelling technique for learning to represent 3D scenes from images with the goal of rendering photorealistic images of the scene from unobserved…

计算机视觉与模式识别 · 计算机科学 2021-03-29 Peter Hedman , Pratul P. Srinivasan , Ben Mildenhall , Jonathan T. Barron , Paul Debevec

Neural Radiance Fields (NeRF), as a pioneering technique in computer vision, offer great potential to revolutionize medical imaging by synthesizing three-dimensional representations from the projected two-dimensional image data. However,…

图像与视频处理 · 电气工程与系统科学 2025-02-27 Xin Wang , Yineng Chen , Shu Hu , Heng Fan , Hongtu Zhu , Xin Li

Adopting Neural Radiance Fields (NeRF) to long-duration dynamic sequences has been challenging. Existing methods struggle to balance between quality and storage size and encounter difficulties with complex scene changes such as topological…

计算机视觉与模式识别 · 计算机科学 2023-12-12 Minye Wu , Tinne Tuytelaars

Reasoning the 3D structure of a non-rigid dynamic scene from a single moving camera is an under-constrained problem. Inspired by the remarkable progress of neural radiance fields (NeRFs) in photo-realistic novel view synthesis of static…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Sameera Ramasinghe , Violetta Shevchenko , Gil Avraham , Anton Van Den Hengel

With the advent of Neural Radiance Fields (NeRF), neural networks can now render novel views of a 3D scene with quality that fools the human eye. Yet, generating these images is very computationally intensive, limiting their applicability…

计算机视觉与模式识别 · 计算机科学 2020-11-26 Daniel Rebain , Wei Jiang , Soroosh Yazdani , Ke Li , Kwang Moo Yi , Andrea Tagliasacchi

Existing Neural Radiance Fields (NeRF) methods suffer from the existence of reflective objects, often resulting in blurry or distorted rendering. Instead of calculating a single radiance field, we propose a multi-space neural radiance field…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Ze-Xin Yin , Peng-Yi Jiao , Jiaxiong Qiu , Ming-Ming Cheng , Bo Ren

Despite the rapid development of Neural Radiance Field (NeRF), the necessity of dense covers largely prohibits its wider applications. While several recent works have attempted to address this issue, they either operate with sparse views…

计算机视觉与模式识别 · 计算机科学 2022-08-15 Dejia Xu , Yifan Jiang , Peihao Wang , Zhiwen Fan , Humphrey Shi , Zhangyang Wang

We present NeRFVS, a novel neural radiance fields (NeRF) based method to enable free navigation in a room. NeRF achieves impressive performance in rendering images for novel views similar to the input views while suffering for novel views…

计算机视觉与模式识别 · 计算机科学 2023-05-24 Chen Yang , Peihao Li , Zanwei Zhou , Shanxin Yuan , Bingbing Liu , Xiaokang Yang , Weichao Qiu , Wei Shen

Neural networks can represent and accurately reconstruct radiance fields for static 3D scenes (e.g., NeRF). Several works extend these to dynamic scenes captured with monocular video, with promising performance. However, the monocular…

计算机视觉与模式识别 · 计算机科学 2021-12-07 Benjamin Attal , Eliot Laidlaw , Aaron Gokaslan , Changil Kim , Christian Richardt , James Tompkin , Matthew O'Toole

Neural radiance fields (NeRFs) are a deep learning technique that can generate novel views of 3D scenes using sparse 2D images from different viewing directions and camera poses. As an extension of conventional NeRFs in underwater…

计算工程、金融与科学 · 计算机科学 2024-07-12 Haojie Lian , Xinhao Li , Yilin Qu , Jing Du , Zhuxuan Meng , Jie Liu , Leilei Chen

We propose X-NeRF, a novel method to learn a Cross-Spectral scene representation given images captured from cameras with different light spectrum sensitivity, based on the Neural Radiance Fields formulation. X-NeRF optimizes camera poses…

计算机视觉与模式识别 · 计算机科学 2022-09-02 Matteo Poggi , Pierluigi Zama Ramirez , Fabio Tosi , Samuele Salti , Stefano Mattoccia , Luigi Di Stefano

Neural Radiance Fields (NeRFs) have demonstrated prominent performance in novel view synthesis. However, their input heavily relies on image acquisition under normal light conditions, making it challenging to learn accurate scene…

计算机视觉与模式识别 · 计算机科学 2024-12-20 Min Wang , Xin Huang , Guoqing Zhou , Qifeng Guo , Qing Wang

Contemporary registration devices for 3D visual information, such as LIDARs and various depth cameras, capture data as 3D point clouds. In turn, such clouds are challenging to be processed due to their size and complexity. Existing methods…

计算机视觉与模式识别 · 计算机科学 2024-06-13 Dominik Zimny , Joanna Waczyńska , Tomasz Trzciński , Przemysław Spurek