中文
相关论文

相关论文: SNeRL: Semantic-aware Neural Radiance Fields for R…

200 篇论文

Neural Representations have recently been shown to effectively reconstruct a wide range of signals from 3D meshes and shapes to images and videos. We show that, when adapted correctly, neural representations can be used to directly…

机器学习 · 计算机科学 2023-04-24 Maor Ashkenazi , Zohar Rimon , Ron Vainshtein , Shir Levi , Elad Richardson , Pinchas Mintz , Eran Treister

Neural fields excel in computer vision and robotics due to their ability to understand the 3D visual world such as inferring semantics, geometry, and dynamics. Given the capabilities of neural fields in densely representing a 3D scene from…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Muhammad Zubair Irshad , Sergey Zakharov , Vitor Guizilini , Adrien Gaidon , Zsolt Kira , Rares Ambrus

Neural Radiance Fields (NeRF) show impressive performance in photo-realistic free-view rendering of scenes. Recent improvements on the NeRF such as TensoRF and ZipNeRF employ explicit models for faster optimization and rendering, as…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Nagabhushan Somraj , Sai Harsha Mupparaju , Adithyan Karanayil , Rajiv Soundararajan

We present DietNeRF, a 3D neural scene representation estimated from a few images. Neural Radiance Fields (NeRF) learn a continuous volumetric representation of a scene through multi-view consistency, and can be rendered from novel…

计算机视觉与模式识别 · 计算机科学 2021-04-02 Ajay Jain , Matthew Tancik , Pieter Abbeel

3D reconstruction from images has wide applications in Virtual Reality and Automatic Driving, where the precision requirement is very high. Ground-breaking research in the neural radiance field (NeRF) by utilizing Multi-Layer Perceptions…

计算机视觉与模式识别 · 计算机科学 2022-09-28 Jiaming Shen , Bolin Song , Zirui Wu , Yi Xu

Neural Radiance Field (NeRF) and its variants have recently emerged as successful methods for novel view synthesis and 3D scene reconstruction. However, most current NeRF models either achieve high accuracy using large model sizes, or…

计算机视觉与模式识别 · 计算机科学 2024-10-16 Shiran Yuan , Hao Zhao

The recent progress in implicit 3D representation, i.e., Neural Radiance Fields (NeRFs), has made accurate and photorealistic 3D reconstruction possible in a differentiable manner. This new representation can effectively convey the…

计算机视觉与模式识别 · 计算机科学 2022-08-25 Yoonwoo Jeong , Seungjoo Shin , Junha Lee , Christopher Choy , Animashree Anandkumar , Minsu Cho , Jaesik Park

In this paper, we aim to learn a semantic radiance field from multiple scenes that is accurate, efficient and generalizable. While most existing NeRFs target at the tasks of neural scene rendering, image synthesis and multi-view…

计算机视觉与模式识别 · 计算机科学 2023-03-24 Fangfu Liu , Chubin Zhang , Yu Zheng , Yueqi Duan

We propose DistillNeRF, a self-supervised learning framework addressing the challenge of understanding 3D environments from limited 2D observations in outdoor autonomous driving scenes. Our method is a generalizable feedforward model that…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Letian Wang , Seung Wook Kim , Jiawei Yang , Cunjun Yu , Boris Ivanovic , Steven L. Waslander , Yue Wang , Sanja Fidler , Marco Pavone , Peter Karkus

Recently 3D-aware GAN methods with neural radiance field have developed rapidly. However, current methods model the whole image as an overall neural radiance field, which limits the partial semantic editability of synthetic results. Since…

计算机视觉与模式识别 · 计算机科学 2023-04-11 Tianxiang Ma , Bingchuan Li , Qian He , Jing Dong , Tieniu Tan

Recent advances in neural rendering have shown that, albeit slow, implicit compact models can learn a scene's geometries and view-dependent appearances from multiple views. To maintain such a small memory footprint but achieve faster…

计算机视觉与模式识别 · 计算机科学 2023-12-14 Juan Luis Gonzalez Bello , Minh-Quan Viet Bui , Munchurl Kim

Image blending aims to combine multiple images seamlessly. It remains challenging for existing 2D-based methods, especially when input images are misaligned due to differences in 3D camera poses and object shapes. To tackle these issues, we…

计算机视觉与模式识别 · 计算机科学 2023-08-17 Hyunsu Kim , Gayoung Lee , Yunjey Choi , Jin-Hwa Kim , Jun-Yan Zhu

Online reconstructing and rendering of large-scale indoor scenes is a long-standing challenge. SLAM-based methods can reconstruct 3D scene geometry progressively in real time but can not render photorealistic results. While NeRF-based…

计算机视觉与模式识别 · 计算机科学 2023-04-19 Yiming Gao , Yan-Pei Cao , Ying Shan

Image translation and manipulation have gain increasing attention along with the rapid development of deep generative models. Although existing approaches have brought impressive results, they mainly operated in 2D space. In light of recent…

计算机视觉与模式识别 · 计算机科学 2023-04-04 Yuedong Chen , Qianyi Wu , Chuanxia Zheng , Tat-Jen Cham , Jianfei Cai

Neural Radiance Fields (NeRF) accomplishes photo-realistic novel view synthesis by learning the implicit volumetric representation of a scene from multi-view images, which faithfully convey the colorimetric information. However, sensor…

计算机视觉与模式识别 · 计算机科学 2024-03-22 Jiacong Xu , Mingqian Liao , K Ram Prabhakar , Vishal M. Patel

Neural Radiance Field (NeRF) is a promising approach for synthesizing novel views, given a set of images and the corresponding camera poses of a scene. However, images photographed from a low-light scene can hardly be used to train a NeRF…

计算机视觉与模式识别 · 计算机科学 2023-07-21 Haoyuan Wang , Xiaogang Xu , Ke Xu , Rynson WH. Lau

In recent years, Neural Radiance Fields (NeRFs) have demonstrated significant potential in encoding highly-detailed 3D geometry and environmental appearance, positioning themselves as a promising alternative to traditional explicit…

计算机视觉与模式识别 · 计算机科学 2024-03-18 Tianxiang Ye , Qi Wu , Junyuan Deng , Guoqing Liu , Liu Liu , Songpengcheng Xia , Liang Pang , Wenxian Yu , Ling Pei

We propose pixelNeRF, a learning framework that predicts a continuous neural scene representation conditioned on one or few input images. The existing approach for constructing neural radiance fields involves optimizing the representation…

计算机视觉与模式识别 · 计算机科学 2021-06-01 Alex Yu , Vickie Ye , Matthew Tancik , Angjoo Kanazawa

We present a new method for estimating the Neural Reflectance Field (NReF) of an object from a set of posed multi-view images under unknown lighting. NReF represents 3D geometry and appearance of objects in a disentangled manner, and are…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Xiu Li , Xiao Li , Yan Lu

Neural Radiation Field (NeRF) technology can learn a 3D implicit model of a scene from 2D images and synthesize realistic novel view images. This technology has received widespread attention from the industry and has good application…

计算机视觉与模式识别 · 计算机科学 2024-04-19 Shun Fang , Ming Cui , Xing Feng , Yanna Lv