中文
相关论文

相关论文: Sem2NeRF: Converting Single-View Semantic Masks to…

200 篇论文

Inferring a meaningful geometric scene representation from a single image is a fundamental problem in computer vision. Approaches based on traditional depth map prediction can only reason about areas that are visible in the image.…

计算机视觉与模式识别 · 计算机科学 2023-04-20 Felix Wimbauer , Nan Yang , Christian Rupprecht , Daniel Cremers

We propose a Transformer-based NeRF (TransNeRF) to learn a generic neural radiance field conditioned on observed-view images for the novel view synthesis task. By contrast, existing MLP-based NeRFs are not able to directly receive observed…

计算机视觉与模式识别 · 计算机科学 2022-06-14 Dan Wang , Xinrui Cui , Septimiu Salcudean , Z. Jane Wang

The ability of neural radiance fields or NeRFs to conduct accurate 3D modelling has motivated application of the technique to scene representation. Previous approaches have mainly followed a centralised learning paradigm, which assumes that…

计算机视觉与模式识别 · 计算机科学 2023-05-03 Lachlan Holden , Feras Dayoub , David Harvey , Tat-Jun Chin

In this paper, we propose a Neural Radiance Fields (NeRF) based framework, referred to as Novel View Synthesis Framework (NVSF). It jointly learns the implicit neural representation of space and time-varying scene for both LiDAR and Camera.…

计算机视觉与模式识别 · 计算机科学 2025-06-26 Gaurav Sharma , Ravi Kothari , Josef Schmid

Recent works on generalizable NeRFs have shown promising results on novel view synthesis from single or few images. However, such models have rarely been applied on other downstream tasks beyond synthesis such as semantic understanding and…

计算机视觉与模式识别 · 计算机科学 2024-04-10 Jianglong Ye , Naiyan Wang , Xiaolong Wang

NeRF is a popular model that efficiently represents 3D objects from 2D images. However, vanilla NeRF has some important limitations. NeRF must be trained on each object separately. The training time is long since we encode the object's…

计算机视觉与模式识别 · 计算机科学 2025-03-20 Dominik Zimny , Artur Kasymov , Adam Kania , Jacek Tabor , Maciej Zięba , Marcin Mazur , Przemysław Spurek

We present a method that achieves state-of-the-art results for synthesizing novel views of complex scenes by optimizing an underlying continuous volumetric scene function using a sparse set of input views. Our algorithm represents a scene…

计算机视觉与模式识别 · 计算机科学 2020-08-05 Ben Mildenhall , Pratul P. Srinivasan , Matthew Tancik , Jonathan T. Barron , Ravi Ramamoorthi , Ren Ng

We aim to obtain an interpretable, expressive, and disentangled scene representation that contains comprehensive structural and textural information for each object. Previous scene representations learned by neural networks are often…

计算机视觉与模式识别 · 计算机科学 2018-12-19 Shunyu Yao , Tzu Ming Harry Hsu , Jun-Yan Zhu , Jiajun Wu , Antonio Torralba , William T. Freeman , Joshua B. Tenenbaum

We propose Multi-spectral Neural Radiance Fields(Spec-NeRF) for jointly reconstructing a multispectral radiance field and spectral sensitivity functions(SSFs) of the camera from a set of color images filtered by different filters. The…

图像与视频处理 · 电气工程与系统科学 2023-10-23 Jiabao Li , Yuqi Li , Ciliang Sun , Chong Wang , Jinhui Xiang

We introduce a technique for pairwise registration of neural fields that extends classical optimization-based local registration (i.e. ICP) to operate on Neural Radiance Fields (NeRF) -- neural 3D scene representations trained from…

计算机视觉与模式识别 · 计算机科学 2022-11-04 Lily Goli , Daniel Rebain , Sara Sabour , Animesh Garg , Andrea Tagliasacchi

Neural Radiance Field (NeRF) approaches learn the underlying 3D representation of a scene and generate photo-realistic novel views with high fidelity. However, most proposed settings concentrate on modelling a single object or a single…

计算机视觉与模式识别 · 计算机科学 2023-08-22 Ankit Dhiman , Srinath R , Harsh Rangwani , Rishubh Parihar , Lokesh R Boregowda , Srinath Sridhar , R Venkatesh Babu

Recently 3D-aware GAN methods with neural radiance field have developed rapidly. However, current methods model the whole image as an overall neural radiance field, which limits the partial semantic editability of synthetic results. Since…

计算机视觉与模式识别 · 计算机科学 2023-04-11 Tianxiang Ma , Bingchuan Li , Qian He , Jing Dong , Tieniu Tan

Neural Radiance Field (NeRF) has gained considerable attention recently for 3D scene reconstruction and novel view synthesis due to its remarkable synthesis quality. However, image blurriness caused by defocus or motion, which often occurs…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Li Ma , Xiaoyu Li , Jing Liao , Qi Zhang , Xuan Wang , Jue Wang , Pedro V. Sander

Considering the problem of novel view synthesis (NVS) from only a set of 2D images, we simplify the training process of Neural Radiance Field (NeRF) on forward-facing scenes by removing the requirement of known or pre-computed camera…

计算机视觉与模式识别 · 计算机科学 2022-04-07 Zirui Wang , Shangzhe Wu , Weidi Xie , Min Chen , Victor Adrian Prisacariu

Neural Radiance Fields (NeRFs) are a powerful representation for modeling a 3D scene as a continuous function. Though NeRF is able to render complex 3D scenes with view-dependent effects, few efforts have been devoted to exploring its…

计算机视觉与模式识别 · 计算机科学 2022-11-18 Yifan Jiang , Peter Hedman , Ben Mildenhall , Dejia Xu , Jonathan T. Barron , Zhangyang Wang , Tianfan Xue

Neural Radiance Fields (NeRF) achieve impressive view synthesis results for a variety of capture settings, including 360 capture of bounded scenes and forward-facing capture of bounded and unbounded scenes. NeRF fits multi-layer perceptrons…

计算机视觉与模式识别 · 计算机科学 2020-10-23 Kai Zhang , Gernot Riegler , Noah Snavely , Vladlen Koltun

We address the problem of photorealistic 3D face avatar synthesis from sparse images. Existing Parametric models for face avatar reconstruction struggle to generate details that originate from inputs. Meanwhile, although current NeRF-based…

计算机视觉与模式识别 · 计算机科学 2023-06-27 Weichen Zhang , Xiang Zhou , Yukang Cao , Wensen Feng , Chun Yuan

Neural Radiance Fields (NeRF) have garnered considerable attention as a paradigm for novel view synthesis by learning scene representations from discrete observations. Nevertheless, NeRF exhibit pronounced performance degradation when…

计算机视觉与模式识别 · 计算机科学 2024-01-23 Zelin Gao , Weichen Dai , Yu Zhang

Extensions of Neural Radiance Fields (NeRFs) to model dynamic scenes have enabled their near photo-realistic, free-viewpoint rendering. Although these methods have shown some potential in creating immersive experiences, two drawbacks limit…

计算机视觉与模式识别 · 计算机科学 2024-06-07 Xinhang Liu , Yu-Wing Tai , Chi-Keung Tang , Pedro Miraldo , Suhas Lohit , Moitreya Chatterjee

Most deep learning approaches to comprehensive semantic modeling of 3D indoor spaces require costly dense annotations in the 3D domain. In this work, we explore a central 3D scene modeling task, namely, semantic scene reconstruction without…

计算机视觉与模式识别 · 计算机科学 2024-06-06 Junwen Huang , Alexey Artemov , Yujin Chen , Shuaifeng Zhi , Kai Xu , Matthias Nießner