中文
相关论文

相关论文: Neural Feature Fusion Fields: 3D Distillation of S…

200 篇论文

We propose DistillNeRF, a self-supervised learning framework addressing the challenge of understanding 3D environments from limited 2D observations in outdoor autonomous driving scenes. Our method is a generalizable feedforward model that…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Letian Wang , Seung Wook Kim , Jiawei Yang , Cunjun Yu , Boris Ivanovic , Steven L. Waslander , Yue Wang , Sanja Fidler , Marco Pavone , Peter Karkus

Emerging neural radiance fields (NeRF) are a promising scene representation for computer graphics, enabling high-quality 3D reconstruction and novel view synthesis from image observations. However, editing a scene represented by a NeRF is…

计算机视觉与模式识别 · 计算机科学 2022-10-18 Sosuke Kobayashi , Eiichi Matsumoto , Vincent Sitzmann

Recent advances in neural scene representations have led to unprecedented quality in 3D reconstruction and view synthesis. Despite achieving high-quality results for common benchmarks with curated data, outputs often degrade for data that…

Neural fields (NeRF) have emerged as a promising approach for representing continuous 3D scenes. Nevertheless, the lack of semantic encoding in NeRFs poses a significant challenge for scene decomposition. To address this challenge, we…

计算机视觉与模式识别 · 计算机科学 2024-05-09 Ning Wang , Lefei Zhang , Angel X Chang

This paper introduces a novel continual learning framework for synthesising novel views of multiple scenes, learning multiple 3D scenes incrementally, and updating the network parameters only with the training data of the upcoming new…

计算机视觉与模式识别 · 计算机科学 2024-09-10 Yuze Wang , Junyi Wang , Chen Wang , Wantong Duan , Yongtang Bao , Yue Qi

Implicit neural representations have shown powerful capacity in modeling real-world 3D scenes, offering superior performance in novel view synthesis. In this paper, we target a more challenging scenario, i.e., joint scene novel view…

计算机视觉与模式识别 · 计算机科学 2023-08-08 Yuxin Wang , Wayne Wu , Dan Xu

Several variants of Neural Radiance Fields (NeRFs) have significantly improved the accuracy of synthesized images and surface reconstruction of 3D scenes/objects. In all of these methods, a key characteristic is that none can train the…

计算机视觉与模式识别 · 计算机科学 2025-06-11 Gonçalo Dias Pais , Valter Piedade , Moitreya Chatterjee , Marcus Greiff , Pedro Miraldo

We study the problem of reconstructing 3D feature curves of an object from a set of calibrated multi-view images. To do so, we learn a neural implicit field representing the density distribution of 3D edges which we refer to as Neural Edge…

计算机视觉与模式识别 · 计算机科学 2023-03-17 Yunfan Ye , Renjiao Yi , Zhirui Gao , Chenyang Zhu , Zhiping Cai , Kai Xu

This paper presents Neural Mesh Fusion (NMF), an efficient approach for joint optimization of polygon mesh from multi-view image observations and unsupervised 3D planar-surface parsing of the scene. In contrast to implicit neural…

计算机视觉与模式识别 · 计算机科学 2024-02-27 Farhad G. Zanjani , Hong Cai , Yinhao Zhu , Leyla Mirvakhabova , Fatih Porikli

Recent works on generalizable NeRFs have shown promising results on novel view synthesis from single or few images. However, such models have rarely been applied on other downstream tasks beyond synthesis such as semantic understanding and…

计算机视觉与模式识别 · 计算机科学 2024-04-10 Jianglong Ye , Naiyan Wang , Xiaolong Wang

Understanding 3D scenes is a crucial challenge in computer vision research with applications spanning multiple domains. Recent advancements in distilling 2D vision-language foundation models into neural fields, like NeRF and 3DGS, enable…

计算机视觉与模式识别 · 计算机科学 2024-12-20 Zihan Gao , Lingling Li , Licheng Jiao , Fang Liu , Xu Liu , Wenping Ma , Yuwei Guo , Shuyuan Yang

We present a novel method for performing flexible, 3D-aware image content manipulation while enabling high-quality novel view synthesis. While NeRF-based approaches are effective for novel view synthesis, such models memorize the radiance…

计算机视觉与模式识别 · 计算机科学 2022-04-25 Verica Lazova , Vladimir Guzov , Kyle Olszewski , Sergey Tulyakov , Gerard Pons-Moll

With Neural Radiance Fields (NeRFs) arising as a powerful 3D representation, research has investigated its various downstream tasks, including inpainting NeRFs with 2D images. Despite successful efforts addressing the view consistency and…

图像与视频处理 · 电气工程与系统科学 2025-04-04 Jingyu Shi , Achleshwar Luthra , Jiazhi Li , Xiang Gao , Xiyun Song , Zongfang Lin , David Gu , Heather Yu

Neural radiance fields (NeRFs) enable novel view synthesis with unprecedented visual quality. However, to render photorealistic images, NeRFs require hundreds of deep multilayer perceptron (MLP) evaluations - for each pixel. This is…

计算机视觉与模式识别 · 计算机科学 2023-04-21 Ziyu Wan , Christian Richardt , Aljaž Božič , Chao Li , Vijay Rengarajan , Seonghyeon Nam , Xiaoyu Xiang , Tuotuo Li , Bo Zhu , Rakesh Ranjan , Jing Liao

Recent research explosion on Neural Radiance Field (NeRF) shows the encouraging potential to represent complex scenes with neural networks. One major drawback of NeRF is its prohibitive inference time: Rendering a single pixel requires…

计算机视觉与模式识别 · 计算机科学 2022-07-26 Huan Wang , Jian Ren , Zeng Huang , Kyle Olszewski , Menglei Chai , Yun Fu , Sergey Tulyakov

Deep neural networks (DNNs) are widely applied for nowadays 3D surface reconstruction tasks and such methods can be further divided into two categories, which respectively warp templates explicitly by moving vertices or represent 3D…

计算机视觉与模式识别 · 计算机科学 2023-06-06 Xianghui Yang , Guosheng Lin , Zhenghao Chen , Luping Zhou

Novel view synthesis from a single image requires inferring occluded regions of objects and scenes whilst simultaneously maintaining semantic and physical consistency with the input. Existing approaches condition neural radiance fields…

计算机视觉与模式识别 · 计算机科学 2023-02-21 Jiatao Gu , Alex Trevithick , Kai-En Lin , Josh Susskind , Christian Theobalt , Lingjie Liu , Ravi Ramamoorthi

In this paper, we present an efficient and robust deep learning solution for novel view synthesis of complex scenes. In our approach, a 3D scene is represented as a light field, i.e., a set of rays, each of which has a corresponding color…

计算机视觉与模式识别 · 计算机科学 2022-07-08 Zhong Li , Liangchen Song , Celong Liu , Junsong Yuan , Yi Xu

3D scene representations have gained immense popularity in recent years. Methods that use Neural Radiance fields are versatile for traditional tasks such as novel view synthesis. In recent times, some work has emerged that aims to extend…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Shijie Zhou , Haoran Chang , Sicheng Jiang , Zhiwen Fan , Zehao Zhu , Dejia Xu , Pradyumna Chari , Suya You , Zhangyang Wang , Achuta Kadambi

Neural radiance fields (NeRFs) have exhibited potential in synthesizing high-fidelity views of 3D scenes but the standard training paradigm of NeRF presupposes an equal importance for each image in the training set. This assumption poses a…

计算机视觉与模式识别 · 计算机科学 2024-01-30 Rongkai Ma , Leo Lebrat , Rodrigo Santa Cruz , Gil Avraham , Yan Zuo , Clinton Fookes , Olivier Salvado
‹ 上一页 1 2 3 10 下一页 ›