English
Related papers

Related papers: InvNeRF-Seg: Fine-Tuning a Pre-Trained NeRF for 3D…

200 papers

Radiance Fields (RF) are popular to represent casually-captured scenes for new view synthesis and several applications beyond it. Mixed reality on personal spaces needs understanding and manipulating scenes represented as RFs, with semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Rahul Goel , Dhawal Sirikonda , Saurabh Saini , PJ Narayanan

Despite the rapid development of Neural Radiance Field (NeRF), the necessity of dense covers largely prohibits its wider applications. While several recent works have attempted to address this issue, they either operate with sparse views…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Dejia Xu , Yifan Jiang , Peihao Wang , Zhiwen Fan , Humphrey Shi , Zhangyang Wang

Learning a 3D representation of a scene has been a challenging problem for decades in computer vision. Recent advances in implicit neural representation from images using neural radiance fields(NeRF) have shown promising results. Some of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Arnab Dey , Andrew I. Comport

We propose Multi-spectral Neural Radiance Fields(Spec-NeRF) for jointly reconstructing a multispectral radiance field and spectral sensitivity functions(SSFs) of the camera from a set of color images filtered by different filters. The…

Image and Video Processing · Electrical Eng. & Systems 2023-10-23 Jiabao Li , Yuqi Li , Ciliang Sun , Chong Wang , Jinhui Xiang

The development of Neural Radiance Fields (NeRFs) has provided a potent representation for encapsulating the geometric and appearance characteristics of 3D scenes. Enhancing the capabilities of NeRFs in open-vocabulary 3D semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Guibiao Liao , Kaichen Zhou , Zhenyu Bao , Kanglin Liu , Qing Li

Recent advances in neural radiance fields have enabled the high-fidelity 3D reconstruction of complex scenes for novel view synthesis. However, it remains underexplored how the appearance of such representations can be efficiently edited…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Zhengfei Kuang , Fujun Luan , Sai Bi , Zhixin Shu , Gordon Wetzstein , Kalyan Sunkavalli

Accurate reconstruction of plant phenotypes plays a key role in optimising sustainable farming practices in the field of Precision Agriculture (PA). Currently, optical sensor-based approaches dominate the field, but the need for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Kewei Hu , Ying Wei , Yaoqiang Pan , Hanwen Kang , Chao Chen

Neural radiance fields (NeRFs) are a deep learning technique that can generate novel views of 3D scenes using sparse 2D images from different viewing directions and camera poses. As an extension of conventional NeRFs in underwater…

Computational Engineering, Finance, and Science · Computer Science 2024-07-12 Haojie Lian , Xinhao Li , Yilin Qu , Jing Du , Zhuxuan Meng , Jie Liu , Leilei Chen

Previous portrait image generation methods roughly fall into two categories: 2D GANs and 3D-aware GANs. 2D GANs can generate high fidelity portraits but with low view consistency. 3D-aware GAN methods can maintain view consistency but their…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Jingxiang Sun , Xuan Wang , Yong Zhang , Xiaoyu Li , Qi Zhang , Yebin Liu , Jue Wang

Neural radiance fields (NeRF) have gained prominence as a machine learning technique for representing 3D scenes and estimating the bidirectional reflectance distribution function (BRDF) from multiple images. However, most existing research…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Lulin Zhang , Ewelina Rupnik , Tri Dung Nguyen , Stéphane Jacquemoud , Yann Klinger

3D representation disentanglement aims to identify, decompose, and manipulate the underlying explanatory factors of 3D data, which helps AI fundamentally understand our 3D world. This task is currently under-explored and poses great…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Baao Xie , Bohan Li , Zequn Zhang , Junting Dong , Xin Jin , Jingyu Yang , Wenjun Zeng

In recent years, the performance of novel view synthesis using perspective images has dramatically improved with the advent of neural radiance fields (NeRF). This study proposes two novel techniques that effectively build NeRF for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Takashi Otonari , Satoshi Ikehata , Kiyoharu Aizawa

Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) have emerged as powerful tools for 3D reconstruction and SLAM tasks. However, their performance depends heavily on accurate camera pose priors. Existing approaches attempt to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Qingsong Yan , Qiang Wang , Kaiyong Zhao , Jie Chen , Bo Li , Xiaowen Chu , Fei Deng

We propose a novel visual re-localization method based on direct matching between the implicit 3D descriptors and the 2D image with transformer. A conditional neural radiance field(NeRF) is chosen as the 3D scene representation in our…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Jianlin Liu , Qiang Nie , Yong Liu , Chengjie Wang

Semantic labelling is highly correlated with geometry and radiance reconstruction, as scene entities with similar shape and appearance are more likely to come from similar classes. Recent implicit neural reconstruction techniques are…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Shuaifeng Zhi , Tristan Laidlow , Stefan Leutenegger , Andrew J. Davison

Radiance fields have gradually become a main representation of media. Although its appearance editing has been studied, how to achieve view-consistent recoloring in an efficient manner is still under explored. We present RecolorNeRF, a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Bingchen Gong , Yuehao Wang , Xiaoguang Han , Qi Dou

We introduce InFusionSurf, an innovative enhancement for neural radiance field (NeRF) frameworks in 3D surface reconstruction using RGB-D video frames. Building upon previous methods that have employed feature encoding to improve…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Seunghwan Lee , Gwanmo Park , Hyewon Son , Jiwon Ryu , Han Joo Chae

Neural scene representations, such as Neural Radiance Fields (NeRF), are based on training a multilayer perceptron (MLP) using a set of color images with known poses. An increasing number of devices now produce RGB-D(color + depth)…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Arnab Dey , Yassine Ahmine , Andrew I. Comport

Neural Radiance Field (NeRF) is a powerful tool to faithfully generate novel views for scenes with only sparse captured images. Despite its strong capability for representing 3D scenes and their appearance, its editing ability is very…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Qiling Wu , Jianchao Tan , Kun Xu

3D reconstruction technology generates three-dimensional representations of real-world objects, scenes, or environments using sensor data such as 2D images, with extensive applications in robotics, autonomous vehicles, and virtual reality…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Hong Zhang , Fei Guo , Zihan Xie , Dizhao Yao