English
Related papers

Related papers: Fused-Planes: Why Train a Thousand Tri-Planes When…

200 papers

We investigate the use of Neural Radiance Fields (NeRF) to learn high quality 3D object category models from collections of input images. In contrast to previous work, we are able to do this whilst simultaneously separating foreground…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Christopher Xie , Keunhong Park , Ricardo Martin-Brualla , Matthew Brown

With the emergence of Neural Radiance Fields (NeRF), neural implicit representations have gained widespread applications across various domains, including simultaneous localization and mapping. However, current neural implicit SLAM faces a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Zhiyao Zhang , Yunzhou Zhang , Yanmin Wu , Bin Zhao , Xingshuo Wang , Rui Tian

Neural radiance fields (NeRF) bring a new wave for 3D interactive experiences. However, as an important part of the immersive experiences, the defocus effects have not been fully explored within NeRF. Some recent NeRF-based methods generate…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Yinhuai Wang , Shuzhou Yang , Yujie Hu , Jian Zhang

High-fidelity three-dimensional (3D) reconstruction is essential for robotics and simulation. While Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) achieve impressive rendering quality, their reliance on time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Xiong Jinlin , Li Can , Shen Jiawei , Qi Zhigang , Sun Lei , Zhao Dongyang

Most NeRF-based models are designed for learning the entire scene, and complex scenes can lead to longer learning times and poorer rendering effects. This paper utilizes scene semantic priors to make improvements in fast training, allowing…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Yuesong Li , Feng Pan , Helong Yan , Xiuli Xin , Xiaoxue Feng

In this work we propose 3D-FFS, a novel approach to make sensor fusion based 3D object detection networks significantly faster using a class of computationally inexpensive heuristics. Existing sensor fusion based networks generate 3D region…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Aniruddha Ganguly , Tasin Ishmam , Khandker Aftarul Islam , Md Zahidur Rahman , Md. Shamsuzzoha Bayzid

Recent works on generalizable NeRFs have shown promising results on novel view synthesis from single or few images. However, such models have rarely been applied on other downstream tasks beyond synthesis such as semantic understanding and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Jianglong Ye , Naiyan Wang , Xiaolong Wang

Learning-based 3D reconstruction using implicit neural representations has shown promising progress not only at the object level but also in more complicated scenes. In this paper, we propose Dynamic Plane Convolutional Occupancy Networks,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-12 Stefan Lionar , Daniil Emtsev , Dusan Svilarkovic , Songyou Peng

This paper proposes a novel approach for rendering a pre-trained Neural Radiance Field (NeRF) in real-time on resource-constrained devices. We introduce Re-ReND, a method enabling Real-time Rendering of NeRFs across Devices. Re-ReND is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Sara Rojas , Jesus Zarzar , Juan Camilo Perez , Artsiom Sanakoyeu , Ali Thabet , Albert Pumarola , Bernard Ghanem

Most Neural Radiance Fields (NeRFs) exhibit limited generalization capabilities, which restrict their applicability in representing multiple scenes using a single model. To address this problem, existing generalizable NeRF methods simply…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Ganlin Yang , Guoqiang Wei , Zhizheng Zhang , Yan Lu , Dong Liu

Intraoperative imaging techniques for reconstructing deformable tissues in vivo are pivotal for advanced surgical systems. Existing methods either compromise on rendering quality or are excessively computationally intensive, often demanding…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Chen Yang , Kailing Wang , Yuehao Wang , Qi Dou , Xiaokang Yang , Wei Shen

A long-standing goal in scene understanding is to obtain interpretable and editable representations that can be directly constructed from a raw monocular RGB-D video, without requiring specialized hardware setup or priors. The problem is…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Yu-Shiang Wong , Niloy J. Mitra

We evaluate different Neural Radiance Fields (NeRFs) techniques for the 3D reconstruction of plants in varied environments, from indoor settings to outdoor fields. Traditional methods usually fail to capture the complex geometric details of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Muhammad Arbab Arshad , Talukder Jubery , James Afful , Anushrut Jignasu , Aditya Balu , Baskar Ganapathysubramanian , Soumik Sarkar , Adarsh Krishnamurthy

We present UniPlane, a novel method that unifies plane detection and reconstruction from posed monocular videos. Unlike existing methods that detect planes from local observations and associate them across the video for the final…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yuzhong Huang , Chen Liu , Ji Hou , Ke Huo , Shiyu Dong , Fred Morstatter

Contemporary 3D research, particularly in reconstruction and generation, heavily relies on 2D images for inputs or supervision. However, current designs for these 2D-3D mapping are memory-intensive, posing a significant bottleneck for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Ang Cao , Justin Johnson , Andrea Vedaldi , David Novotny

This paper introduces a novel continual learning framework for synthesising novel views of multiple scenes, learning multiple 3D scenes incrementally, and updating the network parameters only with the training data of the upcoming new…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Yuze Wang , Junyi Wang , Chen Wang , Wantong Duan , Yongtang Bao , Yue Qi

Mobile robots require comprehensive scene understanding to operate effectively in diverse environments, enriched with contextual information such as layouts, objects, and their relationships. Although advances like neural radiation fields…

Robotics · Computer Science 2024-12-30 Jiawei Hou , Wenhao Guan , Longfei Liang , Jianfeng Feng , Xiangyang Xue , Taiping Zeng

Recent progress in NeRF-based GANs has introduced a number of approaches for high-resolution and high-fidelity generative modeling of human heads with a possibility for novel view rendering. At the same time, one must solve an inverse…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Ananta R. Bhattarai , Matthias Nießner , Artem Sevastopolsky

Creating diverse and high-quality 3D assets with an automatic generative model is highly desirable. Despite extensive efforts on 3D generation, most existing works focus on the generation of a single category or a few categories. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Ziang Cao , Fangzhou Hong , Tong Wu , Liang Pan , Ziwei Liu

This paper presents Neural Mesh Fusion (NMF), an efficient approach for joint optimization of polygon mesh from multi-view image observations and unsupervised 3D planar-surface parsing of the scene. In contrast to implicit neural…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Farhad G. Zanjani , Hong Cai , Yinhao Zhu , Leyla Mirvakhabova , Fatih Porikli