English
Related papers

Related papers: Open-NeRF: Towards Open Vocabulary NeRF Decomposit…

200 papers

Utilizing multi-view inputs to synthesize novel-view images, Neural Radiance Fields (NeRF) have emerged as a popular research topic in 3D vision. In this work, we introduce a Generalizable Semantic Neural Radiance Field (GSNeRF), which…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Zi-Ting Chou , Sheng-Yu Huang , I-Jieh Liu , Yu-Chiang Frank Wang

Neural radiance fields (NeRF) have gained prominence as a machine learning technique for representing 3D scenes and estimating the bidirectional reflectance distribution function (BRDF) from multiple images. However, most existing research…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Lulin Zhang , Ewelina Rupnik , Tri Dung Nguyen , Stéphane Jacquemoud , Yann Klinger

Several variants of Neural Radiance Fields (NeRFs) have significantly improved the accuracy of synthesized images and surface reconstruction of 3D scenes/objects. In all of these methods, a key characteristic is that none can train the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Gonçalo Dias Pais , Valter Piedade , Moitreya Chatterjee , Marcus Greiff , Pedro Miraldo

Talking head synthesis is a practical technique with wide applications. Current Neural Radiance Field (NeRF) based approaches have shown their superiority on driving one-shot talking heads with videos or signals regressed from audio.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Dongze Li , Kang Zhao , Wei Wang , Yifeng Ma , Bo Peng , Yingya Zhang , Jing Dong

Recently, the Segment Anything Model (SAM) has showcased remarkable capabilities of zero-shot segmentation, while NeRF (Neural Radiance Fields) has gained popularity as a method for various 3D problems beyond novel view synthesis. Though…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Yichen Liu , Benran Hu , Chi-Keung Tang , Yu-Wing Tai

Existing neural reconstruction schemes such as Neural Radiance Field (NeRF) are largely focused on modeling opaque objects. We present a novel neural refractive field(NeReF) to recover wavefront of transparent fluids by simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Ziyu Wang , Wei Yang , Junming Cao , Lan Xu , Junqing Yu , Jingyi Yu

Reconstructing category-specific objects using Neural Radiance Field (NeRF) from a single image is a promising yet challenging task. Existing approaches predominantly rely on projection-based feature retrieval to associate 3D points in the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Kun Wang , Zhiqiang Yan , Zhenyu Zhang , Xiang Li , Jun Li , Jian Yang

Implicit surfaces via neural radiance fields (NeRF) have shown surprising accuracy in surface reconstruction. Despite their success in reconstructing richly textured surfaces, existing methods struggle with planar regions with weak…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Albert Gassol Puigjaner , Edoardo Mello Rella , Erik Sandström , Ajad Chhatkuli , Luc Van Gool

Modeling hand-object interactions is a fundamentally challenging task in 3D computer vision. Despite remarkable progress that has been achieved in this field, existing methods still fail to synthesize the hand-object interaction…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Zhongqun Zhang , Jifei Song , Eduardo Pérez-Pellitero , Yiren Zhou , Hyung Jin Chang , Aleš Leonardis

We present ONeRF, a method that automatically segments and reconstructs object instances in 3D from multi-view RGB images without any additional manual annotations. The segmented 3D objects are represented using separate Neural Radiance…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Shengnan Liang , Yichen Liu , Shangzhe Wu , Yu-Wing Tai , Chi-Keung Tang

First-Person-View (FPV) holds immense potential for revolutionizing the trajectory of Unmanned Aerial Vehicles (UAVs), offering an exhilarating avenue for navigating complex building structures. Yet, traditional Neural Radiance Field (NeRF)…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Liqi Yan , Qifan Wang , Junhan Zhao , Qiang Guan , Zheng Tang , Jianhui Zhang , Dongfang Liu

We introduce an approach for selecting objects in neural volumetric 3D representations, such as multi-plane images (MPI) and neural radiance fields (NeRF). Our approach takes a set of foreground and background 2D user scribbles in one view…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Zhongzheng Ren , Aseem Agarwala , Bryan Russell , Alexander G. Schwing , Oliver Wang

Simultaneously odometry and mapping using LiDAR data is an important task for mobile systems to achieve full autonomy in large-scale environments. However, most existing LiDAR-based methods prioritize tracking quality over reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Junyuan Deng , Xieyuanli Chen , Songpengcheng Xia , Zhen Sun , Guoqing Liu , Wenxian Yu , Ling Pei

We present NeuralLabeling, a labeling approach and toolset for annotating 3D scenes using either bounding boxes or meshes and generating segmentation masks, affordance maps, 2D bounding boxes, 3D bounding boxes, 6DOF object poses, depth…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Floris Erich , Naoya Chiba , Yusuke Yoshiyasu , Noriaki Ando , Ryo Hanai , Yukiyasu Domae

Generating high-fidelity talking head video by fitting with the input audio sequence is a challenging problem that receives considerable attentions recently. In this paper, we address this problem with the aid of neural scene representation…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Yudong Guo , Keyu Chen , Sen Liang , Yong-Jin Liu , Hujun Bao , Juyong Zhang

Articulated objects pose a unique challenge for robotic perception and manipulation. Their increased number of degrees-of-freedom makes tasks such as localization computationally difficult, while also making the process of real-world…

Robotics · Computer Science 2022-10-05 Stanley Lewis , Jana Pavlasek , Odest Chadwicke Jenkins

Novel view synthesis is an essential functionality for enabling immersive experiences in various Augmented- and Virtual-Reality (AR/VR) applications, for which generalizable Neural Radiance Fields (NeRFs) have gained increasing popularity…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yonggan Fu , Zhifan Ye , Jiayi Yuan , Shunyao Zhang , Sixu Li , Haoran You , Yingyan Celine Lin

A high-quality 3D reconstruction of a scene from a collection of 2D images can be achieved through offline/online mapping methods. In this paper, we explore active mapping from the perspective of implicit representations, which have…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Huangying Zhan , Jiyang Zheng , Yi Xu , Ian Reid , Hamid Rezatofighi

Recent novel view synthesis (NVS) techniques, including Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) have greatly advanced 3D scene reconstruction with high-quality rendering and realistic detail recovery. Effectively…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Wanzhou Liu , Zhexiao Xiong , Xinyu Li , Nathan Jacobs

Neural Radiance Field (NeRF) research has attracted significant attention recently, with 3D modelling, virtual/augmented reality, and visual effects driving its application. While current NeRF implementations can produce high quality visual…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Adrian Azzarelli , Nantheera Anantrasirichai , David R Bull