English
Related papers

Related papers: Interactive Segmentation of Radiance Fields

200 papers

Feature point detection and description is the backbone for various computer vision applications, such as Structure-from-Motion, visual SLAM, and visual place recognition. While learning-based methods have surpassed traditional handcrafted…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Ali Youssef , Francisco Vasconcelos

Neural Radiance Field (NeRF) has emerged as a compelling method to represent 3D objects and scenes for photo-realistic rendering. However, its implicit representation causes difficulty in manipulating the models like the explicit mesh…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Jiaxiang Tang , Xiaokang Chen , Jingbo Wang , Gang Zeng

Neural radiance fields provide state-of-the-art view synthesis quality but tend to be slow to render. One reason is that they make use of volume rendering, thus requiring many samples (and model queries) per ray at render time. Although…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Haithem Turki , Vasu Agrawal , Samuel Rota Bulò , Lorenzo Porzi , Peter Kontschieder , Deva Ramanan , Michael Zollhöfer , Christian Richardt

We present ObSuRF, a method which turns a single image of a scene into a 3D model represented as a set of Neural Radiance Fields (NeRFs), with each NeRF corresponding to a different object. A single forward pass of an encoder network…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Karl Stelzner , Kristian Kersting , Adam R. Kosiorek

Thin, reflective objects such as forks and whisks are common in our daily lives, but they are particularly challenging for robot perception because it is hard to reconstruct them using commodity RGB-D cameras or multi-view stereo…

Robotics · Computer Science 2022-04-28 Lin Yen-Chen , Pete Florence , Jonathan T. Barron , Tsung-Yi Lin , Alberto Rodriguez , Phillip Isola

A high-quality 3D reconstruction of a scene from a collection of 2D images can be achieved through offline/online mapping methods. In this paper, we explore active mapping from the perspective of implicit representations, which have…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Huangying Zhan , Jiyang Zheng , Yi Xu , Ian Reid , Hamid Rezatofighi

We introduce a technique for pairwise registration of neural fields that extends classical optimization-based local registration (i.e. ICP) to operate on Neural Radiance Fields (NeRF) -- neural 3D scene representations trained from…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Lily Goli , Daniel Rebain , Sara Sabour , Animesh Garg , Andrea Tagliasacchi

Neural Radiance Fields (NeRF) have emerged as a powerful representation for the task of novel view synthesis due to their simplicity and state-of-the-art performance. Though NeRF can produce photorealistic renderings of unseen viewpoints…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Michael Niemeyer , Jonathan T. Barron , Ben Mildenhall , Mehdi S. M. Sajjadi , Andreas Geiger , Noha Radwan

The emerging Neural Radiance Field (NeRF) shows great potential in representing 3D scenes, which can render photo-realistic images from novel view with only sparse views given. However, utilizing NeRF to reconstruct real-world scenes…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Chenbin Li , Yu Xin , Gaoyi Liu , Xiang Zeng , Ligang Liu

Although recent works based on deep learning have made progress in improving recognition accuracy on scene text recognition, how to handle low-quality text images in end-to-end deep networks remains a research challenge. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Zhiwei Jia , Shugong Xu , Shiyi Mu , Yue Tao , Shan Cao , Zhiyong Chen

Recent progress in computational photography has shown that we can acquire near-infrared (NIR) information in addition to the normal visible (RGB) band, with only slight modifications to standard digital cameras. Due to the proximity of the…

Computer Vision and Pattern Recognition · Computer Science 2014-06-25 Neda Salamati , Diane Larlus , Gabriela Csurka , Sabine Süsstrunk

This paper introduces a novel continual learning framework for synthesising novel views of multiple scenes, learning multiple 3D scenes incrementally, and updating the network parameters only with the training data of the upcoming new…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Yuze Wang , Junyi Wang , Chen Wang , Wantong Duan , Yongtang Bao , Yue Qi

Neural radiance fields (NeRFs) are able to synthesize realistic novel views from multi-view images captured from distinct positions and perspectives. In NeRF's rendering pipeline, neural networks are used to represent a scene independently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Kang Han , Wei Xiang , Lu Yu

View synthesis methods using implicit continuous shape representations learned from a set of images, such as the Neural Radiance Field (NeRF) method, have gained increasing attention due to their high quality imagery and scalability to high…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Guo-Wei Yang , Wen-Yang Zhou , Hao-Yang Peng , Dun Liang , Tai-Jiang Mu , Shi-Min Hu

Obtaining 3D object representations is important for creating photo-realistic simulations and for collecting AR and VR assets. Neural fields have shown their effectiveness in learning a continuous volumetric representation of a scene from…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Ashkan Mirzaei , Yash Kant , Jonathan Kelly , Igor Gilitschenski

Object pose estimation is a prominent task in computer vision. The object pose gives the orientation and translation of the object in real-world space, which allows various applications such as manipulation, augmented reality, etc. Various…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Varun Burde , Artem Moroz , Vit Zeman , Pavel Burget

Image segmentation is considered to be one of the critical tasks in hyperspectral remote sensing image processing. Recently, convolutional neural network (CNN) has established itself as a powerful model in segmentation and classification by…

Computer Vision and Pattern Recognition · Computer Science 2017-12-29 Fahim Irfan Alam , Jun Zhou , Alan Wee-Chung Liew , Xiuping Jia , Jocelyn Chanussot , Yongsheng Gao

Humans describe the physical world using natural language to refer to specific 3D locations based on a vast range of properties: visual appearance, semantics, abstract associations, or actionable affordances. In this work we propose…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Justin Kerr , Chung Min Kim , Ken Goldberg , Angjoo Kanazawa , Matthew Tancik

Neural Radiance Fields (NeRFs) are a very recent and very popular approach for the problems of novel view synthesis and 3D reconstruction. A popular scene representation used by NeRFs is to combine a uniform, voxel-based subdivision of the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jonas Kulhanek , Torsten Sattler

Superpixel segmentation has become an important research problem in image processing. In this paper, we propose an Iterative Spanning Forest (ISF) framework, based on sequences of Image Foresting Transforms, where one can choose i) a seed…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 John E. Vargas-Muñoz , Ananda S. Chowdhury , Eduardo B. Alexandre , Felipe L. Galvão , Paulo A. Vechiatto Miranda , Alexandre X. Falcão