English
Related papers

Related papers: Cross-view Self-localization from Synthesized Scen…

200 papers

We introduce ViewNeRF, a Neural Radiance Field-based viewpoint estimation method that learns to predict category-level viewpoints directly from images during training. While NeRF is usually trained with ground-truth camera poses, multiple…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Octave Mariotti , Oisin Mac Aodha , Hakan Bilen

The integration of complementary characteristics from camera and radar data has emerged as an effective approach in 3D object detection. However, such fusion-based methods remain unexplored for place recognition, an equally important task…

Robotics · Computer Science 2024-03-25 Shaowei Fu , Yifan Duan , Yao Li , Chengzhen Meng , Yingjie Wang , Jianmin Ji , Yanyong Zhang

Due to the ability to synthesize high-quality novel views, Neural Radiance Fields (NeRF) have been recently exploited to improve visual localization in a known environment. However, the existing methods mostly utilize NeRFs for data…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Boming Zhao , Luwei Yang , Mao Mao , Hujun Bao , Zhaopeng Cui

We propose a Transformer-based NeRF (TransNeRF) to learn a generic neural radiance field conditioned on observed-view images for the novel view synthesis task. By contrast, existing MLP-based NeRFs are not able to directly receive observed…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Dan Wang , Xinrui Cui , Septimiu Salcudean , Z. Jane Wang

Neural Radiance Field (NeRF) approaches learn the underlying 3D representation of a scene and generate photo-realistic novel views with high fidelity. However, most proposed settings concentrate on modelling a single object or a single…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Ankit Dhiman , Srinath R , Harsh Rangwani , Rishubh Parihar , Lokesh R Boregowda , Srinath Sridhar , R Venkatesh Babu

Recent advancements in 4D scene reconstruction using neural radiance fields (NeRF) have demonstrated the ability to represent dynamic scenes from multi-view videos. However, they fail to reconstruct the dynamic scenes and struggle to fit…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Seoha Kim , Jeongmin Bae , Youngsik Yun , Hahyun Lee , Gun Bang , Youngjung Uh

Most existing approaches for visual localization either need a detailed 3D model of the environment or, in the case of learning-based methods, must be retrained for each new scene. This can either be very expensive or simply impossible for…

Robotics · Computer Science 2021-06-22 Dominik Winkelbauer , Maximilian Denninger , Rudolph Triebel

Beyond novel view synthesis, Neural Radiance Fields are useful for applications that interact with the real world. In this paper, we use them as an implicit map of a given scene and propose a camera relocalization algorithm tailored for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Arthur Moreau , Nathan Piasco , Moussab Bennehar , Dzmitry Tsishkou , Bogdan Stanciulescu , Arnaud de La Fortelle

Novel view synthesis (NVS) is a challenging task in computer vision that involves synthesizing new views of a scene from a limited set of input images. Neural Radiance Fields (NeRF) have emerged as a powerful approach to address this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Shuja Khalid , Frank Rudzicz

Utilizing multi-view inputs to synthesize novel-view images, Neural Radiance Fields (NeRF) have emerged as a popular research topic in 3D vision. In this work, we introduce a Generalizable Semantic Neural Radiance Field (GSNeRF), which…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Zi-Ting Chou , Sheng-Yu Huang , I-Jieh Liu , Yu-Chiang Frank Wang

Neural Radiance Fields (NeRFs) aim to synthesize novel views of objects and scenes, given the object-centric camera views with large overlaps. However, we conjugate that this paradigm does not fit the nature of the street views that are…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Ziyang Xie , Junge Zhang , Wenye Li , Feihu Zhang , Li Zhang

Novel view synthesis refers to the problem of synthesizing novel viewpoints of a scene given the images from a few viewpoints. This is a fundamental problem in computer vision and graphics, and enables a vast variety of applications such as…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Nagabhushan Somraj

Camera relocalization is a crucial problem in computer vision and robotics. Recent advancements in neural radiance fields (NeRFs) have shown promise in synthesizing photo-realistic images. Several works have utilized NeRFs for refining…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Shiyao Xu , Caiyun Liu , Yuantao Chen , Zhenxin Zhu , Zike Yan , Yongliang Shi , Hao Zhao , Guyue Zhou

In this paper, we address the problem of cross-view image geo-localization. Specifically, we aim to estimate the GPS location of a query street view image by finding the matching images in a reference database of geo-tagged bird's eye view…

Computer Vision and Pattern Recognition · Computer Science 2017-03-24 Yicong Tian , Chen Chen , Mubarak Shah

In recent years, the performance of novel view synthesis using perspective images has dramatically improved with the advent of neural radiance fields (NeRF). This study proposes two novel techniques that effectively build NeRF for…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Takashi Otonari , Satoshi Ikehata , Kiyoharu Aizawa

The visual entities in cross-view images exhibit drastic domain changes due to the difference in viewpoints each set of images is captured from. Existing state-of-the-art methods address the problem by learning view-invariant descriptors…

Computer Vision and Pattern Recognition · Computer Science 2019-08-12 Krishna Regmi , Mubarak Shah

Neural Radiance Fields, or NeRFs, have drastically improved novel view synthesis and 3D reconstruction for rendering. NeRFs achieve impressive results on object-centric reconstructions, but the quality of novel view synthesis with…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Georgios Kopanas , George Drettakis

Considering the problem of novel view synthesis (NVS) from only a set of 2D images, we simplify the training process of Neural Radiance Field (NeRF) on forward-facing scenes by removing the requirement of known or pre-computed camera…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Zirui Wang , Shangzhe Wu , Weidi Xie , Min Chen , Victor Adrian Prisacariu

Neural Radiance Fields (NeRF) have demonstrated very impressive performance in novel view synthesis via implicitly modelling 3D representations from multi-view 2D images. However, most existing studies train NeRF models with either…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Jiahui Zhang , Fangneng Zhan , Rongliang Wu , Yingchen Yu , Wenqing Zhang , Bai Song , Xiaoqin Zhang , Shijian Lu

Training computer vision models usually requires collecting and labeling vast amounts of imagery under a diverse set of scene configurations and properties. This process is incredibly time-consuming, and it is challenging to ensure that the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Yunhao Ge , Harkirat Behl , Jiashu Xu , Suriya Gunasekar , Neel Joshi , Yale Song , Xin Wang , Laurent Itti , Vibhav Vineet