English
Related papers

Related papers: CRAYM: Neural Field Optimization via Camera RAY Ma…

200 papers

We present a method that achieves state-of-the-art results for synthesizing novel views of complex scenes by optimizing an underlying continuous volumetric scene function using a sparse set of input views. Our algorithm represents a scene…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Ben Mildenhall , Pratul P. Srinivasan , Matthew Tancik , Jonathan T. Barron , Ravi Ramamoorthi , Ren Ng

Considering the problem of novel view synthesis (NVS) from only a set of 2D images, we simplify the training process of Neural Radiance Field (NeRF) on forward-facing scenes by removing the requirement of known or pre-computed camera…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Zirui Wang , Shangzhe Wu , Weidi Xie , Min Chen , Victor Adrian Prisacariu

Recently, Neural Radiance Field (NeRF) has shown great success in rendering novel-view images of a given scene by learning an implicit representation with only posed RGB images. NeRF and relevant neural field methods (e.g., neural surface…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Zeke Xie , Xindi Yang , Yujie Yang , Qi Sun , Yixiang Jiang , Haoran Wang , Yunfeng Cai , Mingming Sun

Photo-realistic rendering and novel view synthesis play a crucial role in human-computer interaction tasks, from gaming to path planning. Neural Radiance Fields (NeRFs) model scenes as continuous volumetric functions and achieve remarkable…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Iryna Repinetska , Anna Hilsmann , Peter Eisert

This paper presents SIM-Sync, a certifiably optimal algorithm that estimates camera trajectory and 3D scene structure directly from multiview image keypoints. SIM-Sync fills the gap between pose graph optimization and bundle adjustment; the…

Robotics · Computer Science 2023-09-12 Xihang Yu , Heng Yang

Neural Radiance Fields (NeRF) are an advanced technology that creates highly realistic images by learning about scenes through a neural network model. However, NeRF often encounters issues when there are not enough images to work with,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Jiawei Guo , HungChyun Chou , Ning Ding

Successful visual navigation depends upon capturing images that contain sufficient useful information. In this letter, we explore a data-driven approach to account for environmental lighting changes, improving the quality of images for use…

Robotics · Computer Science 2022-07-12 Justin Tomasi , Brandon Wagstaff , Steven L. Waslander , Jonathan Kelly

Many objects are naturally symmetric, and this symmetry can be exploited to infer unseen 3D properties from a single 2D image. Recently, NeRD is proposed for accurate 3D mirror plane estimation from a single image. Despite the unprecedented…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Yancong Lin , Silvia-Laura Pintea , Jan van Gemert

Integration of aerial and ground images has been proved as an efficient approach to enhance the surface reconstruction in urban environments. However, as the first step, the feature point matching between aerial and ground images is…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Qing Zhu , Zhendong Wang , Han Hu , Linfu Xie , Xuming Ge , Yeting Zhang

We present a new solution to tracking and mapping with an event camera. The motion of the camera contains both rotation and translation, and the displacements happen in an arbitrarily structured environment. As a result, the image matching…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Yifu Wang , Jiaqi Yang , Xin Peng , Peng Wu , Ling Gao , Kun Huang , Jiaben Chen , Laurent Kneip

Robust 3D object detection is critical for safe autonomous driving. Camera and radar sensors are synergistic as they capture complementary information and work well under different environmental conditions. Fusing camera and radar data is…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Jyh-Jing Hwang , Henrik Kretzschmar , Joshua Manela , Sean Rafferty , Nicholas Armstrong-Crews , Tiffany Chen , Dragomir Anguelov

Current feature matching methods prioritize improving modeling capabilities to better align outputs with ground-truth matches, which are the theoretical upper bound on matching results, metaphorically depicted as the "ceiling". However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Xiaoyong Lu , Songlin Du

Beyond novel view synthesis, Neural Radiance Fields are useful for applications that interact with the real world. In this paper, we use them as an implicit map of a given scene and propose a camera relocalization algorithm tailored for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Arthur Moreau , Nathan Piasco , Moussab Bennehar , Dzmitry Tsishkou , Bogdan Stanciulescu , Arnaud de La Fortelle

Traditionally, 3d indoor datasets have generally prioritized scale over ground-truth accuracy in order to obtain improved generalization. However, using these datasets to evaluate dense geometry tasks, such as depth rendering, can be…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 HyunJun Jung , Weihang Li , Shun-Cheng Wu , William Bittner , Nikolas Brasch , Jifei Song , Eduardo Pérez-Pellitero , Zhensong Zhang , Arthur Moreau , Nassir Navab , Benjamin Busam

Neural Radiance Fields (NeRF) have demonstrated impressive performance in novel view synthesis. However, NeRF and most of its variants still rely on traditional complex pipelines to provide extrinsic and intrinsic camera parameters, such as…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Qingsong Yan , Qiang Wang , Kaiyong Zhao , Jie Chen , Bo Li , Xiaowen Chu , Fei Deng

Numerical integration is a foundational technique in scientific computing and is at the core of many computer vision applications. Among these applications, neural volume rendering has recently been proposed as a new paradigm for view…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 David B. Lindell , Julien N. P. Martel , Gordon Wetzstein

Finding corresponding pixels within a pair of images is a fundamental computer vision task with various applications. Due to the specific requirements of different tasks like optical flow estimation and local feature matching, previous…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Songyan Zhang , Xinyu Sun , Hao Chen , Bo Li , Chunhua Shen

Estimating the accurate depth from a single image is challenging since it is inherently ambiguous and ill-posed. While recent works design increasingly complicated and powerful networks to directly regress the depth map, we take the path of…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Weihao Yuan , Xiaodong Gu , Zuozhuo Dai , Siyu Zhu , Ping Tan

Previous attempts to integrate Neural Radiance Fields (NeRF) into the Simultaneous Localization and Mapping (SLAM) framework either rely on the assumption of static scenes or require the ground truth camera poses, which impedes their…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Chengyao Duan , Zhiliu Yang

Neural Radiance Fields (NeRF) have demonstrated very impressive performance in novel view synthesis via implicitly modelling 3D representations from multi-view 2D images. However, most existing studies train NeRF models with either…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Jiahui Zhang , Fangneng Zhan , Rongliang Wu , Yingchen Yu , Wenqing Zhang , Bai Song , Xiaoqin Zhang , Shijian Lu