English
Related papers

Related papers: Pose Optimization for Autonomous Driving Datasets …

200 papers

In this work, we consider the problem of learning end to end perception to control for ground vehicles solely from aerial imagery. Photogrammetric simulators allow the synthesis of novel views through the transformation of pre-generated…

Robotics · Computer Science 2024-10-21 Varun Murali , Guy Rosman , Sertac Karaman , Daniela Rus

Implicit representations such as Neural Radiance Fields (NeRF) have been shown to be very effective at novel view synthesis. However, these models typically require manual and careful human data collection for training. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Pierre Marza , Laetitia Matignon , Olivier Simonin , Dhruv Batra , Christian Wolf , Devendra Singh Chaplot

Simulating camera sensors is a crucial task in autonomous driving. Although neural radiance fields are exceptional at synthesizing photorealistic views in driving simulations, they still fail to generate extrapolated views. This paper…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Chenming Wu , Jiadai Sun , Zhelun Shen , Liangjun Zhang

This paper tackles the simultaneous optimization of pose and Neural Radiance Fields (NeRF). Departing from the conventional practice of using explicit global representations for camera pose, we propose a novel overparameterized…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Shin-Fang Chng , Ravi Garg , Hemanth Saratchandran , Simon Lucey

Neural radiance fields (NeRF) is a promising approach for generating photorealistic images and representing complex scenes. However, when processing data sequentially, it can suffer from catastrophic forgetting, where previous data is…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Letian Zhang , Ming Li , Chen Chen , Jie Xu

In this paper, we propose a Neural Radiance Fields (NeRF) based framework, referred to as Novel View Synthesis Framework (NVSF). It jointly learns the implicit neural representation of space and time-varying scene for both LiDAR and Camera.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Gaurav Sharma , Ravi Kothari , Josef Schmid

NeRFmm is the Neural Radiance Fields (NeRF) that deal with Joint Optimization tasks, i.e., reconstructing real-world scenes and registering camera parameters simultaneously. Despite NeRFmm producing precise scene synthesis and pose…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yitong Xia , Hao Tang , Radu Timofte , Luc Van Gool

In the realm of autonomous driving, achieving precise 3D reconstruction of the driving environment is critical for ensuring safety and effective navigation. Neural Radiance Fields (NeRF) have shown promise in creating highly detailed and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Xiaochao Pan , Jiawei Yao , Hongrui Kou , Tong Wu , Canran Xiao

Obtaining a better knowledge of the current state and behavior of objects orbiting Earth has proven to be essential for a range of applications such as active debris removal, in-orbit maintenance, or anomaly detection. 3D models represent a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Clément Forray , Pauline Delporte , Nicolas Delaygue , Florence Genin , Dawa Derksen

Keypoint detection is an essential building block for many robotic applications like motion capture and pose estimation. Historically, keypoints are detected using uniquely engineered markers such as checkerboards or fiducials. More…

Robotics · Computer Science 2023-02-28 Jingpei Lu , Florian Richter , Michael Yip

This work introduces a novel augmentation method that increases the diversity of a train set to improve the generalization abilities of a 6D pose estimation network. For this purpose, a Neural Radiance Field is trained from synthetic images…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Antoine Legrand , Renaud Detry , Christophe De Vleeschouwer

Neural Radiance Fields (NeRFs) are trained using a set of camera poses and associated images as input to estimate density and color values for each position. The position-dependent density learning is of particular interest for…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Miriam Jäger , Patrick Hübner , Dennis Haitz , Boris Jutzi

Radar is an important sensor for autonomous driving (AD) systems due to its robustness to adverse weather and different lighting conditions. Novel view synthesis using neural radiance fields (NeRFs) has recently received considerable…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Mahan Rafidashti , Ji Lan , Maryam Fatemi , Junsheng Fu , Lars Hammarstrand , Lennart Svensson

We introduce ViewNeRF, a Neural Radiance Field-based viewpoint estimation method that learns to predict category-level viewpoints directly from images during training. While NeRF is usually trained with ground-truth camera poses, multiple…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Octave Mariotti , Oisin Mac Aodha , Hakan Bilen

Neural reconstruction models for autonomous driving simulation have made significant strides in recent years, with dynamic models becoming increasingly prevalent. However, these models are typically limited to handling in-domain objects…

Sampling-based motion planning is an effective tool to compute safe trajectories for automated vehicles in complex environments. However, a fast convergence to the optimal solution can only be ensured with the use of problem-specific…

Robotics · Computer Science 2019-02-04 Holger Banzhaf , Paul Sanzenbacher , Ulrich Baumann , J. Marius Zöllner

Neural Radiance Fields (NeRFs) have recently emerged as a powerful paradigm for the representation of natural, complex 3D scenes. NeRFs represent continuous volumetric density and RGB values in a neural network, and generate photo-realistic…

In this work, we propose the use of Neural Radiance Fields (NeRF) as a scene representation for visual localization. Recently, NeRF has been employed to enhance pose regression and scene coordinate regression models by augmenting the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Qunjie Zhou , Maxim Maximov , Or Litany , Laura Leal-Taixé

Neural Radiance Fields (NeRFs) have gained widespread recognition as a highly effective technique for representing 3D reconstructions of objects and scenes derived from sets of images. Despite their efficiency, NeRF models can pose…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Davide Di Nucci , Alessandro Simoni , Matteo Tomei , Luca Ciuffreda , Roberto Vezzani , Rita Cucchiara

A critical obstacle preventing NeRF models from being deployed broadly in the wild is their reliance on accurate camera poses. Consequently, there is growing interest in extending NeRF models to jointly optimize camera poses and scene…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Zezhou Cheng , Carlos Esteves , Varun Jampani , Abhishek Kar , Subhransu Maji , Ameesh Makadia