English
Related papers

Related papers: Multi-Camera Sensor Fusion for Visual Odometry usi…

200 papers

In recent years, Neural Radiance Fields (NeRF) have emerged as a powerful tool for 3D reconstruction and novel view synthesis. However, the computational cost of NeRF rendering and degradation in quality due to the presence of artifacts…

Robotics · Computer Science 2024-08-20 Juyeop Han , Lukas Lao Beyer , Guilherme V. Cavalheiro , Sertac Karaman

Object pose estimation is a fundamental task in 3D vision with applications in robotics, AR/VR, and scene understanding. We address the challenge of category-level 9-DoF pose estimation (6D pose + 3Dsize) from RGB-D input, without relying…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Rachit Agarwal , Abhishek Joshi , Sathish Chalasani , Woo Jin Kim

We propose Deep Patch Visual Odometry (DPVO), a new deep learning system for monocular Visual Odometry (VO). DPVO uses a novel recurrent network architecture designed for tracking image patches across time. Recent approaches to VO have…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Zachary Teed , Lahav Lipson , Jia Deng

3D multi-object tracking (MOT) is essential for an autonomous mobile agent to safely navigate a scene. In order to maximize the perception capabilities of the autonomous agent, we aim to develop a 3D MOT framework that fuses camera and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Tara Sadjadpour , Rares Ambrus , Jeannette Bohg

In recent years, unsupervised deep learning approaches have received significant attention to estimate the depth and visual odometry (VO) from unlabelled monocular image sequences. However, their performance is limited in challenging…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Yasin Almalioglu , Angel Santamaria-Navarro , Benjamin Morrell , Ali-akbar Agha-mohammadi

Visual Odometry (VO) is vital for the navigation of autonomous systems, providing accurate position and orientation estimates at reasonable costs. While traditional VO methods excel in some conditions, they struggle with challenges like…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Siyu Chen , Kangcheng Liu , Chen Wang , Shenghai Yuan , Jianfei Yang , Lihua Xie

In this paper, we propose an accurate and robust perception module for Autonomous Vehicles (AVs) for drivable space extraction. Perception is crucial in autonomous driving, where many deep learning-based methods, while accurate on benchmark…

This paper proposes a new framework to solve the problem of monocular visual odometry, called MagicVO . Based on Convolutional Neural Network (CNN) and Bi-directional LSTM (Bi-LSTM), MagicVO outputs a 6-DoF absolute-scale pose at each…

Computer Vision and Pattern Recognition · Computer Science 2018-11-29 Jian Jiao , Jichao Jiao , Yaokai Mo , Weilun Liu , Zhongliang Deng

Multi-sensor fusion plays a critical role in enhancing perception for autonomous driving, overcoming individual sensor limitations, and enabling comprehensive environmental understanding. This paper first formalizes multi-sensor fusion…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Chuheng Wei , Ziye Qin , Ziyan Zhang , Guoyuan Wu , Matthew J. Barth

In this paper, we present a cooperative odometry scheme based on the detection of mobile markers in line with the idea of cooperative positioning for multiple robots [1]. To this end, we introduce a simple optimization scheme that realizes…

Robotics · Computer Science 2017-04-19 Raul Acuna , Zaijuan Li , Volker Willert

For ego-motion estimation, the feature representation of the scenes is crucial. Previous methods indicate that both the low-level and semantic feature-based methods can achieve promising results. Therefore, the incorporation of hierarchical…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Xiaochuan Yin , Chengju Liu

Driven by deep learning techniques, perception technology in autonomous driving has developed rapidly in recent years, enabling vehicles to accurately detect and interpret surrounding environment for safe and efficient navigation. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Shanliang Yao , Runwei Guan , Xiaoyu Huang , Zhuoxiao Li , Xiangyu Sha , Yong Yue , Eng Gee Lim , Hyungjoon Seo , Ka Lok Man , Xiaohui Zhu , Yutao Yue

In recent years, Onboard Self Localization (OSL) methods based on cameras or Lidar have achieved many significant progresses. However, some issues such as estimation drift and feature-dependence still remain inherent limitations. On the…

Robotics · Computer Science 2020-10-26 Thien-Minh Nguyen , Shenghai Yuan , Muqing Cao , Yang Lyu , Thien Hoang Nguyen , Lihua Xie

Radars, due to their robustness to adverse weather conditions and ability to measure object motions, have served in autonomous driving and intelligent agents for years. However, Radar-based perception suffers from its unintuitive sensing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Liu Liu , Shuaifeng Zhi , Zhenhua Du , Li Liu , Xinyu Zhang , Kai Huo , Weidong Jiang

Accurate 6-DoF object pose estimation and tracking are critical for reliable robotic manipulation. However, zero-shot methods often fail under viewpoint-induced ambiguities and fixed-camera setups struggle when objects move or become…

Robotics · Computer Science 2026-03-10 Sheng Liu , Zhe Li , Weiheng Wang , Han Sun , Heng Zhang , Hongpeng Chen , Yusen Qin , Arash Ajoudani , Yizhao Wang

In the field of multi-sensor fusion for simultaneous localization and mapping (SLAM), monocular cameras and IMUs are widely used to build simple and effective visual-inertial systems. However, limited research has explored the integration…

Invariant Extended Kalman Filter (IEKF) has been a significant technique in vision-aided sensor fusion. However, it usually suffers from high computational burden when jointly optimizing camera poses and the landmarks. To improve its…

Robotics · Computer Science 2025-08-08 Tong Hua , Jiale Han , Wei Ouyang

Knowledge about the location of a vehicle is indispensable for autonomous driving. In order to apply global localisation methods, a pose prior must be known which can be obtained from visual odometry. The quality and robustness of that…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Johannes Graeter , Tobias Strauss , Martin Lauer

Leveraging multi-modal fusion, especially between camera and LiDAR, has become essential for building accurate and robust 3D object detection systems for autonomous vehicles. Until recently, point decorating approaches, in which point…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Philip Jacobson , Yiyang Zhou , Wei Zhan , Masayoshi Tomizuka , Ming C. Wu

In this work, we propose a novel deep online correction (DOC) framework for monocular visual odometry. The whole pipeline has two stages: First, depth maps and initial poses are obtained from convolutional neural networks (CNNs) trained in…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Jiaxin Zhang , Wei Sui , Xinggang Wang , Wenming Meng , Hongmei Zhu , Qian Zhang