English
Related papers

Related papers: Probabilistic Multimodal Depth Estimation Based on…

200 papers

A fundamental problem in robotic perception is matching identical objects or data, with applications such as loop closure detection, place recognition, object tracking, and map fusion. While the problem becomes considerably more challenging…

Robotics · Computer Science 2021-12-01 Parker C. Lusk , Ronak Roy , Kaveh Fathian , Jonathan P. How

Multi-modal fusion is imperative to the implementation of reliable object detection and tracking in complex environments. Exploiting the synergy of heterogeneous modal information endows perception systems the ability to achieve more…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Kun Shi , Shibo He , Zhenyu Shi , Anjun Chen , Zehui Xiong , Jiming Chen , Jun Luo

Dense and accurate 3D mapping from a monocular sequence is a key technology for several applications and still an open research area. This paper leverages recent results on single-view CNN-based depth estimation and fuses them with…

Computer Vision and Pattern Recognition · Computer Science 2017-06-28 José M. Fácil , Alejo Concha , Luis Montesano , Javier Civera

Vision-based depth estimation is a key feature in autonomous systems, which often relies on a single camera or several independent ones. In such a monocular setup, dense depth is obtained with either additional input from one or several…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Florent Bartoccioni , Éloi Zablocki , Patrick Pérez , Matthieu Cord , Karteek Alahari

In the recent literature, on the one hand, many 3D multi-object tracking (MOT) works have focused on tracking accuracy and neglected computation speed, commonly by designing rather complex cost functions and feature extractors. On the other…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Xiyang Wang , Chunyun Fu , Zhankun Li , Ying Lai , Jiawei He

While LiDAR sensors have been successfully applied to 3D object detection, the affordability of radar and camera sensors has led to a growing interest in fusing radars and cameras for 3D object detection. However, previous radar-camera…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Jisong Kim , Minjae Seong , Geonho Bang , Dongsuk Kum , Jun Won Choi

LiDAR-based vision systems are integral for 3D object detection, which is crucial for autonomous navigation. However, they suffer from performance degradation in adverse weather conditions due to the quality deterioration of LiDAR point…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Xun Huang , Ziyu Xu , Hai Wu , Jinlong Wang , Qiming Xia , Yan Xia , Jonathan Li , Kyle Gao , Chenglu Wen , Cheng Wang

The perception of autonomous vehicles has to be efficient, robust, and cost-effective. However, cameras are not robust against severe weather conditions, lidar sensors are expensive, and the performance of radar-based perception is still…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Felix Fent , Andras Palffy , Holger Caesar

Automotive traffic scenes are complex due to the variety of possible scenarios, objects, and weather conditions that need to be handled. In contrast to more constrained environments, such as automated underground trains, automotive…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Felix Nobis , Ehsan Shafiei , Phillip Karle , Johannes Betz , Markus Lienkamp

Road detection is a critically important task for self-driving cars. By employing LiDAR data, recent works have significantly improved the accuracy of road detection. Relying on LiDAR sensors limits the wide application of those methods…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Libo Sun , Haokui Zhang , Wei Yin

Radars, due to their robustness to adverse weather conditions and ability to measure object motions, have served in autonomous driving and intelligent agents for years. However, Radar-based perception suffers from its unintuitive sensing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Liu Liu , Shuaifeng Zhi , Zhenhua Du , Li Liu , Xinyu Zhang , Kai Huo , Weidong Jiang

This research presents a novel depth estimation algorithm based on a Transformer-encoder architecture, tailored for the NYU and KITTI Depth Dataset. This research adopts a transformer model, initially renowned for its success in natural…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Linhan Xia , Junbang Liu , Tong Wu

Depth completion, which estimates dense depth from sparse LiDAR and RGB images, has demonstrated outstanding performance in well-lit conditions. However, due to the limitations of RGB sensors, existing methods often struggle to achieve…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Janghyun Kim , Minseong Kweon , Jinsun Park , Ukcheol Shin

We propose a method for depth estimation under different illumination conditions, i.e., day and night time. As photometry is uninformative in regions under low-illumination, we tackle the problem through a multi-sensor fusion approach,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Vadim Ezhov , Hyoungseob Park , Zhaoyang Zhang , Rishi Upadhyay , Howard Zhang , Chethan Chinder Chandrappa , Achuta Kadambi , Yunhao Ba , Julie Dorsey , Alex Wong

In this work, we present an uncertainty-based method for sensor fusion with camera and radar data. The outputs of two neural networks, one processing camera and the other one radar data, are combined in an uncertainty aware manner. To this…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Kamil Kowol , Matthias Rottmann , Stefan Bracke , Hanno Gottschalk

Sensor fusion is crucial for a performant and robust Perception system in autonomous vehicles, but sensor staleness, where data from different sensors arrives with varying delays, poses significant challenges. Temporal misalignment between…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Meng Fan , Yifan Zuo , Patrick Blaes , Harley Montgomery , Subhasis Das

This work considers the problem of depth completion, with or without image data, where an algorithm may measure the depth of a prescribed limited number of pixels. The algorithmic challenge is to choose pixel positions strategically and…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Eyal Gofer , Shachar Praisler , Guy Gilboa

In this paper we present a novel radar-camera sensor fusion framework for accurate object detection and distance estimation in autonomous driving scenarios. The proposed architecture uses a middle-fusion approach to fuse the radar point…

Computer Vision and Pattern Recognition · Computer Science 2020-09-18 Ramin Nabati , Hairong Qi

Lidar point cloud distortion from moving object is an important problem in autonomous driving, and recently becomes even more demanding with the emerging of newer lidars, which feature back-and-forth scanning patterns. Accurately estimating…

Robotics · Computer Science 2022-07-05 Wen Yang , Zheng Gong , Baifu Huang , Xiaoping Hong

The combination of data from multiple sensors, also known as sensor fusion or data fusion, is a key aspect in the design of autonomous robots. In particular, algorithms able to accommodate sensor fusion techniques enable increased accuracy,…

Robotics · Computer Science 2021-03-26 Li Qingqing , Jorge Peña Queralta , Tuan Nguyen Gia , Zhuo Zou , Tomi Westerlund