English
Related papers

Related papers: Radar and Camera Fusion for Object Detection and T…

200 papers

We present a novel approach for metric dense depth estimation based on the fusion of a single-view image and a sparse, noisy Radar point cloud. The direct fusion of heterogeneous Radar and image data, or their encodings, tends to yield…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Han Li , Yukai Ma , Yaqing Gu , Kewei Hu , Yong Liu , Xingxing Zuo

Leveraging multi-modal fusion, especially between camera and LiDAR, has become essential for building accurate and robust 3D object detection systems for autonomous vehicles. Until recently, point decorating approaches, in which point…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Philip Jacobson , Yiyang Zhou , Wei Zhan , Masayoshi Tomizuka , Ming C. Wu

In this paper, we propose a new deep architecture for fusing camera and LiDAR sensors for 3D object detection. Because the camera and LiDAR sensor signals have different characteristics and distributions, fusing these two modalities is…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Jin Hyeok Yoo , Yecheol Kim , Jisong Kim , Jun Won Choi

In photogrammetry, accurately fusing infrared (IR) and visible (VIS) spectra while preserving the geometric fidelity of visible features and incorporating thermal radiation is a significant challenge, particularly under extreme conditions.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Jing Tao , Yonghong Zong , Banglei Guan , Pengju Sun , Taihang Lei , Yang Shanga , Qifeng Yu

With the rapid advancements of sensor technology and deep learning, autonomous driving systems are providing safe and efficient access to intelligent vehicles as well as intelligent transportation. Among these equipped sensors, the radar…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Shanliang Yao , Runwei Guan , Zitian Peng , Chenhang Xu , Yilu Shi , Weiping Ding , Eng Gee Lim , Yong Yue , Hyungjoon Seo , Ka Lok Man , Jieming Ma , Xiaohui Zhu , Yutao Yue

Vision-based 3D occupancy prediction has made significant advancements, but its reliance on cameras alone struggles in challenging environments. This limitation has driven the adoption of sensor fusion, among which camera-radar fusion…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Chaehee Song , Sanmin Kim , Hyeonjun Jeong , Juyeb Shin , Joonhee Lim , Dongsuk Kum

The integration of data from diverse sensor modalities (e.g., camera and LiDAR) constitutes a prevalent methodology within the ambit of autonomous driving scenarios. Recent advancements in efficient point cloud transformers have underscored…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Yutao Zhu , Xiaosong Jia , Xinyu Yang , Junchi Yan

Environment modeling in autonomous driving is realized by two fundamental approaches, grid-based and feature-based approach. Both methods interpret the environment differently and show some situation-dependent beneficial realizations. In…

Robotics · Computer Science 2019-12-06 Nils Rexin , Marcel Musch , Klaus Dietmayer

Event cameras, inspired by biological vision, are asynchronous sensors that detect changes in brightness, offering notable advantages in environments characterized by high-speed motion, low lighting, or wide dynamic range. These distinctive…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Jiaqiang Zhang , Xianjia Yu , Ha Sier , Haizhou Zhang , Tomi Westerlund

While computer vision has advanced considerably for general object detection and tracking, the specific problem of fast-moving tiny objects remains underexplored. This paper addresses the significant challenge of detecting and tracking…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Prithvi Raj Singh , Raju Gottumukkala , Anthony S. Maida , Alan B. Barhorst , Vijaya Gopu

The rapid advancement of remote sensing foundation models, particularly vision and multimodal models, has significantly enhanced the capabilities of intelligent geospatial data interpretation. These models combine various data modalities,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Ziyue Huang , Hongxi Yan , Qiqi Zhan , Shuai Yang , Mingming Zhang , Chenkai Zhang , YiMing Lei , Zeming Liu , Qingjie Liu , Yunhong Wang

Unmanned aerial vehicle (UAV) detection and aerial object recognition are critical for modern surveillance and security, prompting a need for robust systems that overcome limitations of single-modality approaches. This research addresses…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Mauro Larrat , Claudomiro Sales

Although significant progress has been made, achieving place recognition in environments with perspective changes, seasonal variations, and scene transformations remains challenging. Relying solely on perception information from a single…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Yan Pan , Jiapeng Xie , Jiajie Wu , Bo Zhou

Fusing Radar and Lidar sensor data can fully utilize their complementary advantages and provide more accurate reconstruction of the surrounding for autonomous driving systems. Surround Radar/Lidar can provide 360-degree view sampling with…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Wenjing Xie , Tao Hu , Neiwen Ling , Guoliang Xing , Chun Jason Xue , Nan Guan

Online multi-object tracking (MOT) is extremely important for high-level spatial reasoning and path planning for autonomous and highly-automated vehicles. In this paper, we present a modular framework for tracking multiple objects…

Computer Vision and Pattern Recognition · Computer Science 2019-02-20 Akshay Rangesh , Mohan M. Trivedi

Multi-sensor fusion (MSF) is widely used in autonomous vehicles (AVs) for perception, particularly for 3D object detection with camera and LiDAR sensors. The purpose of fusion is to capitalize on the advantages of each modality while…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Zhiyuan Cheng , Hongjun Choi , James Liang , Shiwei Feng , Guanhong Tao , Dongfang Liu , Michael Zuzak , Xiangyu Zhang

Multi-sensor fusion plays a critical role in enhancing perception for autonomous driving, overcoming individual sensor limitations, and enabling comprehensive environmental understanding. This paper first formalizes multi-sensor fusion…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Chuheng Wei , Ziye Qin , Ziyan Zhang , Guoyuan Wu , Matthew J. Barth

LiDAR-based vision systems are integral for 3D object detection, which is crucial for autonomous navigation. However, they suffer from performance degradation in adverse weather conditions due to the quality deterioration of LiDAR point…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Xun Huang , Ziyu Xu , Hai Wu , Jinlong Wang , Qiming Xia , Yan Xia , Jonathan Li , Kyle Gao , Chenglu Wen , Cheng Wang

Image fusion in Remote Sensing (RS) has been a consistent demand due to its ability to turn raw images of different resolutions, sources, and modalities into accurate, complete, and spatio-temporally coherent images. It greatly facilitates…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Hessah Albanwan , Rongjun Qin , Yang Tang

In this work, a deep learning approach has been developed to carry out road detection by fusing LIDAR point clouds and camera images. An unstructured and sparse point cloud is first projected onto the camera image plane and then upsampled…

Computer Vision and Pattern Recognition · Computer Science 2018-09-24 Luca Caltagirone , Mauro Bellone , Lennart Svensson , Mattias Wahde