English
Related papers

Related papers: TransCAR: Transformer-based Camera-And-Radar Fusio…

200 papers

Perceiving the surrounding environment is a fundamental task in autonomous driving. To obtain highly accurate perception results, modern autonomous driving systems typically employ multi-modal sensors to collect comprehensive environmental…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Zhiwei Lin , Zhe Liu , Yongtao Wang , Le Zhang , Ce Zhu

Accurate and robust 3D object detection is essential for autonomous driving, where fusing data from sensors like LiDAR and camera enhances detection accuracy. However, sensor malfunctions such as corruption or disconnection can degrade…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Reza Sadeghian , Niloofar Hooshyaripour , Chris Joslin , WonSook Lee

Perception is a key component of Automated vehicles (AVs). However, sensors mounted to the AVs often encounter blind spots due to obstructions from other vehicles, infrastructure, or objects in the surrounding area. While recent…

Robotics · Computer Science 2025-04-14 Nithish Kumar Saravanan , Varun Jammula , Yezhou Yang , Jeffrey Wishart , Junfeng Zhao

Urban-oriented autonomous vehicles require a reliable perception technology to tackle the high amount of uncertainties. The recently introduced compact 3D LIDAR sensor offers a surround spatial information that can be exploited to enhance…

Computer Vision and Pattern Recognition · Computer Science 2018-04-24 Achim Kampker , Mohsen Sefati , Arya Abdul Rachman , Kai Kreisköther , Pascual Campoy

This paper presents a novel multi-modal Multi-Object Tracking (MOT) algorithm for self-driving cars that combines camera and LiDAR data. Camera frames are processed with a state-of-the-art 3D object detector, whereas classical clustering…

Robotics · Computer Science 2024-05-14 Riccardo Pieroni , Simone Specchia , Matteo Corno , Sergio Matteo Savaresi

Collaborative visual perception methods have gained widespread attention in the autonomous driving community in recent years due to their ability to address sensor limitation problems. However, the absence of explicit depth information…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Shaohong Wang , Bin Lu , Xinyu Xiao , Hanzhi Zhong , Bowen Pang , Tong Wang , Zhiyu Xiang , Hangguan Shan , Eryun Liu

Monocular image-based 3D perception has become an active research area in recent years owing to its applications in autonomous driving. Approaches to monocular 3D perception including detection and tracking, however, often yield inferior…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Longlong Jing , Ruichi Yu , Henrik Kretzschmar , Kang Li , Charles R. Qi , Hang Zhao , Alper Ayvaci , Xu Chen , Dillon Cower , Yingwei Li , Yurong You , Han Deng , Congcong Li , Dragomir Anguelov

Multi-object tracking (MOT) has important applications in monitoring, logistics, and other fields. This paper develops a real-time multi-object tracking and prediction system in rugged environments. A 3D object detection algorithm based on…

Robotics · Computer Science 2023-08-24 Shixing Huang , Zhihao Wang , Junyuan Ouyang , Haoyao Chen

Accurate 3D object detection for autonomous driving requires complementary sensors. Cameras provide dense semantics but unreliable depth, while millimeter-wave radar offers precise range and velocity measurements with sparse geometry. We…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Mayank Mayank , Bharanidhar Duraisamy , Florian Geiß , Abhinav Valada

Object detection in Remote Sensing Images (RSI) is a critical task for numerous applications in Earth Observation (EO). Differing from object detection in natural images, object detection in remote sensing images faces challenges of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Bissmella Bahaduri , Zuheng Ming , Fangchen Feng , Anissa Mokraou

3D lane detection is an integral part of autonomous driving systems. Previous CNN and Transformer-based methods usually first generate a bird's-eye-view (BEV) feature map from the front view image, and then use a sub-network with BEV…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Yifeng Bai , Zhirong Chen , Zhangjie Fu , Lang Peng , Pengpeng Liang , Erkang Cheng

This paper presents a novel framework for robust 3D object detection from point clouds via cross-modal hallucination. Our proposed approach is agnostic to either hallucination direction between LiDAR and 4D radar. We introduce multiple…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Jianning Deng , Gabriel Chan , Hantao Zhong , Chris Xiaoxuan Lu

LiDAR and camera are two essential sensors for 3D object detection in autonomous driving. LiDAR provides accurate and reliable 3D geometry information while the camera provides rich texture with color. Despite the increasing popularity of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Qi Jiang , Hao Sun , Xi Zhang

We tackle the problem of exploiting Radar for perception in the context of self-driving as Radar provides complementary information to other sensors such as LiDAR or cameras in the form of Doppler velocity. The main challenges of using…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Bin Yang , Runsheng Guo , Ming Liang , Sergio Casas , Raquel Urtasun

Image-based 3D object detection is an inevitable part of autonomous driving because cheap onboard cameras are already available in most modern cars. Because of the accurate depth information, currently, most state-of-the-art 3D object…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Hendrik Königshof , Kun Li , Christoph Stiller

Recently, 3D object detection algorithms based on radar and camera fusion have shown excellent performance, setting the stage for their application in autonomous driving perception tasks. Existing methods have focused on dealing with…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Linhua Kong , Dongxia Chang , Lian Liu , Zisen Kong , Pengyuan Li , Yao Zhao

LiDAR and camera fusion techniques are promising for achieving 3D object detection in autonomous driving. Most multi-modal 3D object detection frameworks integrate semantic knowledge from 2D images into 3D LiDAR point clouds to enhance…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Shaoqing Xu , Fang Li , Ziying Song , Jin Fang , Sifen Wang , Zhi-Xin Yang

In this work, a deep learning approach has been developed to carry out road detection by fusing LIDAR point clouds and camera images. An unstructured and sparse point cloud is first projected onto the camera image plane and then upsampled…

Computer Vision and Pattern Recognition · Computer Science 2018-09-24 Luca Caltagirone , Mauro Bellone , Lennart Svensson , Mattias Wahde

3D lane detection from monocular images is a fundamental yet challenging task in autonomous driving. Recent advances primarily rely on structural 3D surrogates (e.g., bird's eye view) built from front-view image features and camera…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yueru Luo , Chaoda Zheng , Xu Yan , Tang Kun , Chao Zheng , Shuguang Cui , Zhen Li

In several real-world scenarios like autonomous navigation and mobility, to obtain a better visual understanding of the surroundings, image captioning and object detection play a crucial role. This work introduces a novel multitask learning…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Debolena Basak , P. K. Srijith , Maunendra Sankar Desarkar