English
Related papers

Related papers: Radar-Informed 3D Multi-Object Tracking under Adve…

200 papers

Autonomous systems need to localize and track surrounding objects in 3D space for safe motion planning. As a result, 3D multi-object tracking (MOT) plays a vital role in autonomous navigation. Most MOT methods use a tracking-by-detection…

Computer Vision and Pattern Recognition · Computer Science 2020-11-26 Can Chen , Luca Zanotti Fragonara , Antonios Tsourdos

Radar and camera fusion yields robustness in perception tasks by leveraging the strength of both sensors. The typical extracted radar point cloud is 2D without height information due to insufficient antennas along the elevation axis, which…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Huawei Sun , Hao Feng , Gianfranco Mauro , Julius Ott , Georg Stettinger , Lorenzo Servadei , Robert Wille

Multiple Object Tracking (MOT) is crucial to autonomous vehicle perception. End-to-end transformer-based algorithms, which detect and track objects simultaneously, show great potential for the MOT task. However, most existing methods focus…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Ce Zhang , Chengjie Zhang , Yiluan Guo , Lingji Chen , Michael Happold

The fusion of multimodal sensor data streams such as camera images and lidar point clouds plays an important role in the operation of autonomous vehicles (AVs). Robust perception across a range of adverse weather and lighting conditions is…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Shounak Sural , Nishad Sahu , Ragunathan Rajkumar

This paper presents a novel multi-modal Multi-Object Tracking (MOT) algorithm for self-driving cars that combines camera and LiDAR data. Camera frames are processed with a state-of-the-art 3D object detector, whereas classical clustering…

Robotics · Computer Science 2024-05-14 Riccardo Pieroni , Simone Specchia , Matteo Corno , Sergio Matteo Savaresi

LiDAR and 4D radar are widely used in autonomous driving and robotics. While LiDAR provides rich spatial information, 4D radar offers velocity measurement and remains robust under adverse conditions. As a result, increasing studies have…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Xiangyuan Peng , Miao Tang , Huawei Sun , Bierzynski Kay , Lorenzo Servadei , Robert Wille

Intelligent transportation systems require accurate and reliable sensing. However, adverse environments, such as rain, snow, and fog, can significantly degrade the performance of LiDAR and cameras. In contrast, 4D mmWave radar not only…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Xiangyuan Peng , Miao Tang , Huawei Sun , Kay Bierzynski , Lorenzo Servadei , Robert Wille

4D millimeter-wave (mmWave) radar has been widely adopted in autonomous driving and robot perception due to its low cost and all-weather robustness. However, point-cloud-based radar representations suffer from information loss due to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Runwei Guan , Jianan Liu , Shaofeng Liang , Fangqiang Ding , Shanliang Yao , Xiaokai Bai , Daizong Liu , Tao Huang , Guoqiang Mao , Hui Xiong

3D multi-object tracking (MOT) is essential for an autonomous mobile agent to safely navigate a scene. In order to maximize the perception capabilities of the autonomous agent, we aim to develop a 3D MOT framework that fuses camera and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Tara Sadjadpour , Rares Ambrus , Jeannette Bohg

We present an approach for radar-inertial odometry which uses a continuous-time framework to fuse measurements from multiple automotive radars and an inertial measurement unit (IMU). Adverse weather conditions do not have a significant…

Robotics · Computer Science 2022-01-10 Yin Zhi Ng , Benjamin Choi , Robby Tan , Lionel Heng

To track the 3D locations and trajectories of the other traffic participants at any given time, modern autonomous vehicles are equipped with multiple cameras that cover the vehicle's full surroundings. Yet, camera-based 3D object tracking…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Tobias Fischer , Yung-Hsu Yang , Suryansh Kumar , Min Sun , Fisher Yu

Multi-object tracking from LiDAR point clouds presents unique challenges due to the sparse and irregular nature of the data, compounded by the need for temporal coherence across frames. Traditional tracking systems often rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Martha Teiko Teye , Ori Maoz , Matthias Rottmann

Safety and reliability are crucial for the public acceptance of autonomous driving. To ensure accurate and reliable environmental perception, intelligent vehicles must exhibit accuracy and robustness in various environments. Millimeter-wave…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Yue Sun , Yeqiang Qian , Chunxiang Wang , Ming Yang

3D multi-object tracking (MOT) is essential to applications such as autonomous driving. Recent work focuses on developing accurate systems giving less attention to computational cost and system complexity. In contrast, this work proposes a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Xinshuo Weng , Jianren Wang , David Held , Kris Kitani

Robust 3D object detection is critical for safe autonomous driving. Camera and radar sensors are synergistic as they capture complementary information and work well under different environmental conditions. Fusing camera and radar data is…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Jyh-Jing Hwang , Henrik Kretzschmar , Joshua Manela , Sean Rafferty , Nicholas Armstrong-Crews , Tiffany Chen , Dragomir Anguelov

This technical report presents the online and real-time 2D and 3D multi-object tracking (MOT) algorithms that reached the 1st places on both Waymo Open Dataset 2D tracking and 3D tracking challenges. An efficient and pragmatic online…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Yu Wang , Sijia Chen , Li Huang , Runzhou Ge , Yihan Hu , Zhuangzhuang Ding , Jie Liao

Deploying autonomous robots in crowded indoor environments usually requires them to have accurate dynamic obstacle perception. Although plenty of previous works in the autonomous driving field have investigated the 3D object detection…

Robotics · Computer Science 2024-02-28 Zhefan Xu , Xiaoyang Zhan , Yumeng Xiu , Christopher Suzuki , Kenji Shimada

The recent trend in 2D multiple object tracking (MOT) is jointly solving detection and tracking, where object detection and appearance feature (or motion) are learned simultaneously. Despite competitive performance, in crowded scenes, joint…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Weihong Ren , Denglu Wu , Hui Cao , Xi'ai Chen , Zhi Han , Honghai Liu

Persistent multi-object tracking (MOT) allows autonomous vehicles to navigate safely in highly dynamic environments. One of the well-known challenges in MOT is object occlusion when an object becomes unobservant for subsequent frames. The…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Mohamed Nagy , Majid Khonji , Jorge Dias , Sajid Javed

Autonomous driving systems are highly dependent on sensors like cameras, LiDAR, and inertial measurement units (IMU) to perceive the environment and estimate their motion. Among these sensors, perception-based sensors are not protected from…