English
Related papers

Related papers: Graph-Based Multi-Modal Sensor Fusion for Autonomo…

200 papers

Vehicle state estimation presents a fundamental challenge for autonomous driving systems, requiring both physical interpretability and the ability to capture complex nonlinear behaviors across diverse operating conditions. Traditional…

Systems and Control · Electrical Eng. & Systems 2025-06-17 Farid Mafi , Ladan Khoshnevisan , Mohammad Pirani , Amir Khajepour

We present ConFusion, an open-source package for online sensor fusion for robotic applications. ConFusion is a modular framework for fusing measurements from many heterogeneous sensors within a moving horizon estimator. ConFusion offers…

Robotics · Computer Science 2019-03-04 Timothy Sandy , Lukas Stadelmann , Simon Kerscher , Jonas Buchli

Seamless operation of mobile robots in challenging environments requires low-latency local motion estimation (e.g., dynamic maneuvers) and accurate global localization (e.g., wayfinding). While most existing sensor-fusion approaches are…

Large scale monitoring systems enable efficient field level data collection at high temporal and spatial resolutions. One example is the deployment of such systems in pipeline infrastructure applications which have to be monitored for leaks…

Systems and Control · Computer Science 2015-11-06 Grigore Stamatescu

Multi-modal fusion is a basic task of autonomous driving system perception, which has attracted many scholars' interest in recent years. The current multi-modal fusion methods mainly focus on camera data and LiDAR data, but pay little…

Robotics · Computer Science 2022-11-14 Yan Gong , Jianli Lu , Jiayi Wu , Wenzhuo Liu

Motion estimation approaches typically employ sensor fusion techniques, such as the Kalman Filter, to handle individual sensor failures. More recently, deep learning-based fusion approaches have been proposed, increasing the performance and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Nimet Kaygusuz , Oscar Mendez , Richard Bowden

Coverage analysis is essential for validating the safety of autonomous driving systems, yet existing approaches typically assess coverage factors individually or in limited combinations, struggling to capture the complex interactions…

Methodology · Statistics 2026-02-03 Thomas Muehlenstädt , Marius Bause

3D multi-object tracking (MOT) is essential for an autonomous mobile agent to safely navigate a scene. In order to maximize the perception capabilities of the autonomous agent, we aim to develop a 3D MOT framework that fuses camera and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Tara Sadjadpour , Rares Ambrus , Jeannette Bohg

This study aims to improve the performance and generalization capability of end-to-end autonomous driving with scene understanding leveraging deep learning and multimodal sensor fusion techniques. The designed end-to-end deep neural network…

Robotics · Computer Science 2020-08-04 Zhiyu Huang , Chen Lv , Yang Xing , Jingda Wu

Unmanned aerial vehicles (UAVs) equipped with multiple complementary sensors have tremendous potential for fast autonomous or remote-controlled semantic scene analysis, e.g., for disaster examination. In this work, we propose a UAV system…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Simon Bultmann , Jan Quenzel , Sven Behnke

3D Multi-Object Tracking (MOT), a fundamental component of environmental perception, is essential for intelligent systems like autonomous driving and robotic sensing. Although Tracking-by-Detection frameworks have demonstrated excellent…

Robotics · Computer Science 2024-11-14 Xiaoxiang Wang , Jiaxin Liu , Miaojie Feng , Zhaoxing Zhang , Xin Yang

LiDAR point clouds have become the most common data source in autonomous driving. However, due to the sparsity of point clouds, accurate and reliable detection cannot be achieved in specific scenarios. Because of their complementarity with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Leichao Cui , Xiuxian Li , Min Meng , Xiaoyu Mo

In this letter, we propose a robust, real-time tightly-coupled multi-sensor fusion framework, which fuses measurement from LiDAR, inertial sensor, and visual camera to achieve robust and accurate state estimation. Our proposed framework is…

Robotics · Computer Science 2021-02-25 Jiarong Lin , Chunran Zheng , Wei Xu , Fu Zhang

Robust semantic perception for autonomous vehicles relies on effectively combining multiple sensors with complementary strengths and weaknesses. State-of-the-art sensor fusion approaches to semantic perception often treat sensor data…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Tim Broedermannn , Christos Sakaridis , Luigi Piccinelli , Wim Abbeloos , Luc Van Gool

Driven by deep learning techniques, perception technology in autonomous driving has developed rapidly in recent years, enabling vehicles to accurately detect and interpret surrounding environment for safe and efficient navigation. To…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Shanliang Yao , Runwei Guan , Xiaoyu Huang , Zhuoxiao Li , Xiangyu Sha , Yong Yue , Eng Gee Lim , Hyungjoon Seo , Ka Lok Man , Xiaohui Zhu , Yutao Yue

Leveraging multiple sensors is crucial for robust semantic perception in autonomous driving, as each sensor type has complementary strengths and weaknesses. However, existing sensor fusion methods often treat sensors uniformly across all…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Tim Broedermann , Christos Sakaridis , Yuqian Fu , Luc Van Gool

There are two critical sensors for 3D perception in autonomous driving, the camera and the LiDAR. The camera provides rich semantic information such as color, texture, and the LiDAR reflects the 3D shape and locations of surrounding…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Kaicheng Yu , Tang Tao , Hongwei Xie , Zhiwei Lin , Zhongwei Wu , Zhongyu Xia , Tingting Liang , Haiyang Sun , Jiong Deng , Dayang Hao , Yongtao Wang , Xiaodan Liang , Bing Wang

Intelligent transportation systems (ITS) localization is of significant importance as it provides fundamental position and orientation for autonomous operations like intelligent vehicles. Integrating diverse and complementary sensors such…

Robotics · Computer Science 2024-09-20 Wei Liu , Jiaqi Zhu , Guirong Zhuo , Wufei Fu , Zonglin Meng , Yishi Lu , Min Hua , Feng Qiao , You Li , Yi He , Lu Xiong

In this paper, a multi-modal 360$^{\circ}$ framework for 3D object detection and tracking for autonomous vehicles is presented. The process is divided into four main stages. First, images are fed into a CNN network to obtain instance…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jorge Beltrán , Carlos Guindel , Irene Cortés , Alejandro Barrera , Armando Astudillo , Jesús Urdiales , Mario Álvarez , Farid Bekka , Vicente Milanés , Fernando García

The combination of data from multiple sensors, also known as sensor fusion or data fusion, is a key aspect in the design of autonomous robots. In particular, algorithms able to accommodate sensor fusion techniques enable increased accuracy,…

Robotics · Computer Science 2021-03-26 Li Qingqing , Jorge Peña Queralta , Tuan Nguyen Gia , Zhuo Zou , Tomi Westerlund