English
Related papers

Related papers: Learning Selective Sensor Fusion for States Estima…

200 papers

Autonomous driving necessitates advanced object detection techniques that integrate information from multiple modalities to overcome the limitations associated with single-modal approaches. The challenges of aligning diverse data in early…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Qihang Yang , Yang Zhao , Hong Cheng

Pavement defect detection faces critical challenges including limited annotated data, domain shift between training and deployment environments, and high variability in defect appearances across different road conditions. We propose…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Muhammad Aqeel , Kidus Dagnaw Bellete , Francesco Setti

Accurate state estimation is a fundamental problem for autonomous robots. To achieve locally accurate and globally drift-free state estimation, multiple sensors with complementary properties are usually fused together. Local sensors…

Computer Vision and Pattern Recognition · Computer Science 2019-01-14 Tong Qin , Shaozu Cao , Jie Pan , Shaojie Shen

Autonomous vehicles use multiple sensors, large deep-learning models, and powerful hardware platforms to perceive the environment and navigate safely. In many contexts, some sensing modalities negatively impact perception while increasing…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Arnav Vaibhav Malawade , Trier Mortlock , Mohammad Abdullah Al Faruque

Building a multi-modality multi-task neural network toward accurate and robust performance is a de-facto standard in perception task of autonomous driving. However, leveraging such data from multiple sensors to jointly optimize the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Tengju Ye , Wei Jing , Chunyong Hu , Shikun Huang , Lingping Gao , Fangzhen Li , Jingke Wang , Ke Guo , Wencong Xiao , Weibo Mao , Hang Zheng , Kun Li , Junbo Chen , Kaicheng Yu

In this paper, we present a effective state estimation algorithm that combined with various sensors information (Inertial measurement unit, joints encoder, camera and LIDAR)

Robotics · Computer Science 2021-08-13 Chen Yao , Zhenzhong Jia

Multi-view radar-camera fused 3D object detection provides a farther detection range and more helpful features for autonomous driving, especially under adverse weather. The current radar-camera fusion methods deliver kinds of designs to…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Zizhang Wu , Guilian Chen , Yuanzhu Gan , Lei Wang , Jian Pu

3D multi-object tracking (MOT) is essential for an autonomous mobile agent to safely navigate a scene. In order to maximize the perception capabilities of the autonomous agent, we aim to develop a 3D MOT framework that fuses camera and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Tara Sadjadpour , Rares Ambrus , Jeannette Bohg

Multi-satellite, multi-modality in-orbit fusion is a challenging task as it explores the fusion representation of complex high-dimensional data under limited computational resources. Deep neural networks can reveal the underlying…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 DaiXun Li , Weiying Xie , Yunsong Li , Leyuan Fang

The safe operation of autonomous vehicles (AVs) is highly dependent on their understanding of the surroundings. For this, the task of 3D semantic occupancy prediction divides the space around the sensors into voxels, and labels each voxel…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Zhenxing Ming , Julie Stephany Berrio , Mao Shan , Yaoqi Huang , Hongyu Lyu , Nguyen Hoang Khoi Tran , Tzu-Yun Tseng , Stewart Worrall

Sensor fusion approaches for intelligent self-driving agents remain key to driving scene understanding given visual global contexts acquired from input sensors. Specifically, for the local waypoint prediction task, single-modality networks…

Robotics · Computer Science 2024-02-01 Hwan-Soo Choi , Jongoh Jeong , Young Hoo Cho , Kuk-Jin Yoon , Jong-Hwan Kim

3D semantic occupancy prediction is one of the crucial tasks of autonomous driving. It enables precise and safe interpretation and navigation in complex environments. Reliable predictions rely on effective sensor fusion, as different…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Tomislav Pavković , Mohammad-Ali Nikouei Mahani , Johannes Niedermayer , Johannes Betz

Nowadays, more and more sensors are equipped on robots to increase robustness and autonomous ability. We have seen various sensor suites equipped on different platforms, such as stereo cameras on ground vehicles, a monocular camera with an…

Computer Vision and Pattern Recognition · Computer Science 2019-01-14 Tong Qin , Jie Pan , Shaozu Cao , Shaojie Shen

Multimodality and multichannel monitoring have become increasingly popular and accessible in engineering, Internet of Things, wearable devices, and biomedical applications. In these contexts, given the diverse and complex nature of data…

Information Theory · Computer Science 2023-12-29 Reza Sameni

Object detection in camera images, using deep learning has been proven successfully in recent years. Rising detection rates and computationally efficient network structures are pushing this technique towards application in production…

Computer Vision and Pattern Recognition · Computer Science 2020-05-18 Felix Nobis , Maximilian Geisslinger , Markus Weber , Johannes Betz , Markus Lienkamp

Multi-modality fusion is the guarantee of the stability of autonomous driving systems. In this paper, we propose a general multi-modality cascaded fusion framework, exploiting the advantages of decision-level and feature-level fusion,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Hongwu Kuang , Xiaodong Liu , Jingwei Zhang , Zicheng Fang

Additive manufacturing, particularly fused deposition modeling, is transforming modern production by enabling rapid prototyping and complex part fabrication. However, its layer-by-layer process remains vulnerable to faults such as nozzle…

Signal Processing · Electrical Eng. & Systems 2026-02-19 Muhammad Fasih Waheed , Shonda Bernadin , Ali Hassan

Accurate and robust 3D object detection is essential for autonomous driving, where fusing data from sensors like LiDAR and camera enhances detection accuracy. However, sensor malfunctions such as corruption or disconnection can degrade…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Reza Sadeghian , Niloofar Hooshyaripour , Chris Joslin , WonSook Lee

World models for autonomous driving have the potential to dramatically improve the reasoning capabilities of today's systems. However, most works focus on camera data, with only a few that leverage lidar data or combine both to better…

Machine Learning · Computer Science 2025-08-21 Daniel Bogdoll , Yitian Yang , Tim Joseph , Melih Yazgan , J. Marius Zöllner

The current fusion positioning systems are mainly based on filtering algorithms, such as Kalman filtering or particle filtering. However, the system complexity of practical application scenarios is often very high, such as noise modeling in…

Signal Processing · Electrical Eng. & Systems 2022-09-29 Luchi Hua , Jun Yang