English
Related papers

Related papers: Graph-Based Multi-Modal Sensor Fusion for Autonomo…

200 papers

With the advancement of autonomous driving, numerous annotated multi-modality datasets have become available. This presents an opportunity to develop domain-adaptive 3D object detectors for new environments without relying on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Xiaohu Lu , Hamed Khatounabadi , Hayder Radha

In recent years, multi-modal fusion has attracted a lot of research interest, both in academia, and in industry. Multimodal fusion entails the combination of information from a set of different types of sensors. Exploiting complementary…

Machine Learning · Computer Science 2020-08-27 Siddharth Roheda , Hamid Krim , Benjamin S. Riggan

We propose a method for automated synchronization of vehicle sensors useful for the study of multi-modal driver behavior and for the design of advanced driver assistance systems. Multi-sensor decision fusion relies on synchronized data…

Robotics · Computer Science 2016-03-02 Lex Fridman , Daniel E Brown , William Angell , Irman Abdić , Bryan Reimer , Hae Young Noh

Detecting road features is a key enabler for autonomous driving and localization. For instance, a reliable detection of poles which are widespread in road environments can improve localization. Modern deep learning-based perception systems…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Maxime Noizet , Philippe Xu , Philippe Bonnifait

Cooperative Localization is expected to play a crucial role in various applications in the field of Connected and Autonomous vehicles (CAVs). Future 5G wireless systems are expected to enable cost-effective Vehicle-to-Everything…

Signal Processing · Electrical Eng. & Systems 2021-07-19 Nikos Piperigkos , Aris S. Lalos , Kostas Berberidis , Christos Anagnostopoulos

Reliable, drift-free global localization presents significant challenges yet remains crucial for autonomous navigation in large-scale dynamic environments. In this paper, we introduce a tightly-coupled Semantic-LiDAR-Inertial-Wheel Odometry…

Robotics · Computer Science 2025-09-19 Haoxuan Jiang , Peicong Qian , Yusen Xie , Linwei Zheng , Xiaocong Li , Ming Liu , Jun Ma

Moving Object Detection (MOD) is a critical vision task for successfully achieving safe autonomous driving. Despite plausible results of deep learning methods, most existing approaches are only frame-based and may fail to reach reasonable…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Zhuyun Zhou , Zongwei Wu , Rémi Boutteau , Fan Yang , Cédric Demonceaux , Dominique Ginhac

Multi-modal systems enhance performance in autonomous driving but face inefficiencies due to indiscriminate processing within each modality. Additionally, the independent feature learning of each modality lacks interaction, which results in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Guoliang You , Xiaomeng Chu , Yifan Duan , Xingchen Li , Sha Zhang , Jianmin Ji , Yanyong Zhang

Map construction task plays a vital role in providing precise and comprehensive static environmental information essential for autonomous driving systems. Primary sensors include cameras and LiDAR, with configurations varying between…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Xiaoshuai Hao , Yunfeng Diao , Mengchuan Wei , Yifan Yang , Peng Hao , Rong Yin , Hui Zhang , Weiming Li , Shu Zhao , Yu Liu

Ensuring safe transition of control in automated vehicles requires an accurate and timely assessment of driver readiness. This paper introduces Driver-Net, a novel deep learning framework that fuses multi-camera inputs to estimate driver…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Mahdi Rezaei , Mohsen Azarmi

3D multi-object tracking is a crucial component in the perception system of autonomous driving vehicles. Tracking all dynamic objects around the vehicle is essential for tasks such as obstacle avoidance and path planning. Autonomous…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Ramin Nabati , Landon Harris , Hairong Qi

Inspired by the fact that humans use diverse sensory organs to perceive the world, sensors with different modalities are deployed in end-to-end driving to obtain the global context of the 3D scene. In previous works, camera and LiDAR inputs…

Computer Vision and Pattern Recognition · Computer Science 2022-08-04 Qingwen Zhang , Mingkai Tang , Ruoyu Geng , Feiyi Chen , Ren Xin , Lujia Wang

In autonomous driving, transparency in the decision-making of perception models is critical, as even a single misperception can be catastrophic. Yet with multi-sensor inputs, it is difficult to determine how each modality contributes to a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Jaehyun Park , Konyul Park , Daehun Kim , Junseo Park , Jun Won Choi

Reliable segmentation of road lines and markings is critical to autonomous driving. Our work is motivated by the observations that road lines and markings are (1) frequently occluded in the presence of moving vehicles, shadow, and glare and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Shan Wang , Chuong Nguyen , Jiawei Liu , Kaihao Zhang , Wenhan Luo , Yanhao Zhang , Sundaram Muthu , Fahira Afzal Maken , Hongdong Li

Multi-modality image fusion aims at fusing modality-specific (complementarity) and modality-shared (correlation) information from multiple source images. To tackle the problem of the neglect of inter-feature relationships, high-frequency…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Xiaoli Zhang , Liying Wang , Libo Zhao , Xiongfei Li , Siwei Ma

Recent progress in aspect-level sentiment classification has been propelled by the incorporation of graph neural networks (GNNs) leveraging syntactic structures, particularly dependency trees. Nevertheless, the performance of these models…

Computation and Language · Computer Science 2023-12-08 Jane Sunny , Tom Padraig , Roggie Terry , Woods Ali

Accurate and real-time traffic state prediction is of great practical importance for urban traffic control and web mapping services. With the support of massive data, deep learning methods have shown their powerful capability in capturing…

Machine Learning · Computer Science 2023-09-07 Xunlian Luo , Chunjiang Zhu , Detian Zhang , Qing Li

Multi-sensor fusion is essential for autonomous vehicle localization, as it is capable of integrating data from various sources for enhanced accuracy and reliability. The accuracy of the integrated location and orientation depends on the…

Robotics · Computer Science 2025-03-10 Changhong Lin , Jiarong Lin , Zhiqiang Sui , XiaoZhi Qu , Rui Wang , Kehua Sheng , Bo Zhang

The technology of dynamic map fusion among networked vehicles has been developed to enlarge sensing ranges and improve sensing accuracies for individual vehicles. This paper proposes a federated learning (FL) based dynamic map fusion…

Machine Learning · Computer Science 2022-09-23 Zijian Zhang , Shuai Wang , Yuncong Hong , Liangkai Zhou , Qi Hao

Multimodal emotion recognition aims to recognize emotions for each utterance of multiple modalities, which has received increasing attention for its application in human-machine interaction. Current graph-based methods fail to…

Computation and Language · Computer Science 2023-11-21 Dongyuan Li , Yusong Wang , Kotaro Funakoshi , Manabu Okumura