English
Related papers

Related papers: Multi-modal Fusion Technology based on Vehicle Inf…

200 papers

In autonomous driving, transparency in the decision-making of perception models is critical, as even a single misperception can be catastrophic. Yet with multi-sensor inputs, it is difficult to determine how each modality contributes to a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Jaehyun Park , Konyul Park , Daehun Kim , Junseo Park , Jun Won Choi

Sensor fusion is critical to perception systems for task domains such as autonomous driving and robotics. Recently, the Transformer integrated with CNN has demonstrated high performance in sensor fusion for various perception tasks. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Quoc-Vinh Lai-Dang , Jihui Lee , Bumgeun Park , Dongsoo Har

Multi-modal fusion has played a vital role in multi-modal scene understanding. Most existing methods focus on cross-modal fusion involving two modalities, often overlooking more complex multi-modal fusion, which is essential for real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Yi Liu , Chengxin Li , Shoukun Xu , Jungong Han

The safety of an automated vehicle hinges crucially upon the accuracy of perception and decision-making latency. Under these stringent requirements, future automated cars are usually equipped with multi-modal sensors such as cameras and…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-15 Zhendong Wang , Xiaoming Zeng , Shuaiwen Leon Song , Yang Hu

Multimodal image fusion and object detection are crucial for autonomous driving. While current methods have advanced the fusion of texture details and semantic information, their complex training processes hinder broader applications.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Jiaqing Zhang , Mingxiang Cao , Weiying Xie , Jie Lei , Daixun Li , Wenbo Huang , Yunsong Li , Xue Yang

Recommendation systems have lately been popularized globally, with primary use cases in online interaction systems, with significant focus on e-commerce platforms. We have developed a machine learning-based recommendation platform, which…

The last decade's market has been characterized by wearable devices, mainly smartwatches, edge, and cloud computing. A possible application of these technologies is to improve the safety of dangerous activities, especially driving motor…

Emerging Technologies · Computer Science 2023-09-22 Jacopo Sini , Luigi Pugliese , Sara Groppo , Michele Guagnano , Massimo Violante

Autonomous robots that assist humans in day to day living tasks are becoming increasingly popular. Autonomous mobile robots operate by sensing and perceiving their surrounding environment to make accurate driving decisions. A combination of…

Computer Vision and Pattern Recognition · Computer Science 2018-08-24 Varuna De Silva , Jamie Roche , Ahmet Kondoz

In the typical urban intersection scenario, both vehicles and infrastructures are equipped with visual and LiDAR sensors. By successfully integrating the data from vehicle-side and road monitoring devices, a more comprehensive and accurate…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Xinyu Zhang , Yijin Xiong , Qianxin Qu , Renjie Wang , Xin Gao , Jing Liu , Shichun Guo , Jun Li

Long-tailed distributions in class-imbalanced data present a fundamental challenge for deep learning models, which tend to be biased toward majority classes. While recent methods for long-tailed recognition have mitigated this issue, they…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Heegeon Yoon , Heeyoung Kim

Multi-modal image fusion (MMIF) integrates valuable information from different modality images into a fused one. However, the fusion of multiple visible images with different focal regions and infrared images is a unprecedented challenge in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Xilai Li , Xiaosong Li , Tao Ye , Xiaoqi Cheng , Wuyang Liu , Haishu Tan

Multimodal learning has become a prominent research area, with the potential of substantial performance gains by combining information across modalities. At the same time, model development has trended toward increasingly complex deep…

Machine Learning · Computer Science 2026-05-08 Tillmann Rheude , Roland Eils , Benjamin Wild

We present an end-to-end method for object detection and trajectory prediction utilizing multi-view representations of LiDAR returns and camera images. In this work, we recognize the strengths and weaknesses of different view…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Sudeep Fadadu , Shreyash Pandey , Darshan Hegde , Yi Shi , Fang-Chieh Chou , Nemanja Djuric , Carlos Vallespi-Gonzalez

This paper introduces a novel deep learning-based multimodal fusion architecture aimed at enhancing the perception capabilities of autonomous navigation robots in complex environments. By utilizing innovative feature extraction modules,…

Machine Learning · Computer Science 2025-04-29 Delun Lai , Yeyubei Zhang , Yunchong Liu , Chaojie Li , Huadong Mo

Autonomous vehicles have a great potential in the application of both civil and military fields, and have become the focus of research with the rapid development of science and economy. This article proposes a brief review on learning-based…

Robotics · Computer Science 2021-07-05 Qi Liu , Xueyuan Li , Shihua Yuan , Zirui Li

High-definition (HD) map construction methods are crucial for providing precise and comprehensive static environmental information, which is essential for autonomous driving systems. While Camera-LiDAR fusion techniques have shown promising…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Xiaoshuai Hao , Yuting Zhao , Yuheng Ji , Luanyuan Dai , Peng Hao , Dingzhe Li , Shuai Cheng , Rong Yin

Target detection and tracking provides crucial information for motion planning and decision making in autonomous driving. This paper proposes an online multi-object tracking (MOT) framework with tracking-by-detection for maneuvering…

Robotics · Computer Science 2019-12-03 Zehui Meng , Qi Heng Ho , Zefan Huang , Hongliang Guo , Marcelo H. Ang , Daniela Rus

Autonomous driving is a popular research area within the computer vision research community. Since autonomous vehicles are highly safety-critical, ensuring robustness is essential for real-world deployment. While several public multimodal…

This paper presents a novel vehicle motion forecasting method based on multi-head attention. It produces joint forecasts for all vehicles on a road scene as sequences of multi-modal probability density functions of their positions. Its…

Machine Learning · Computer Science 2019-12-23 Jean Mercat , Thomas Gilles , Nicole El Zoghby , Guillaume Sandou , Dominique Beauvois , Guillermo Pita Gil

This paper presents a multi-sensor fusion strategy for a novel road-matching method designed to support real-time navigational features within advanced driving-assistance systems. Managing multihypotheses is a useful strategy for the…

Artificial Intelligence · Computer Science 2007-09-10 Cherif Smaili , Maan El Badaoui El Najjar , François Charpillet