English
Related papers

Related papers: Driver Assistance System Based on Multimodal Data …

200 papers

The ability to simultaneously leverage multiple modes of sensor information is critical for perception of an automated vehicle's physical surroundings. Spatio-temporal alignment of registration of the incoming information is often a…

Computer Vision and Pattern Recognition · Computer Science 2016-11-15 Michael Giering , Vivek Venugopalan , Kishore Reddy

Autonomous driving systems face significant challenges in handling unpredictable edge-case scenarios, such as adversarial pedestrian movements, dangerous vehicle maneuvers, and sudden environmental changes. Current end-to-end driving models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Dianwei Chen , Zifan Zhang , Lei Cheng , Yuchen Liu , Xianfeng Terry Yang

Traffic safety remains a critical global challenge, with traditional Advanced Driver-Assistance Systems (ADAS) often struggling in dynamic real-world scenarios due to fragmented sensor processing and susceptibility to adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Mohammad Abu Tami , Mohammed Elhenawy , Huthaifa I. Ashqar

Multi-modal 3D object detection has received growing attention as the information from different sensors like LiDAR and cameras are complementary. Most fusion methods for 3D detection rely on an accurate alignment and calibration between 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Zhe Liu , Xiaoqing Ye , Zhikang Zou , Xinwei He , Xiao Tan , Errui Ding , Jingdong Wang , Xiang Bai

The last decade's market has been characterized by wearable devices, mainly smartwatches, edge, and cloud computing. A possible application of these technologies is to improve the safety of dangerous activities, especially driving motor…

Emerging Technologies · Computer Science 2023-09-22 Jacopo Sini , Luigi Pugliese , Sara Groppo , Michele Guagnano , Massimo Violante

Modern on-road navigation systems heavily depend on integrating speed measurements with inertial navigation systems (INS) and global navigation satellite systems (GNSS). Telemetry-based applications typically source speed data from the…

Signal Processing · Electrical Eng. & Systems 2025-06-25 Hany Ragab , Sidney Givigi , Aboelmagd Noureldin

There is a growing interest in more intelligent natural user interaction with the car. Hand gestures and speech are already being applied for driver-car interaction. Moreover, multimodal approaches are also showing promise in the automotive…

Human-Computer Interaction · Computer Science 2021-07-27 Abdul Rafey Aftab , Michael von der Beeck , Steven Rohrhirsch , Benoit Diotte , Michael Feld

Current technologies are unable to produce massively deployable, fully autonomous vehicles that do not require human intervention. Such technological limitations are projected to persist for decades. Therefore, roadway scenarios requiring a…

Applications · Statistics 2021-07-02 David Ríos Insua , William N. Caballero , Roi Naveiro

Achieving zero-collision mobility remains a key objective for intelligent vehicle systems, which requires understanding driver risk perception-a complex cognitive process shaped by voluntary response of the driver to external stimuli and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Nakul Agarwal , Yi-Ting Chen , Behzad Dariush

Multimodal wearable sensor data classification plays an important role in ubiquitous computing and has a wide range of applications in scenarios from healthcare to entertainment. However, most existing work in this field employs…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Xiang Zhang , Lina Yao , Chaoran Huang , Sen Wang , Mingkui Tan , Guodong Long , Can Wang

Detecting mental states of human users is crucial for the development of cooperative and intelligent robots, as it enables the robot to understand the user's intentions and desires. Despite their importance, it is difficult to obtain a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Hendric Voß , Heiko Wersing , Stefan Kopp

Pedestrian behavior prediction is one of the major challenges for intelligent driving systems in urban environments. Pedestrians often exhibit a wide range of behaviors and adequate interpretations of those depend on various sources of…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Amir Rasouli , Tiffany Yau , Mohsen Rohani , Jun Luo

Short-term future of automated driving can be imagined as a hybrid scenario in which both automated and human-driven vehicles co-exist in the same environment. In order to address the needs of such road configuration, many technology…

Signal Processing · Electrical Eng. & Systems 2020-08-24 Behrad Toghi , Divas Grover , Mahdi Razzaghpour , Rajat Jain , Rodolfo Valiente , Mahdi Zaman , Ghayoor Shah , Yaser P. Fallah

We propose a condition-adaptive representation learning framework for the driver drowsiness detection based on 3D-deep convolutional neural network. The proposed framework consists of four models: spatio-temporal representation learning,…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Jongmin Yu , Sangwoo Park , Sangwook Lee , Moongu Jeon

Multi-view cooperative perception and multimodal fusion are essential for reliable 3D spatiotemporal understanding in autonomous driving, especially under occlusions, limited viewpoints, and communication delays in V2X scenarios. This paper…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Zhenwei Yang , Yibo Ai , Weidong Zhang

Multimodal sensor fusion is an essential capability for autonomous robots, enabling object detection and decision-making in the presence of failing or uncertain inputs. While recent fusion methods excel in normal environmental conditions,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Edoardo Palladin , Roland Dietze , Praveen Narayanan , Mario Bijelic , Felix Heide

With the development of autonomous driving, the improvement of autonomous driving technology for individual vehicles has reached the bottleneck. The advancement of vehicle-road cooperation autonomous driving technology can expand the…

Robotics · Computer Science 2022-08-31 Songbin Chen

Multimodal camera-LiDAR fusion technology has found extensive application in 3D object detection, demonstrating encouraging performance. However, existing methods exhibit significant performance degradation in challenging scenarios…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Sixian Liu , Chen Xu , Qiang Wang , Donghai Shi , Yiwen Li

For intelligent vehicles, sensing the 3D environment is the first but crucial step. In this paper, we build a real-time advanced driver assistance system based on a low-power mobile platform. The system is a real-time multi-scheme…

Computer Vision and Pattern Recognition · Computer Science 2020-01-28 Qiwei Xie , Qian Long , Liming Zhang , Zhao Sun

LiDAR datasets for autonomous driving exhibit biases in properties such as point cloud density, range, and object dimensions. As a result, object detection networks trained and evaluated in different environments often experience…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Deepti Hegde , Suhas Lohit , Kuan-Chuan Peng , Michael J. Jones , Vishal M. Patel