English
Related papers

Related papers: Multimodal Polynomial Fusion for Detecting Driver …

200 papers

Sophisticated user interaction in the automotive industry is a fast emerging topic. Mid-air gestures and speech already have numerous applications for driver-car interaction. Additionally, multimodal approaches are being developed to…

Human-Computer Interaction · Computer Science 2020-12-29 Abdul Rafey Aftab , Michael von der Beeck , Michael Feld

Drowsy driving represents a major contributor to traffic accidents, and the implementation of driver drowsy driving detection systems has been proven to significantly reduce the occurrence of such accidents. Despite the development of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Shulei QU , Zhenguo Gao , Xiaoxiao Wu , Yuanyuan Qiu

Driver distraction causes a significant number of traffic accidents every year, resulting in economic losses and casualties. Currently, the level of automation in commercial vehicles is far from completely unmanned, and drivers still play…

Computer Vision and Pattern Recognition · Computer Science 2023-07-14 Yingzhi Zhang , Taiguo Li , Chao Li , Xinghong Zhou

Driver action recognition, aiming to accurately identify drivers' behaviours, is crucial for enhancing driver-vehicle interactions and ensuring driving safety. Unlike general action recognition, drivers' environments are often challenging,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Ruoyu Wang , Wenqian Wang , Jianjun Gao , Dan Lin , Kim-Hui Yap , Bingbing Li

Depression, a prevalent and serious mental health issue, affects approximately 3.8\% of the global population. Despite the existence of effective treatments, over 75\% of individuals in low- and middle-income countries remain untreated,…

Computation and Language · Computer Science 2024-07-19 Shengjie Li , Yinhao Xiao

Despite increasing interest in computer vision-based distracted driving detection, most existing models rely exclusively on driver-facing views and overlook crucial environmental context that influences driving behavior. This study…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Anthony Dontoh , Stephanie Ivey , Armstrong Aboah

It is now well established from a variety of studies that there is a significant benefit from combining video and audio data in detecting active speakers. However, either of the modalities can potentially mislead audiovisual fusion by…

Pedestrian crossing intention prediction is essential for the deployment of autonomous vehicles (AVs) in urban environments. Ideal prediction provides AVs with critical environmental cues, thereby reducing the risk of pedestrian-related…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Yuanzhe Li , Steffen Müller

Voice Activity Detection (VAD) plays a key role in speech processing, often utilizing hand-crafted or neural features. This study examines the effectiveness of Mel-Frequency Cepstral Coefficients (MFCCs) and pre-trained model (PTM)…

Sound · Computer Science 2025-06-03 Kumud Tripathi , Chowdam Venkata Kumar , Pankaj Wasnik

Driver distractions are known to be the dominant cause of road accidents. While monitoring systems can detect non-driving-related activities and facilitate reducing the risks, they must be accurate and efficient to be applicable.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Yiming Ma , Victor Sanchez , Soodeh Nikan , Devesh Upadhyay , Bhushan Atote , Tanaya Guha

End-to-end autonomous driving has witnessed remarkable progress. However, the extensive deployment of autonomous vehicles has yet to be realized, primarily due to 1) inefficient multi-modal environment perception: how to integrate data from…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Dongyang Xu , Haokun Li , Qingfan Wang , Ziying Song , Lei Chen , Hanming Deng

Ensuring safe transition of control in automated vehicles requires an accurate and timely assessment of driver readiness. This paper introduces Driver-Net, a novel deep learning framework that fuses multi-camera inputs to estimate driver…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Mahdi Rezaei , Mohsen Azarmi

In this survey, we first introduce the background of popular sensors used for self-driving, their data properties, and the corresponding object detection algorithms. Next, we discuss existing datasets that can be used for evaluating…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Yingjie Wang , Qiuyu Mao , Hanqi Zhu , Jiajun Deng , Yu Zhang , Jianmin Ji , Houqiang Li , Yanyong Zhang

There is a growing interest in more intelligent natural user interaction with the car. Hand gestures and speech are already being applied for driver-car interaction. Moreover, multimodal approaches are also showing promise in the automotive…

Human-Computer Interaction · Computer Science 2021-07-27 Abdul Rafey Aftab , Michael von der Beeck , Steven Rohrhirsch , Benoit Diotte , Michael Feld

With over 50 million car sales annually and over 1.3 million deaths every year due to motor accidents we have chosen this space. India accounts for 11 per cent of global death in road accidents. Drivers are held responsible for 78% of…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Narayana Darapaneni , Jai Arora , MoniShankar Hazra , Naman Vig , Simrandeep Singh Gandhi , Saurabh Gupta , Anwesh Reddy Paduri

In this paper, we presented a preliminary study for tactical driver behavior detection from untrimmed naturalistic driving recordings. While supervised learning based detection is a common approach, it suffers when labeled data is scarce.…

Computer Vision and Pattern Recognition · Computer Science 2018-07-04 Athma Narayanan , Yi-Ting Chen , Srikanth Malla

Driver inattention assessment has become a very active field in intelligent transportation systems. Based on active sensor Kinect and computer vision tools, we have built an efficient module for detecting driver distraction and recognizing…

Computer Vision and Pattern Recognition · Computer Science 2015-02-03 Céline Craye , Fakhri Karray

With the enrichment of smartphones, driving distractions caused by phone usages have become a threat to driving safety. A promising way to mitigate driving distractions is to detect them and give real-time safety warnings. However, existing…

Machine Learning · Computer Science 2021-03-16 Chen Chai , Juanwu Lu , Xuan Jiang , Xiupeng Shi , Zeng Zeng

Multi-modal learning has been intensified in recent years, especially for applications in facial analysis and action unit detection whilst there still exist two main challenges in terms of 1) relevant feature learning for representation and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Xiang Zhang , Lijun Yin

This paper explores the development of a multimodal sentiment analysis model that integrates text, audio, and visual data to enhance sentiment classification. The goal is to improve emotion detection by capturing the complex interactions…

Computation and Language · Computer Science 2025-01-15 Hui Lee , Singh Suniljit , Yong Siang Ong