English
Related papers

Related papers: Multimodal Brain-Computer Interface for In-Vehicle…

200 papers

Perception-driven approach and end-to-end system are two major vision-based frameworks for self-driving cars. However, it is difficult to introduce attention and historical information of autonomous driving process, which are the essential…

Computer Vision and Pattern Recognition · Computer Science 2017-02-21 Shitao Chen , Songyi Zhang , Jinghao Shang , Badong Chen , Nanning Zheng

Despite recent advances in automated driving technology, impaired driving continues to incur a high cost to society. In this paper, we present a driving dataset designed to support the study of two common forms of driver impairment: alcohol…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 John Gideon , Kimimasa Tamura , Emily Sumner , Laporsha Dees , Patricio Reyes Gomez , Bassamul Haq , Todd Rowell , Avinash Balachandran , Simon Stent , Guy Rosman

In real-world driving scenarios, multiple states occur simultaneously due to individual differences and environmental factors, complicating the analysis and estimation of driver states. Previous studies, limited by experimental design and…

Human-Computer Interaction · Computer Science 2024-12-20 Jiyao Wang , Ange Wang , Song Yan , Dengbo He , Kaishun Wu

Vision is the richest and most cost-effective technology for Driver Monitoring Systems (DMS), especially after the recent success of Deep Learning (DL) methods. The lack of sufficiently large and comprehensive datasets is currently a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Juan Diego Ortega , Neslihan Kose , Paola Cañas , Min-An Chao , Alexander Unnervik , Marcos Nieto , Oihana Otaegui , Luis Salgado

Drowsy driving has a crucial influence on driving safety, creating an urgent demand for driver drowsiness detection. Electroencephalogram (EEG) signal can accurately reflect the mental fatigue state and thus has been widely studied in…

Signal Processing · Electrical Eng. & Systems 2023-05-01 Xinliang Zhou , Dan Lin , Ziyu Jia , Jiaping Xiao , Chenyu Liu , Liming Zhai , Yang Liu

A smart vehicle should be able to monitor the actions and behaviors of the human driver to provide critical warnings or intervene when necessary. Recent advancements in deep learning and computer vision have shown great promise in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-15 Sumit Jha , Mohamed F. Marzban , Tiancheng Hu , Mohamed H. Mahmoud , Naofal Al-Dhahir , Carlos Busso

Driver drowsiness is one of main factors leading to road fatalities and hazards in the transportation industry. Electroencephalography (EEG) has been considered as one of the best physiological signals to detect drivers drowsy states, since…

Signal Processing · Electrical Eng. & Systems 2021-06-02 Jian Cui , Zirui Lan , Yisi Liu , Ruilin Li , Fan Li , Olga Sourina , Wolfgang Mueller-Wittig

Nowadays, the possibility to run advanced AI on embedded systems allows natural interaction between humans and machines, especially in the automotive field. We present a custom portable EEG-based Brain-Computer Interface (BCI) that exploits…

In vehicles with partial or conditional driving automation (SAE Levels 2-3), the driver remains responsible for supervising the system and responding to take-over requests. Therefore, reliable driver monitoring is essential for safe…

Human-Computer Interaction · Computer Science 2026-04-14 David Puertas-Ramirez , Raul Fernandez-Matellan , David Martin Gomez , Jesus G. Boticario

This work introduces an innovative method for estimating attention levels (cognitive load) using an ensemble of facial analysis techniques applied to webcam videos. Our method is particularly useful, among others, in e-learning…

Human-Computer Interaction · Computer Science 2024-08-15 Roberto Daza , Luis F. Gomez , Julian Fierrez , Aythami Morales , Ruben Tolosana , Javier Ortega-Garcia

This paper presents MOCAS, a multimodal dataset dedicated for human cognitive workload (CWL) assessment. In contrast to existing datasets based on virtual game stimuli, the data in MOCAS was collected from realistic closed-circuit…

Databases · Computer Science 2024-06-11 Wonse Jo , Ruiqi Wang , Su Sun , Revanth Krishna Senthilkumaran , Daniel Foti , Byung-Cheol Min

Human-machine Interface (HMI) is critical for safety during automated driving, as it serves as the only media between the automated system and human users. To enable a transparent HMI, we first need to know how to evaluate it. However, most…

Human-Computer Interaction · Computer Science 2024-06-17 Yuan-Cheng Liu , Nikol Figalova , Juergen Pichen , Philipp Hock , Martin Baumann , Klaus Bengler

Understanding how driver mental states differ between active and autonomous driving is critical for designing safe human-vehicle interfaces. This paper presents the first EEG-based comparison of cognitive load, fatigue, valence, and arousal…

Human-Computer Interaction · Computer Science 2025-12-11 Prithila Angkan , Paul Hungler , Ali Etemad

In this work we aim to predict the driver's focus of attention. The goal is to estimate what a person would pay attention to while driving, and which part of the scene around the vehicle is more critical for the task. To this end we propose…

Computer Vision and Pattern Recognition · Computer Science 2018-06-07 Andrea Palazzi , Davide Abati , Simone Calderara , Francesco Solera , Rita Cucchiara

The principal reason for measuring mental workload is to quantify the cognitive cost of performing tasks to predict human performance. Unfortunately, a method for assessing mental workload that has general applicability does not exist yet.…

Signal Processing · Electrical Eng. & Systems 2022-09-23 Luca Longo

Ensuring safe transition of control in automated vehicles requires an accurate and timely assessment of driver readiness. This paper introduces Driver-Net, a novel deep learning framework that fuses multi-camera inputs to estimate driver…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Mahdi Rezaei , Mohsen Azarmi

We propose a new representation learning solution for the classification of cognitive load based on Electroencephalogram (EEG). Our method integrates both time and frequency domains by first passing the raw EEG signals through the…

Human-Computer Interaction · Computer Science 2025-11-18 Prithila Angkan , Amin Jalali , Paul Hungler , Ali Etemad

Motion simulators allow researchers to safely investigate the interaction of drivers with a vehicle. However, many studies that use driving simulator data to predict cognitive load only employ two levels of workload, leaving a gap in…

Human-Computer Interaction · Computer Science 2024-08-14 Mehshan Ahmed Khan , Houshyar Asadi , Mohammad Reza Chalak Qazani , Chee Peng Lim , Saied Nahavandi

In human interactions, emotion recognition is crucial. For this reason, the topic of computer-vision approaches for automatic emotion recognition is currently being extensively researched. Processing multi-channel electroencephalogram (EEG)…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Joshua Bègue , Mohamed Aymen Labiod , Abdelhamid Melloulk

The integration of brain-computer interfaces (BCIs), in particular electroencephalography (EEG), with artificial intelligence (AI) has shown tremendous promise in decoding human cognition and behavior from neural signals. In particular, the…

Artificial Intelligence · Computer Science 2025-10-15 Nie Lin , Yansen Wang , Dongqi Han , Weibang Jiang , Jingyuan Li , Ryosuke Furuta , Yoichi Sato , Dongsheng Li