English
Related papers

Related papers: Multimodal Brain-Computer Interface for In-Vehicle…

200 papers

Understanding the interaction of neural and cardiac systems during cognitive activity is critical to advancing physiological computing. Although EEG has been the gold standard for assessing mental workload, its limited portability restricts…

Machine Learning · Computer Science 2026-01-06 Akshay Sasi , Malavika Pradeep , Nusaibah Farrukh , Rahul Venugopal , Elizabeth Sherly

The electroencephalogram (EEG) has been the gold standard for quantifying mental workload; however, due to its complexity and non-portability, it can be constraining. ECG signals, which are feasible on wearable equipment pieces such as…

Machine Learning · Computer Science 2026-01-13 Malavika Pradeep , Akshay Sasi , Nusaibah Farrukh , Rahul Venugopal , Elizabeth Sherly

Robust and unobtrusive in-vehicle physiological monitoring is crucial for ensuring driving safety and user experience. While remote physiological measurement (RPM) offers a promising non-invasive solution, its translation to real-world…

Artificial Intelligence · Computer Science 2025-07-28 Jiyao Wang , Xiao Yang , Qingyong Hu , Jiankai Tang , Can Liu , Dengbo He , Yuntao Wang , Yingcong Chen , Kaishun Wu

Driving behavior is inherently personal, influenced by individual habits, decision-making styles, and physiological states. However, most existing datasets treat all drivers as homogeneous, overlooking driver-specific variability. To…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Chuheng Wei , Ziye Qin , Siyan Li , Ziyan Zhang , Xuanpeng Zhao , Amr Abdelraouf , Rohit Gupta , Kyungtae Han , Matthew J. Barth , Guoyuan Wu

Classifying human cognitive states from behavioral and physiological signals is a challenging problem with important applications in robotics. The problem is challenging due to the data variability among individual users, and sensor…

Human-Computer Interaction · Computer Science 2018-10-09 Ruohan Wang , Pierluigi V. Amadori , Yiannis Demiris

Road traffic accidents remain a significant global concern, with the majority attributed to human factors such as driver distraction and fatigue. This study proposes a camera-based approach to derive useful indicators to assess driver…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Carmelo Scribano , Giovanni Cappelletti , Elia Giacobazzi , Giorgia Franchini , Paolo Burgio , Marko Bertogna

A fundamental challenge in car-following modeling lies in accurately representing the multi-scale complexity of driving behaviors, particularly the intra-driver heterogeneity where a single driver's actions fluctuate dynamically under…

Machine Learning · Computer Science 2025-06-09 Shirui Zhou , Jiying Yan , Junfang Tian , Tao Wang , Yongfu Li , Shiquan Zhong

This article describes GAZELOAD, a multimodal dataset for mental workload estimation in industrial human-robot collaboration. The data were collected in a laboratory assembly testbed where 26 participants interacted with two collaborative…

Robotics · Computer Science 2026-01-30 Bsher Karbouj , Baha Eddin Gaaloul , Jorg Kruger

Mutual understanding between driver and vehicle is critically important to the design of intelligent vehicles and customized interaction interface. In this study, a unified driver behavior reasoning system toward multi-scale and multi-tasks…

Systems and Control · Electrical Eng. & Systems 2020-03-23 Yang Xing , Chen Lv , Dongpu Cao , Efstathios Velenis

In this paper, we explore different deep learning based approaches to detect driver fatigue. Drowsy driving results in approximately 72,000 crashes and 44,000 injuries every year in the US and detecting drowsiness and alerting the driver…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Ken Alparslan , Yigit Alparslan , Matthew Burlick

Electroencephalography (EEG) is an integral tool in neurocognitive research worldwide. However, research grade EEG (32/64ch) systems are expensive and have cumbersome setup designed for clinical usage not suited for rugged environment of…

Neurons and Cognition · Quantitative Biology 2022-09-27 Manvi Jain , C. M. Markan

Electroencephalography (EEG) interpretation using multimodal large language models (MLLMs) offers a novel approach for analyzing brain signals. However, the complex nature of brain activity introduces critical challenges: EEG signals…

Signal Processing · Electrical Eng. & Systems 2025-10-02 Ziyi Zeng , Zhenyang Cai , Yixi Cai , Xidong Wang , Junying Chen , Rongsheng Wang , Yipeng Liu , Siqi Cai , Benyou Wang , Zhiguo Zhang , Haizhou Li

As semi-automated vehicles (SAVs) become more common, ensuring effective human-vehicle interaction during control handovers remains a critical safety challenge. Existing studies often rely on single-session simulator experiments or…

Human-Computer Interaction · Computer Science 2026-04-02 Yasaman Hakiminejad , Shiva Azimi , Luis Gomero , Elizabeth Pantesco , Irene P. Kan , Meltem Izzetoglu , Arash Tavakoli

Human cognitive performance is constrained by limited mental resources, yet continuous computational estimation of cognitive capacity dynamics remains an open challenge. We propose a theory-driven multimodal learning framework that models…

Machine Learning · Computer Science 2026-05-26 Yisak Debele , Henok Ademtew , Israel Goytom

Effective driving style analysis is critical to developing human-centered intelligent driving systems that consider drivers' preferences. However, the approaches and conclusions of most related studies are diverse and inconsistent because…

Robotics · Computer Science 2024-06-13 Chaopeng Zhang , Wenshuo Wang , Zhaokun Chen , Junqiang Xi

Monitoring drivers' mental workload facilitates initiating and maintaining safe interactions with in-vehicle information systems, and thus delivers adaptive human machine interaction with reduced impact on the primary task of driving. In…

Signal Processing · Electrical Eng. & Systems 2023-09-11 Nermin Caber , Bashar I. Ahmad , Jiaming Liang , Simon Godsill , Alexandra Bremers , Philip Thomas , David Oxtoby , Lee Skrypchuk

This paper addresses the learning task of estimating driver drowsiness from the signals of car acceleration sensors. Since even drivers themselves cannot perceive their own drowsiness in a timely manner unless they use burdensome invasive…

Machine Learning · Computer Science 2020-05-13 Takayuki Katsuki , Kun Zhao , Takayuki Yoshizumi

Engagement, which links to attentional, emotional, and cognitive dimensions, plays an important role in learning. In online and video-based learning environments, learners often need to regulate their own interactions with instructional…

Human-Computer Interaction · Computer Science 2026-05-05 Zikang Leng , Edan Eyal , Yingtian Shi , Jiaman He , Yaqi Liu , Thomas Plötz

Multi-task learning for advanced driver assistance systems requires modeling the complex interplay between driver internal states and external traffic environments. However, existing methods treat recognition tasks as flat and independent…

Machine Learning · Computer Science 2026-04-10 Keito Inoshita , Nobuhiro Hayashida , Akira Imanishi

With the growing need to effectively support workforce upskilling in the manufacturing sector, virtual reality is gaining popularity as a scalable training solution. However, most current systems are designed as static, step-by-step…

Human-Computer Interaction · Computer Science 2025-10-08 Bhavya Matam , Adamay Mann , Kachina Studer , Christian Gabbianelli , Sonia Castelo , John Liu , Claudio Silva , Dishita Turakhia