English
Related papers

Related papers: Capsule Attention for Multimodal EEG-EOG Represent…

200 papers

Human drivers adeptly navigate complex scenarios by utilizing rich attentional semantics, but the current autonomous systems struggle to replicate this ability, as they often lose critical semantic information when converting 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Pei Liu , Haipeng Liu , Haichao Liu , Xin Liu , Jinxin Ni , Jun Ma

Understanding the correlation between EEG features and cognitive tasks is crucial for elucidating brain function. Brain activity synchronizes during speaking and listening tasks. However, it is challenging to estimate task-dependent brain…

Neurons and Cognition · Quantitative Biology 2024-10-01 Dai Shimizu , Ko Watanabe , Andreas Dengel

Detecting driver distraction is a significant concern for future intelligent transportation systems. We present a new approach for identifying distracted driving behavior by evaluating a stimulus and response interaction with the brain…

Human-Computer Interaction · Computer Science 2019-04-22 Garima Bajwa , Mohamed Fazeen , Ram Dantu

Electroencephalography (EEG) reflects the brain's functional state, making it a crucial tool for diverse detection applications like seizure detection and sleep stage classification. While deep learning-based approaches have recently shown…

Machine Learning · Computer Science 2025-10-07 Kerui Wu , Ziyue Zhao , Bülent Yener

Accurate and continuous estimation of cognitive workload is fundamental to creating adaptive human-machine systems. However, designing architectures that balance representational capacity with computational efficiency has been challenging…

Signal Processing · Electrical Eng. & Systems 2026-05-20 Stefanos Gkikas , Christian Arzate Cruz , Thomas Kassiotis , Giorgos Giannakakis , Raul Fernandez Rojas , Randy Gomez

Vehicle taillight recognition is an important application for automated driving, especially for intent prediction of ado vehicles and trajectory planning of the ego vehicle. In this work, we propose an end-to-end deep learning framework to…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Kuan-Hui Lee , Takaaki Tagawa , Jia-En M. Pan , Adrien Gaidon , Bertrand Douillard

Vision Transformers are very popular nowadays due to their state-of-the-art performance in several computer vision tasks, such as image classification and action recognition. Although their performance has been greatly enhanced through…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Dimitrios Konstantinidis , Ilias Papastratis , Kosmas Dimitropoulos , Petros Daras

Driver drowsiness is one of main factors leading to road fatalities and hazards in the transportation industry. Electroencephalography (EEG) has been considered as one of the best physiological signals to detect drivers drowsy states, since…

Signal Processing · Electrical Eng. & Systems 2021-06-02 Jian Cui , Zirui Lan , Yisi Liu , Ruilin Li , Fan Li , Olga Sourina , Wolfgang Mueller-Wittig

Fatigue is the most vital factor of road fatalities and one manifestation of fatigue during driving is drowsiness. In this paper, we propose using deep Q-learning to analyze an electroencephalogram (EEG) dataset captured during a simulated…

Machine Learning · Computer Science 2020-05-19 Yurui Ming , Dongrui Wu , Yu-Kai Wang , Yuhui Shi , Chin-Teng Lin

Predicting a driver's cognitive state, or more specifically, modeling a driver's reaction time (RT) in response to the appearance of a potential hazard warrants urgent research. In the last two decades, the electric field that is generated…

Human-Computer Interaction · Computer Science 2019-05-28 Chun-Hsiang Chuang , Zehong Cao , Po-Tsang Chen , Chih-Sheng Huang , Nikhil R. Pal , Chin-Teng Lin

While the Self-Attention mechanism in the Transformer model has proven to be effective in many domains, we observe that it is less effective in more diverse settings (e.g. multimodality) due to the varying granularity of each token and the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Wayner Barrios , SouYoung Jin

We introduce the Momentum Transformer, an attention-based deep-learning architecture, which outperforms benchmark time-series momentum and mean-reversion trading strategies. Unlike state-of-the-art Long Short-Term Memory (LSTM)…

Machine Learning · Computer Science 2022-11-24 Kieran Wood , Sven Giegerich , Stephen Roberts , Stefan Zohren

Autonomous driving technology has advanced significantly, yet detecting driving anomalies remains a major challenge due to the long-tailed distribution of driving events. Existing methods primarily rely on single-modal road condition video…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Long Zhouxiang , Ovanes Petrosian

Refractive errors are among the most common visual impairments globally, yet their diagnosis often relies on active user participation and clinical oversight. This study explores a passive method for estimating refractive power using two…

Image and Video Processing · Electrical Eng. & Systems 2025-05-27 Xin Wei , Huakun Liu , Yutaro Hirao , Monica Perusquia-Hernandez , Katsutoshi Masai , Hideaki Uchiyama , Kiyoshi Kiyokawa

A smart vehicle should be able to monitor the actions and behaviors of the human driver to provide critical warnings or intervene when necessary. Recent advancements in deep learning and computer vision have shown great promise in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-15 Sumit Jha , Mohamed F. Marzban , Tiancheng Hu , Mohamed H. Mahmoud , Naofal Al-Dhahir , Carlos Busso

Multimodal learning has been a popular area of research, yet integrating electroencephalogram (EEG) data poses unique challenges due to its inherent variability and limited availability. In this paper, we introduce a novel multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Kang Yin , Hye-Bin Shin , Dan Li , Seong-Whan Lee

Public charging station occupancy prediction plays key importance in developing a smart charging strategy to reduce electric vehicle (EV) operator and user inconvenience. However, existing studies are mainly based on conventional…

Machine Learning · Computer Science 2021-11-16 Tai-Yu Ma , Sébastien Faye

Electroencephalogram (EEG) is a valuable technique to record brain electrical activity through electrodes placed on the scalp. Analyzing EEG signals contributes to the understanding of neurological conditions and developing brain-computer…

Signal Processing · Electrical Eng. & Systems 2024-12-25 Haili Ye , Stephan Goerttler , Fei He

Attention mechanisms underpin the success of large language models (LLMs), yet their substantial computational and memory overhead poses challenges for optimizing efficiency and performance. A critical bottleneck arises as KV cache and…

Computation and Language · Computer Science 2025-07-24 Luoyang Sun , Cheng Deng , Jiwen Jiang , Xinjian Wu , Haifeng Zhang , Lei Chen , Lionel Ni , Jun Wang

Continuous electroencephalography (EEG) is routinely used in neurocritical care to monitor seizures and other harmful brain activity, including rhythmic and periodic patterns that are clinically significant. Although deep learning methods…

Human-Computer Interaction · Computer Science 2026-01-05 Argha Kamal Samanta , Deepak Mewada , Monalisa Sarma , Debasis Samanta