English
Related papers

Related papers: EEG2Vision: A Multimodal EEG-Based Framework for 2…

200 papers

Surface electromyography (EMG) is a promising modality for silent speech interfaces, but its effectiveness depends heavily on sensor placement and channel availability. In this work, we investigate the contribution of individual and…

Sound · Computer Science 2026-02-09 Injune Hwang , Jaejun Lee , Kyogu Lee

Brain-computer interfaces (BCI) offer numerous human-centered application possibilities, particularly affecting people with neurological disorders. Text or speech decoding from brain activities is a relevant domain that could augment the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-10 Jihwan Lee , Tiantian Feng , Aditya Kommineni , Sudarsana Reddy Kadiri , Shrikanth Narayanan

For real-world BCI applications, lightweight Electroencephalography (EEG) systems offer the best cost-deployment balance. However, such spatial sparsity of EEG limits spatial fidelity, hurting learning and introducing bias. EEG spatial…

Multimedia · Computer Science 2026-02-24 Hongjun Liu , Leyu Zhou , Zijianghao Yang , Chao Yao

Current EEG/MEG-to-text decoding systems suffer from three key limitations: (1) reliance on teacher-forcing methods, which compromises robustness during inference, (2) sensitivity to session-specific noise, hindering generalization across…

Artificial Intelligence · Computer Science 2025-08-06 Jilong Li , Zhenxi Song , Jiaqi Wang , Meishan Zhang , Honghai Liu , Min Zhang , Zhiguo Zhang

Recent advances in self-supervised learning for EEG representation have largely relied on masked reconstruction, where models are trained to recover randomly masked signal segments. While effective at modeling local dependencies, such…

Machine Learning · Computer Science 2026-04-17 Shaocong Wang , Tong Liu , Yihan Li , Ming Li , Kairui Wen , Pei Yang , Wenqi Ji , Minjing Yu , Yong-Jin Liu

Effective visual brain-machine interfaces (BMI) is based on reliable and stable EEG biomarkers. However, traditional adaptive filter-based approaches may suffer from individual variations in EEG signals, while deep neural network-based…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Junwen Luo , Chengyong Jiang , Qingyuan Chen , Dongqi Han , Yansen Wang , Biao Yan , Dongsheng Li , Jiayi Zhang

Brain-computer interfaces (BCIs) enable direct communication between the brain and external devices, providing critical support for individuals with motor impairments. However, accurate motor imagery (MI) decoding from…

Machine Learning · Computer Science 2026-04-08 Panagiotis Andrikopoulos , Siamak Mehrkanoon

EEG is the most common signal source for noninvasive BCI applications. For such applications, the EEG signal needs to be decoded and translated into appropriate actions. A recently emerging EEG decoding approach is deep learning with…

Signal Processing · Electrical Eng. & Systems 2019-01-25 Felix A. Heilmeyer , Robin T. Schirrmeister , Lukas D. J. Fiederer , Martin Völker , Joos Behncke , Tonio Ball

Identifying abnormal patterns in electroencephalography (EEG) remains the cornerstone of diagnosing several neurological diseases. The current clinical EEG review process relies heavily on expert visual review, which is unscalable and…

Signal Processing · Electrical Eng. & Systems 2023-02-07 Teja Gupta , Neeraj Wagh , Samarth Rawal , Brent Berry , Gregory Worrell , Yogatheesan Varatharajah

Decoding visual experience from brain signals offers exciting possibilities for neuroscience and interpretable AI. While EEG is accessible and temporally precise, its limitations in spatial detail hinder image reconstruction. Our model…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Arshak Rezvani , Ali Akbari , Kosar Sanjar Arani , Maryam Mirian , Emad Arasteh , Martin J. McKeown

While electroencephalography (EEG) has been a popular modality for neural decoding, it often involves task specific acquisition of the EEG data. This poses challenges for the development of a unified pipeline to learn embeddings for various…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Pushapdeep Singh , Jyoti Nigam , Medicherla Vamsi Krishna , Arnav Bhavsar , Aditya Nigam

This work investigates the predictive potential of bipolar electroencephalogram (EEG) recordings towards efficient prediction of poor neurological outcomes. A retrospective design using a hybrid deep learning approach is utilized to…

Signal Processing · Electrical Eng. & Systems 2023-10-09 Hemin Ali Qadir , Naimahmed Nesaragi , Per Steiner Halvorsen , Ilangko Balasingham

Current expressive avatar systems rely heavily on visual cues, failing when faces are occluded or when emotions remain internal. We present Mind-to-Face, the first framework that decodes non-invasive electroencephalogram (EEG) signals…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Haolin Xiong , Tianwen Fu , Pratusha Bhuvana Prasad , Yunxuan Cai , Haiwei Chen , Wenbin Teng , Hanyuan Xiao , Yajie Zhao

Electroencephalography (EEG)-based multimodal learning integrates brain signals with complementary modalities to improve mental state assessment, providing great clinical potential. The effectiveness of such paradigms largely depends on the…

Machine Learning · Computer Science 2026-05-12 Runhe Zhou , Shanglin Li , Guanxiang Huang , Xinliang Zhou , Qibin Zhao , Motoaki Kawanabe , Yi Ding , Cuntai Guan

Event cameras provide a promising sensing modality for high-speed and high-dynamic-range vision by asynchronously capturing brightness changes. A fundamental task in event-based vision is event-to-video (E2V) reconstruction, which aims to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Jingqian Wu , Yunbo Jia , Shengpeng Xu , Edmund Y. Lam

While functional magnetic resonance imaging (fMRI) offers valuable insights into brain activity, it is limited by high operational costs and significant infrastructural demands. In contrast, electroencephalography (EEG) provides…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Kristofer Grover Roos , Atsushi Fukuda , Quan Huu Cap

Electroencephalogram (EEG) has shown a useful approach to produce a brain-computer interface (BCI). One-dimensional (1-D) EEG signal is yet easily disturbed by certain artifacts (a.k.a. noise) due to the high temporal resolution. Thus, it…

Signal Processing · Electrical Eng. & Systems 2025-04-03 Peng Yi , Kecheng Chen , Zhaoqi Ma , Di Zhao , Xiaorong Pu , Yazhou Ren

Accurate and timely seizure detection from Electroencephalography (EEG) is critical for clinical intervention, yet manual review of long-term recordings is labor-intensive. Recent efforts to encode EEG signals into large language models…

Machine Learning · Computer Science 2026-02-10 Yan Chen , Jie Peng , Moajjem Hossain Chowdhury , Tianlong Chen , Yunmei Liu

In this study, we tackle a modern research challenge within the field of perceptual brain decoding, which revolves around synthesizing images from EEG signals using an adversarial deep learning framework. The specific objective is to…

Artificial Intelligence · Computer Science 2024-11-21 Rahul Mishra , Arnav Bhavsar

Decoding speech from non-invasive brain signals, such as electroencephalography (EEG), has the potential to advance brain-computer interfaces (BCIs), with applications in silent communication and assistive technologies for individuals with…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-30 Terrance Yu-Hao Chen , Yulin Chen , Pontus Soederhaell , Sadrishya Agrawal , Kateryna Shapovalenko