English
Related papers

Related papers: DECAF: Dynamic Envelope Context-Aware Fusion for S…

200 papers

Human language processing relies on the brain's capacity for predictive inference. We present a machine learning framework for decoding neural (EEG) responses to dynamic visual language stimuli in Deaf signers. Using coherence between…

Neurons and Cognition · Quantitative Biology 2025-12-25 Sean C. Borneman , Julia Krebs , Ronnie B. Wilbur , Evie A. Malaia

Decoding the directional focus of an attended speaker from listeners' electroencephalogram (EEG) signals is essential for developing brain-computer interfaces to improve the quality of life for individuals with hearing impairment. Previous…

Sound · Computer Science 2025-10-23 Yuanming Zhang , Jing Lu , Fei Chen , Haoliang Du , Xia Gao , Zhibin Lin

Auditory attention decoding (AAD) identifies the attended speech stream in multi-speaker environments by decoding brain signals such as electroencephalography (EEG). This technology is essential for realizing smart hearing aids that address…

Signal Processing · Electrical Eng. & Systems 2026-01-26 Masahiro Yoshino , Haruki Yokota , Junya Hara , Yuichi Tanaka , Hiroshi Higashi

Recent advances in electroencephalography (EEG) foundation models, which capture transferable EEG representations, have greatly accelerated the development of brain-computer interfaces (BCIs). However, existing approaches still struggle to…

Machine Learning · Computer Science 2026-03-24 Muyun Jiang , Shuailei Zhang , Zhenjie Yang , Mengjun Wu , Weibang Jiang , Zhiwei Guo , Wei Zhang , Rui Liu , Shangen Zhang , Yong Li , Yi Ding , Cuntai Guan

Decoding visual information from electroencephalography (EEG) signals remains a fundamental challenge in brain-computer interfaces and medical rehabilitation. Existing EEG visual decoding methods mainly focus on learning a single global EEG…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Xiang Gao , Hui Tian , Yanming Zhu , Xuefei Yin , Alan Wee-Chung Liew

Advances in neuroscience and artificial intelligence have enabled preliminary decoding of brain activity. However, despite the progress, the interpretability of neural representations remains limited. A significant challenge arises from the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Hasib Aslam , Muhammad Talal Faiz , Muhammad Imran Malik

Decoding continuous language from neural signals remains a significant challenge in the intersection of neuroscience and artificial intelligence. We introduce Neuro2Semantic, a novel framework that reconstructs the semantic content of…

Computation and Language · Computer Science 2025-06-03 Siavash Shams , Richard Antonello , Gavin Mischler , Stephan Bickel , Ashesh Mehta , Nima Mesgarani

Transformers are groundbreaking architectures that have changed a flow of deep learning, and many high-performance models are developing based on transformer architectures. Transformers implemented only with attention with encoder-decoder…

Human-Computer Interaction · Computer Science 2021-12-20 Young-Eun Lee , Seo-Hyun Lee

Decoding speech from stereo-electroencephalography (sEEG) signals has emerged as a promising direction for brain-computer interfaces (BCIs). Its clinical applicability, however, is limited by the inherent non-stationarity of neural signals,…

Human-Computer Interaction · Computer Science 2025-09-30 Suli Wang , Yang-yang Li , Siqi Cai , Haizhou Li

Reconstructing dynamic visual stimuli from brain EEG recordings is challenging due to the non-stationary and noisy nature of EEG signals and the limited availability of EEG-video datasets. Prior work has largely focused on static image…

Human-Computer Interaction · Computer Science 2025-09-23 Prajwal Singh , Anupam Sharma , Pankaj Pandey , Krishna Miyapuram , Shanmuganathan Raman

Translating imagined speech from human brain activity into voice is a challenging and absorbing research issue that can provide new means of human communication via brain signals. Endeavors toward reconstructing speech from brain activity…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-19 Young-Eun Lee , Seo-Hyun Lee , Sang-Ho Kim , Seong-Whan Lee

Electroencephalography (EEG)-based visual perception reconstruction has become an important area of research. Neuroscientific studies indicate that humans can decode imagined 3D objects by perceiving or imagining various visual information,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Xin Xiang , Wenhui Zhou , Guojun Dai

Identifying the target speaker in hearing aid applications is crucial to improve speech understanding. Recent advances in electroencephalography (EEG) have shown that it is possible to identify the target speaker from single-trial EEG…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-03 Ali Aroudi , Tobias de Taillez , Simon Doclo

It is crucial for auditory attention decoding to classify matched and mismatched speech stimuli with corresponding EEG responses by exploring their relationship. However, existing methods often adopt two independent networks to encode…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-22 Shitong Fan , Wenbo Wang , Feiyang Xiao , Shiheng Zhang , Qiaoxi Zhu , Jian Guan

EEG-based brain-computer interfaces (BCIs) have shown promise in various applications, such as motor imagery and cognitive state monitoring. However, decoding visual representations from EEG signals remains a significant challenge due to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Tariq Mehmood , Hamza Ahmad , Muhammad Haroon Shakeel , Murtaza Taj

Although obtaining deep brain activity from non-invasive scalp electroencephalography (sEEG) is crucial for neuroscience and clinical diagnosis, directly generating high-fidelity intracranial electroencephalography (iEEG) signals remains a…

Neurons and Cognition · Quantitative Biology 2026-05-26 Dongyi He , Bin Jiang , Kecheng Feng , Luyin Zhang , Ling Liu , Yuxuan Li , Yun Zhao , He Yan

Reconstructing visual stimuli from non-invasive electroencephalography (EEG) remains challenging due to its low spatial resolution and high noise, particularly under realistic low-density electrode configurations. To address this, we…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Emanuele Balloni , Emanuele Frontoni , Chiara Matti , Marina Paolanti , Roberto Pierdicca , Emiliano Santarnecchi

Decoding speech from brain signals is a challenging research problem. Although existing technologies have made progress in reconstructing the mel spectrograms of auditory stimuli at the word or letter level, there remain core challenges in…

Sound · Computer Science 2025-08-12 Cunhang Fan , Sheng Zhang , Jingjing Zhang , Enrui Liu , Xinhui Li , Gangming Zhao , Zhao Lv

For real-world BCI applications, lightweight Electroencephalography (EEG) systems offer the best cost-deployment balance. However, such spatial sparsity of EEG limits spatial fidelity, hurting learning and introducing bias. EEG spatial…

Multimedia · Computer Science 2026-02-24 Hongjun Liu , Leyu Zhou , Zijianghao Yang , Chao Yao

Forecasting Electroncephalography (EEG) signals during cognitive events remains a fundamental challenge in neuroscience and Brain-Computer Interfaces (BCIs), as existing methods struggle to capture both the stochastic nature of neural…

Signal Processing · Electrical Eng. & Systems 2026-03-19 Mehran Shabanpour , Sadaf Khademi , Konstantinos N Plataniotis , Arash Mohammadi