English
Related papers

Related papers: Relating EEG to continuous speech using deep neura…

200 papers

Relating speech to EEG holds considerable importance but is challenging. In this study, a deep convolutional network was employed to extract spatiotemporal features from EEG data. Self-supervised speech representation and contextual text…

Signal Processing · Electrical Eng. & Systems 2024-02-02 Bo Wang , Xiran Xu , Zechen Zhang , Haolin Zhu , YuJie Yan , Xihong Wu , Jing Chen

Brain activity translation into human language delivers the capability to revolutionize machine-human interaction while providing communication support to people with speech disability. Electronic decoding reaches a certain level of…

Signal Processing · Electrical Eng. & Systems 2025-02-26 Mostafa El Gedawy , Omnia Nabil , Omar Mamdouh , Mahmoud Nady , Nour Alhuda Adel , Ahmed Fares

Brain-computer interfaces (BCI) offer numerous human-centered application possibilities, particularly affecting people with neurological disorders. Text or speech decoding from brain activities is a relevant domain that could augment the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-10 Jihwan Lee , Tiantian Feng , Aditya Kommineni , Sudarsana Reddy Kadiri , Shrikanth Narayanan

Electroencephalography (EEG) foundation models hold significant promise for universal Brain-Computer Interfaces (BCIs). However, existing approaches often rely on end-to-end fine-tuning and exhibit limited efficacy under frozen-probing…

Machine Learning · Computer Science 2026-03-20 Jiquan Wang , Sha Zhao , Yangxuan Zhou , Yiming Kang , Shijian Li , Gang Pan

Identifying auditory attention by comparing auditory stimuli and corresponding brain responses, is known as auditory attention decoding (AAD). The majority of AAD algorithms utilize the so-called envelope entrainment mechanism, whereby…

Signal Processing · Electrical Eng. & Systems 2024-10-29 Nhan Duc Thanh Nguyen , Huy Phan , Kaare Mikkelsen , Preben Kidmose

Deep learning has achieved excellent performance in a wide range of domains, especially in speech recognition and computer vision. Relatively less work has been done for EEG, but there is still significant progress attained in the last…

Signal Processing · Electrical Eng. & Systems 2021-05-24 Shu Gong , Kaibo Xing , Andrzej Cichocki , Junhua Li

The recent rise of EEG-based end-to-end deep learning models presents a significant challenge in elucidating how these models process raw EEG signals and generate predictions in the frequency domain. This challenge limits the transparency…

Signal Processing · Electrical Eng. & Systems 2024-07-26 Hanqi Wang , Kun Yang , Jingyu Zhang , Tao Chen , Liang Song

This thesis delves into the world of non-invasive electrophysiological brain signals like electroencephalography (EEG) and magnetoencephalography (MEG), focusing on modelling and decoding such data. The research aims to investigate what…

Signal Processing · Electrical Eng. & Systems 2025-10-30 Richard Csaky

Electroencephalography (EEG) plays a vital role in detecting how brain responses to different stimulus. In this paper, we propose a novel Shallow-Deep Attention-based Network (SDANet) to classify the correct auditory stimulus evoking the…

Sound · Computer Science 2023-03-21 Fan Cui , Liyong Guo , Lang He , Jiyao Liu , ErCheng Pei , Yujun Wang , Dongmei Jiang

Electroencephalogram (EEG) decoding aims to identify the perceptual, semantic, and cognitive content of neural processing based on non-invasively measured brain activity. Traditional EEG decoding methods have achieved moderate success when…

Signal Processing · Electrical Eng. & Systems 2022-03-09 Xun Chen , Chang Li , Aiping Liu , Martin J. McKeown , Ruobing Qian , Z. Jane Wang

Interpreting EEG signals linked to spoken language presents a complex challenge, given the data's intricate temporal and spatial attributes, as well as the various noise factors. Denoising diffusion probabilistic models (DDPMs), which have…

Computation and Language · Computer Science 2023-11-15 Soowon Kim , Seo-Hyun Lee , Young-Eun Lee , Ji-Won Lee , Ji-Ha Park , Seong-Whan Lee

Deep neural networks are inherently opaque and challenging to interpret. Unlike hand-crafted feature-based models, we struggle to comprehend the concepts learned and how they interact within these models. This understanding is crucial not…

Computation and Language · Computer Science 2023-07-12 Shammur Absar Chowdhury , Nadir Durrani , Ahmed Ali

Unlike conventional data such as natural images, audio and speech, raw multi-channel Electroencephalogram (EEG) data are difficult to interpret. Modern deep neural networks have shown promising results in EEG studies, however finding robust…

Signal Processing · Electrical Eng. & Systems 2022-06-22 Nikesh Bajaj , Jesús Requena Carrión , Francesco Bellotti

Decoding speech from non-invasive brain signals, such as electroencephalography (EEG), has the potential to advance brain-computer interfaces (BCIs), with applications in silent communication and assistive technologies for individuals with…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-30 Terrance Yu-Hao Chen , Yulin Chen , Pontus Soederhaell , Sadrishya Agrawal , Kateryna Shapovalenko

The normalization of brain recordings from multiple subjects responding to the natural stimuli is one of the key challenges in auditory neuroscience. The objective of this normalization is to transform the brain data in such a way as to…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-12 Jaswanth Reddy Katthi , Sriram Ganapathy

A fundamental challenge in neuroscience is to understand what structure in the world is represented in spatially distributed patterns of neural activity from multiple single-trial measurements. This is often accomplished by learning a…

Neural and Evolutionary Computing · Computer Science 2020-07-01 Jesse A. Livezey , Kristofer E. Bouchard , Edward F. Chang

Electroencephalography (EEG), with its broad range of applications, necessitates models that can generalize effectively across various tasks and datasets. Large EEG Models (LEMs) address this by pretraining encoder-centric architectures on…

Machine Learning · Computer Science 2025-09-29 Chenyu Liu , Yuqiu Deng , Tianyu Liu , Jinan Zhou , Xinliang Zhou , Ziyu Jia , Yi Ding

In this study, we propose an ensemble learning framework for electroencephalogram-based overt speech classification, leveraging denoising diffusion probabilistic models with varying convolutional kernel sizes. The ensemble comprises three…

Sound · Computer Science 2024-11-15 Soowon Kim , Ha-Na Jo , Eunyeong Ko

The recent advances in the field of deep learning have not been fully utilised for decoding imagined speech primarily because of the unavailability of sufficient training samples to train a deep network. In this paper, we present a novel…

Signal Processing · Electrical Eng. & Systems 2020-03-23 Jerrin Thomas Panachakel , A. G. Ramakrishnan , T. V. Ananthapadmanabha

Existing approaches to modeling associations between visual stimuli and brain responses are facing difficulties in handling between-subject variance and model generalization. Inspired by the recent progress in modeling speech-brain…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Yiqian Yang , Zhengqiao Zhao , Qian Wang , Yan Yang , Jingdong Chen