English
Related papers

Related papers: Decoding EEG Speech Perception with Transformers a…

200 papers

The electrocardiogram (ECG) is an inexpensive and widely available tool for cardiovascular assessment. Despite its standardized format and small file size, the high complexity and inter-individual variability of ECG signals (typically a…

Machine Learning · Computer Science 2024-10-31 Christopher J. Harvey , Sumaiya Shomaji , Zijun Yao , Amit Noheria

Electroencephalogram (EEG) classification has been widely used in various medical and engineering applications, where it is important for understanding brain function, diagnosing diseases, and assessing mental health conditions. However,…

Signal Processing · Electrical Eng. & Systems 2024-08-20 Mingzhi Chen , Yiyu Gui , Yuqi Su , Yuesheng Zhu , Guibo Luo , Yuchao Yang

Previous research has demonstrated the potential of using pre-trained language models for decoding open vocabulary Electroencephalography (EEG) signals captured through a non-invasive Brain-Computer Interface (BCI). However, the impact of…

Signal Processing · Electrical Eng. & Systems 2024-08-13 Hamza Amrani , Daniela Micucci , Paolo Napoletano

For many Automatic Speech Recognition (ASR) tasks audio features as spectrograms show better results than Mel-frequency Cepstral Coefficients (MFCC), but in practice they are hard to use due to a complex dimensionality of a feature space.…

Sound · Computer Science 2024-10-07 Olga Iakovenko , Ivan Bondarenko

Deep learning based neural decoding from stereotactic electroencephalography (sEEG) would likely benefit from scaling up both dataset and model size. To achieve this, combining data across multiple subjects is crucial. However, in sEEG…

Self-supervised learning has been a powerful training paradigm to facilitate representation learning. In this study, we design a masked autoencoder (MAE) to guide deep learning models to learn electroencephalography (EEG) signal…

Human-Computer Interaction · Computer Science 2024-09-04 Yifei Zhou , Sitong Liu

Reconstructing 3D visual stimuli from Electroencephalography (EEG) data holds significant potential for applications in Brain-Computer Interfaces (BCIs) and aiding individuals with communication disorders. Traditionally, efforts have…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Yuxiang Ge , Jionghao Cheng , Ruiquan Ge , Zhaojie Fang , Gangyong Jia , Xiang Wan , Nannan Li , Ahmed Elazab , Changmiao Wang

Many people with hearing loss struggle to comprehend speech in crowded auditory scenes, even when they are using hearing aids. It has recently been demonstrated that the focus of a listener's selective attention to speech can be decoded…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-18 Mike Thornton , Danilo Mandic , Tobias Reichenbach

Decoding natural language from brain activity using non-invasive electroencephalography (EEG) remains a significant challenge in neuroscience and machine learning, particularly for open-vocabulary scenarios where traditional methods…

Machine Learning · Computer Science 2025-06-19 Mohamed Masry , Mohamed Amen , Mohamed Elzyat , Mohamed Hamed , Norhan Magdy , Maram Khaled

Machine learning techniques have enabled researchers to leverage neuroimaging data to decode speech from brain activity, with some amazing recent successes achieved by applications built using invasive devices. However, research requiring…

Machine Learning · Computer Science 2024-10-29 Jeremiah Ridge , Oiwi Parker Jones

Variational auto-encoder (VAE) is an effective neural network architecture to disentangle a speech utterance into speaker identity and linguistic content latent embeddings, then generate an utterance for a target speaker from that of a…

Sound · Computer Science 2022-08-23 Ziang Long , Yunling Zheng , Meng Yu , Jack Xin

Electroencephalogram (EEG) decoding aims to identify the perceptual, semantic, and cognitive content of neural processing based on non-invasively measured brain activity. Traditional EEG decoding methods have achieved moderate success when…

Signal Processing · Electrical Eng. & Systems 2022-03-09 Xun Chen , Chang Li , Aiping Liu , Martin J. McKeown , Ruobing Qian , Z. Jane Wang

Automatic recognition of disordered speech remains a highly challenging task to date. The underlying neuro-motor conditions, often compounded with co-occurring physical disabilities, lead to the difficulty in collecting large quantities of…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-21 Zengrui Jin , Xurong Xie , Mengzhe Geng , Tianzi Wang , Shujie Hu , Jiajun Deng , Guinan Li , Xunying Liu

Electroencephalogram (EEG) signals have become a popular medium for decoding visual information due to their cost-effectiveness and high temporal resolution. However, current approaches face significant challenges in bridging the modality…

Machine Learning · Computer Science 2026-03-10 Sicheng Dai , Hongwang Xiao , Shan Yu , Qiwei Ye

Electroencephalography (EEG) is an invaluable tool in neuroscience, offering insights into brain activity with high temporal resolution. Recent advancements in machine learning and generative modeling have catalyzed the application of EEG…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yashvir Sabharwal , Balaji Rama

Electroencephalografic (EEG) data are complex multi-dimensional time-series that are very useful in many applications, from diagnostics to driving brain-computer interface systems. Their classification is still a challenging task, due to…

Signal Processing · Electrical Eng. & Systems 2024-07-30 Alberto Zancanaro , Giulia Cisotto , Italo Zoppis , Sara Lucia Manzoni

Speech Neuroprostheses have the potential to enable communication for people with dysarthria or anarthria. Recent advances have demonstrated high-quality text decoding and speech synthesis from electrocorticographic grids placed on the…

Decoding EEG signals is crucial for unraveling human brain and advancing brain-computer interfaces. Traditional machine learning algorithms have been hindered by the high noise levels and inherent inter-person variations in EEG signals.…

Signal Processing · Electrical Eng. & Systems 2024-03-26 Pengfei Sun , Jorg De Winne , Paul Devos , Dick Botteldooren

Electroencephalography (EEG) decoding is a challenging task due to the limited availability of labelled data. While transfer learning is a promising technique to address this challenge, it assumes that transferable data domains and task are…

Signal Processing · Electrical Eng. & Systems 2023-08-07 Bruno Aristimunha , Raphael Y. de Camargo , Walter H. Lopez Pinaya , Sylvain Chevallier , Alexandre Gramfort , Cedric Rommel

Recent research has delved into speech enhancement (SE) approaches that leverage audio embeddings from pre-trained models, diverging from time-frequency masking or signal prediction techniques. This paper introduces an efficient and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-16 Xingwei Sun , Heinrich Dinkel , Yadong Niu , Linzhang Wang , Junbo Zhang , Jian Luan