English
Related papers

Related papers: Relating EEG to continuous speech using deep neura…

200 papers

Thanks to advancements in deep learning, speech generation systems now power a variety of real-world applications, such as text-to-speech for individuals with speech disorders, voice chatbots in call centers, cross-linguistic speech…

Accurate epileptic seizure prediction from electroencephalography (EEG) remains challenging because pre-ictal dynamics may span long time horizons while clinically relevant signatures can be subtle and transient. Many deep learning models…

Machine Learning · Computer Science 2026-01-21 Tien-Dat Pham , Xuan-The Tran

Single-channel electroencephalogram (EEG) is a cost-effective, comfortable, and non-invasive method for monitoring brain activity, widely adopted by researchers, consumers, and clinicians. The increasing number and proportion of articles on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Yueyang Li , Weiming Zeng , Wenhao Dong , Di Han , Lei Chen , Hongyu Chen , Zijian Kang , Shengyu Gong , Hongjie Yan , Wai Ting Siok , Nizhuan Wang

In this paper we explore predicting facial or lip video features from electroencephalography (EEG) features and predicting EEG features from recorded facial or lip video frames using deep learning models. The subjects were asked to read out…

Computer Vision and Pattern Recognition · Computer Science 2020-05-25 Gautam Krishna , Co Tran , Mason Carnahan , Ahmed Tewfik

Can artificial intelligence unlock the secrets of the human brain? How do the inner mechanisms of deep learning models relate to our neural circuits? Is it possible to enhance AI by tapping into the power of brain recordings? These…

Neurons and Cognition · Quantitative Biology 2024-12-31 Subba Reddy Oota , Zijiao Chen , Manish Gupta , Raju S. Bapi , Gael Jobard , Frederic Alexandre , Xavier Hinaut

We explore whether neural networks can decode brain activity into speech by mapping EEG recordings to audio representations. Using EEG data recorded as subjects listened to natural speech, we train a model with a contrastive CLIP loss to…

Sound · Computer Science 2025-11-10 Quentin Auster , Kateryna Shapovalenko , Chuang Ma , Demaio Sun

Cognitively inspired NLP leverages human-derived data to teach machines about language processing mechanisms. Recently, neural networks have been augmented with behavioral data to solve a range of NLP tasks spanning syntax and semantics. We…

Computation and Language · Computer Science 2020-10-06 Lukas Muttenthaler , Nora Hollenstein , Maria Barrett

Understanding the correlation between EEG features and cognitive tasks is crucial for elucidating brain function. Brain activity synchronizes during speaking and listening tasks. However, it is challenging to estimate task-dependent brain…

Neurons and Cognition · Quantitative Biology 2024-10-01 Dai Shimizu , Ko Watanabe , Andreas Dengel

Speech Neuroprostheses have the potential to enable communication for people with dysarthria or anarthria. Recent advances have demonstrated high-quality text decoding and speech synthesis from electrocorticographic grids placed on the…

Inferring patterns of synchronous brain activity from a heterogeneous sample of electroencephalograms (EEG) is scientifically and methodologically challenging. While it is intuitively and statistically appealing to rely on readings from…

Deep learning methods for person identification based on electroencephalographic (EEG) brain activity encounters the problem of exploiting the temporally correlated structures or recording session specific variability within EEG.…

Machine Learning · Computer Science 2019-03-29 Ozan Ozdenizci , Ye Wang , Toshiaki Koike-Akino , Deniz Erdogmus

Building on the deep learning based acoustic echo cancellation (AEC) in the single-loudspeaker (single-channel) and single-microphone setup, this paper investigates multi-channel AEC (MCAEC) and multi-microphone AEC (MMAEC). We train a deep…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-04 Hao Zhang , DeLiang Wang

The variability in EEG signals between different individuals poses a significant challenge when implementing brain-computer interfaces (BCI). Commonly proposed solutions to this problem include deep learning models, due to their increased…

Signal Processing · Electrical Eng. & Systems 2023-12-01 Stylianos Bakas , Siegfried Ludwig , Dimitrios A. Adamos , Nikolaos Laskaris , Yannis Panagakis , Stefanos Zafeiriou

Electroencephalography (EEG) is a neuroimaging technique that records brain neural activity with high temporal resolution. Unlike other methods, EEG does not require prohibitively expensive equipment and can be easily set up using…

Human-Computer Interaction · Computer Science 2024-10-01 Arash Akbarinia

Electroencephalography (EEG) is a useful way to implicitly monitor the users perceptual state during multimedia consumption. One of the primary challenges for the practical use of EEG-based monitoring is to achieve a satisfactory level of…

Machine Learning · Computer Science 2021-12-07 Soobeom Jang , Seong-Eun Moon , Jong-Seok Lee

High-resolution neural datasets enable foundation models for the next generation of brain-computer interfaces and neurological treatments. The community requires rigorous benchmarks to discriminate between competing modeling approaches, yet…

Evaluation of quality of experience (QoE) based on electroencephalography (EEG) has received great attention due to its capability of real-time QoE monitoring of users. However, it still suffers from rather low recognition accuracy. In this…

Human-Computer Interaction · Computer Science 2018-09-13 Seong-Eun Moon , Soobeom Jang , Jong-Seok Lee

Electroencephalography (EEG) is a critical, non-invasive method to monitor electrical brain activity. EEGs can span anywhere from a couple seconds to multiple hours, posing a major hurdle for existing deep learning methods due to two major…

Artificial Intelligence · Computer Science 2026-05-28 Abhilash Durgam , Nyle Siddiqui , Jeffrey A. Chan-Santiago , Qiushi Fu , Elakkat D. Gireesh , Mubarak Shah

Modeling of music audio semantics has been previously tackled through learning of mappings from audio data to high-level tags or latent unsupervised spaces. The resulting semantic spaces are theoretically limited, either because the chosen…

Information Retrieval · Computer Science 2017-12-18 Francisco Raposo , David Martins de Matos , Ricardo Ribeiro , Suhua Tang , Yi Yu

Objective: The Electroencephalogram (EEG) is gaining popularity as a physiological measure for neuroergonomics in human factor studies because it is objective, less prone to bias, and capable of assessing the dynamics of cognitive states.…

Human-Computer Interaction · Computer Science 2023-05-16 Kuan-Jung Chiang , Steven Dong , Chung-Kuan Cheng , Tzyy-Ping Jung