English
Related papers

Related papers: A Penny for Your Thoughts: Decoding Speech from In…

200 papers

Neurophysiological time series recordings like the electroencephalogram (EEG) or local field potentials are obtained from multiple sensors. They can be decoded by machine learning models in order to estimate the ongoing brain state of a…

Signal Processing · Electrical Eng. & Systems 2023-04-14 Pierre Guetschel , Théodore Papadopoulo , Michael Tangermann

In this study, a novel open-source brain-computer interface (BCI) platform was developed to decode scalp electroencephalography (EEG) signals associated with sustained attention. The EEG signal collection was conducted using a wireless…

Signal Processing · Electrical Eng. & Systems 2024-05-08 Maryam Norouzi , Mohammad Zaeri Amirani , Yalda Shahriari , Reza Abiri

Electroencephalography (EEG) is widely researched for neural decoding in Brain Computer Interfaces (BCIs) as it is non-invasive, portable, and economical. However, EEG signals suffer from inter- and intra-subject variability, leading to…

Signal Processing · Electrical Eng. & Systems 2024-12-25 Taveena Lotey , Aman Verma , Partha Pratim Roy

EEG technology finds applications in several domains. Currently, most EEG systems require subjects to wear several electrodes on the scalp to be effective. However, several channels might include noisy information, redundant signals, induce…

Signal Processing · Electrical Eng. & Systems 2021-06-22 Michela C. Massi , Francesca Ieva

Speech encoding models use auditory representations to predict how the human brain responds to spoken language stimuli. Most performant encoding models linearly map the hidden states of artificial neural networks to brain data, but this…

Computation and Language · Computer Science 2025-02-14 Nishitha Vattikonda , Aditya R. Vaidya , Richard J. Antonello , Alexander G. Huth

Brain-Computer Interfaces (BCIs) can decode imagined speech from neural activity. However, these systems typically require extensive training sessions where participants imaginedly repeat words, leading to mental fatigue and difficulties…

Machine Learning · Computer Science 2025-02-07 Saravanakumar Duraisamy , Mateusz Dubiel , Maurice Rekrut , Luis A. Leiva

Brain decoding is a field of computational neuroscience that uses measurable brain activity to infer mental states or internal representations of perceptual inputs. Therefore, we propose a novel approach to brain decoding that also relies…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Matteo Ferrante , Tommaso Boccato , Nicola Toschi

During music listening, cortical activity encodes both acoustic and expectation-related information. Prior work has shown that ANN representations resemble cortical representations and can serve as supervisory signals for EEG recognition.…

Artificial Intelligence · Computer Science 2026-05-19 Shogo Noguchi , Taketo Akama , Tai Nakamura , Shun Minamikawa , Natalia Polouliakh

Decoding imagined speech from human brain signals is a challenging and important issue that may enable human communication via brain signals. While imagined speech can be the paradigm for silent communication via brain signals, it is always…

Human-Computer Interaction · Computer Science 2023-02-16 Seo-Hyun Lee , Young-Eun Lee , Soowon Kim , Byung-Kwan Ko , Seong-Whan Lee

Stimulus-evoked EEG data has a notoriously low signal-to-noise ratio and high inter-subject variability. We propose a novel paradigm for the self-supervised extraction of stimulus-related brain response data: a model is trained to extract…

Neurons and Cognition · Quantitative Biology 2024-05-15 Bernd Accou , Hugo Van hamme , Tom Francart

Human language processing relies on the brain's capacity for predictive inference. We present a machine learning framework for decoding neural (EEG) responses to dynamic visual language stimuli in Deaf signers. Using coherence between…

Neurons and Cognition · Quantitative Biology 2025-12-25 Sean C. Borneman , Julia Krebs , Ronnie B. Wilbur , Evie A. Malaia

Studies have shown that in noisy acoustic environments, providing binaural signals to the user of an assistive listening device may improve speech intelligibility and spatial awareness. This paper presents a binaural speech enhancement…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-11 Vikas Tokala , Eric Grinstein , Mike Brookes , Simon Doclo , Jesper Jensen , Patrick A. Naylor

In this study, we propose an ensemble learning framework for electroencephalogram-based overt speech classification, leveraging denoising diffusion probabilistic models with varying convolutional kernel sizes. The ensemble comprises three…

Sound · Computer Science 2024-11-15 Soowon Kim , Ha-Na Jo , Eunyeong Ko

It was shown in literature that speech representations extracted by self-supervised pre-trained models exhibit similarities with brain activations of human for speech perception and fine-tuning speech representation models on downstream…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-14 Hengyu Li , Kangdi Mei , Zhaoci Liu , Yang Ai , Liping Chen , Jie Zhang , Zhenhua Ling

A language is made up of an infinite/finite number of sentences, which in turn is composed of a number of words. The Electrocardiogram (ECG) is the most popular noninvasive medical tool for studying heart function and diagnosing various…

Signal Processing · Electrical Eng. & Systems 2024-07-17 Prapti Ganguly , Wazib Ansar , Amlan Chakrabarti

Non-invasive brain-computer interfaces that decode spoken commands from electroencephalogram must be both accurate and trustworthy. We present a confidence-aware decoding framework that couples deep ensembles of compact, speech-oriented…

Artificial Intelligence · Computer Science 2025-11-12 Soowon Kim , Byung-Kwan Ko , Seo-Hyun Lee

Self-supervised learning has emerged as a key approach for learning generic representations from speech data. Despite promising results in downstream tasks such as speech recognition, speaker verification, and emotion recognition, a…

Computation and Language · Computer Science 2024-08-01 Nakamasa Inoue , Shinta Otake , Takumi Hirose , Masanari Ohi , Rei Kawakami

How related are the representations learned by neural language models, translation models, and language tagging tasks? We answer this question by adapting an encoder-decoder transfer learning method from computer vision to investigate the…

Computation and Language · Computer Science 2025-12-11 Richard Antonello , Javier Turek , Vy Vo , Alexander Huth

Auditory attention decoding (AAD) is the process of identifying the attended speech in a multi-talker environment using brain signals, typically recorded through electroencephalography (EEG). Over the past decade, AAD has undergone…

Sound · Computer Science 2025-07-08 Nhan Duc Thanh Nguyen , Huy Phan , Simon Geirnaert , Kaare Mikkelsen , Preben Kidmose

Invasive brain-computer interfaces with Electrocorticography (ECoG) have shown promise for high-performance speech decoding in medical applications, but less damaging methods like intracranial stereo-electroencephalography (sEEG) remain…

Signal Processing · Electrical Eng. & Systems 2024-11-04 Hui Zheng , Hai-Teng Wang , Wei-Bang Jiang , Zhong-Tao Chen , Li He , Pei-Yang Lin , Peng-Hu Wei , Guo-Guang Zhao , Yun-Zhe Liu