English
Related papers

Related papers: Decoding Phone Pairs from MEG Signals Across Speec…

200 papers

Electroencephalography (EEG) is an invaluable tool in neuroscience, offering insights into brain activity with high temporal resolution. Recent advancements in machine learning and generative modeling have catalyzed the application of EEG…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yashvir Sabharwal , Balaji Rama

Surface electromyography (EMG) is a promising modality for silent speech interfaces, but its effectiveness depends heavily on sensor placement and channel availability. In this work, we investigate the contribution of individual and…

Sound · Computer Science 2026-02-09 Injune Hwang , Jaejun Lee , Kyogu Lee

Electroencephalography (EEG) signals are crucial for investigating brain function and cognitive processes. This study aims to address the challenges of efficiently recording and analyzing high-dimensional EEG signals while listening to…

Machine Learning · Computer Science 2024-08-23 Jingyi Wang , Zhiqun Wang , Guiran Liu

Listeners adapt language comprehension based on their mental representations of speakers, but how these representations are updated remains unclear. We investigated whether listeners probabilistically adapt comprehension based on the…

Neurons and Cognition · Quantitative Biology 2025-10-28 Hanlin Wu , Xiaohui Rao , Zhenguang G Cai

Can artificial intelligence unlock the secrets of the human brain? How do the inner mechanisms of deep learning models relate to our neural circuits? Is it possible to enhance AI by tapping into the power of brain recordings? These…

Neurons and Cognition · Quantitative Biology 2024-12-31 Subba Reddy Oota , Zijiao Chen , Manish Gupta , Raju S. Bapi , Gael Jobard , Frederic Alexandre , Xavier Hinaut

This study investigates the performance of classifiers across EEG frequency bands, evaluating efficient class prediction for the left and right hemispheres using various optimisers. Three neural network architectures a deep dense network, a…

Machine Learning · Computer Science 2026-04-02 Robiul Islam , Dmitry I. Ignatov , Karl Kaberg , Roman Nabatchikov

The Temporal Sampling Framework (TSF) theorizes that the characteristic phonological difficulties of dyslexia are caused by an atypical oscillatory sampling at one or more temporal rates. The LEEDUCA study conducted a series of…

Our ability to comprehend speech remains, to date, unrivaled by deep learning models. This feat could result from the brain's ability to fine-tune generic sound representations for speech-specific processes. To test this hypothesis, we…

Computation and Language · Computer Science 2021-03-02 Juliette Millet , Jean-Remi King

Brain-to-speech (BTS) systems represent a groundbreaking approach to human communication by enabling the direct transformation of neural activity into linguistic expressions. While recent non-invasive BTS studies have largely focused on…

Human-Computer Interaction · Computer Science 2025-11-03 Deok-Seon Kim , Seo-Hyun Lee , Kang Yin , Seong-Whan Lee

We present a model for predicting articulatory features from surface electromyography (EMG) signals during speech production. The proposed model integrates convolutional layers and a Transformer block, followed by separate predictors for…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-30 Jihwan Lee , Kevin Huang , Kleanthis Avramidis , Simon Pistrosch , Monica Gonzalez-Machorro , Yoonjeong Lee , Björn Schuller , Louis Goldstein , Shrikanth Narayanan

Electroencephalography (EEG) is a tool that allows us to analyze brain activity with high temporal resolution. These measures, combined with deep learning and digital signal processing, are widely used in neurological disorder detection and…

Signal Processing · Electrical Eng. & Systems 2024-11-20 Isaac Ariza , Lorenzo J. Tardon , Ana M. Barbancho , Irene De-Torres , Isabel Barbancho

Electroencephalography (EEG)-based P300 brain-computer interfaces (BCIs) enable communication without physical movement by detecting stimulus-evoked neural responses. Accurate and efficient decoding remains challenging due to high…

Methodology · Statistics 2026-03-02 Guoxuan Ma , Yuan Zhong , Moyan Li , Yuxiao Nie , Jian Kang

Studies in recent years have demonstrated that neural organization and structure impact an individual's ability to perform a given task. Specifically, individuals with greater neural efficiency have been shown to outperform those with less…

Automatic speech transcription and speaker recognition are usually treated as separate tasks even though they are interdependent. In this study, we investigate training a single network to perform both tasks jointly. We train the network in…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-21 Siddharth Sigtia , Erik Marchi , Sachin Kajarekar , Devang Naik , John Bridle

This work focuses on inner speech recognition starting from EEG signals. Inner speech recognition is defined as the internalized process in which the person thinks in pure meanings, generally associated with an auditory imagery of own inner…

Human-Computer Interaction · Computer Science 2023-10-26 Francesca Gasparini , Elisa Cazzaniga , Aurora Saibene

Kinematics decoding from brain activity helps in developing rehabilitation or power-augmenting brain-computer interface devices. Low-frequency signals recorded from non-invasive electroencephalography (EEG) are associated with the neural…

Signal Processing · Electrical Eng. & Systems 2022-08-30 Anant Jain , Lalan Kumar

Many voice disorders induce subharmonic phonation, but voice signal analysis is currently lacking a technique to detect the presence of subharmonics reliably. Distinguishing subharmonic phonation from normal phonation is a challenging task…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-17 Takeshi Ikuma , Melda Kunduk , Brad Story , Andrew J. McWhorter

Human language processing relies on the brain's capacity for predictive inference. We present a machine learning framework for decoding neural (EEG) responses to dynamic visual language stimuli in Deaf signers. Using coherence between…

Neurons and Cognition · Quantitative Biology 2025-12-25 Sean C. Borneman , Julia Krebs , Ronnie B. Wilbur , Evie A. Malaia

There are a variety of features of the human voice that can be classified as pitch, timbre, loudness, and vocal tone. It is observed in numerous incidents that human expresses their feelings using different vocal qualities when they are…

The recent emergence of machine-learning based generative models for speech suggests a significant reduction in bit rate for speech codecs is possible. However, the performance of generative models deteriorates significantly with the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-22 W. Bastiaan Kleijn , Andrew Storus , Michael Chinen , Tom Denton , Felicia S. C. Lim , Alejandro Luebs , Jan Skoglund , Hengchin Yeh