English
Related papers

Related papers: Relating EEG to continuous speech using deep neura…

200 papers

The Guided Imagery technique is reported to be used by therapists all over the world in order to increase the comfort of patients suffering from a variety of disorders from mental to oncology ones and proved to be successful in numerous of…

Machine Learning · Computer Science 2024-05-29 Filip Postepski , Grzegorz M. Wojcik , Krzysztof Wrobel , Andrzej Kawiak , Katarzyna Zemla , Grzegorz Sedek

As deep learning has achieved state-of-the-art performance for many tasks of EEG-based BCI, many efforts have been made in recent years trying to understand what have been learned by the models. This is commonly done by generating a heatmap…

Neural and Evolutionary Computing · Computer Science 2023-08-21 Jian Cui , Liqiang Yuan , Zhaoxiang Wang , Ruilin Li , Tianzi Jiang

Covert speech involves imagining speaking without audible sound or any movements. Decoding covert speech from electroencephalogram (EEG) is challenging due to a limited understanding of neural pronunciation mapping and the low…

Audio Large Language Models (Audio LLMs) have demonstrated strong capabilities in integrating speech perception with language understanding. However, whether their internal representations align with human neural dynamics during…

Sound · Computer Science 2026-02-04 Haoyun Yang , Xin Xiao , Jiang Zhong , Yu Tian , Dong Xiaohua , Yu Mao , Hao Wu , Kaiwen Wei

In recent years, deep learning has witnessed its blossom in the field of Electrocardiography (ECG) processing, outperforming traditional signal processing methods in various tasks, for example, classification, QRS detection, wave…

Machine Learning · Computer Science 2022-04-12 Wen Hao , Kang Jingsu

Inner speech recognition has gained enormous interest in recent years due to its applications in rehabilitation, developing assistive technology, and cognitive assessment. However, since language and speech productions are a complex…

This paper proposes a novel approach that uses deep neural networks for classifying imagined speech, significantly increasing the classification accuracy. The proposed approach employs only the EEG channels over specific areas of the brain…

Neurons and Cognition · Quantitative Biology 2020-03-24 Jerrin Thomas Panachakel , A. G. Ramakrishnan , A. G. Ramakrishnan

This study examines the efficacy of various neural network (NN) models in interpreting mental constructs via electroencephalogram (EEG) signals. Through the assessment of 16 prevalent NN models and their variants across four brain-computer…

Neurons and Cognition · Quantitative Biology 2023-09-26 Xia Chen , Xiangbin Teng , Han Chen , Yafeng Pan , Philipp Geyer

This paper presents EffortNet, a novel deep learning framework for decoding individual listening effort from electroencephalography (EEG) during speech comprehension. Listening effort represents a significant challenge in speech-hearing…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-22 Ching-Chih Sung , Cheng-Hung Hsin , Yu-Anne Shiah , Bo-Jyun Lin , Yi-Xuan Lai , Chia-Ying Lee , Yu-Te Wang , Borchin Su , Yu Tsao

Deep learning and large public datasets have recently catalyzed the proliferation of AI models for processing brain recordings. However, systematically evaluating these models remains a challenge: not only do the preprocessing pipelines,…

Decoding the human brain has been a hallmark of neuroscientists and Artificial Intelligence researchers alike. Reconstruction of visual images from brain Electroencephalography (EEG) signals has garnered a lot of interest due to its…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Prajwal Singh , Dwip Dalal , Gautam Vashishtha , Krishna Miyapuram , Shanmuganathan Raman

The electroencephalography classifier is the most important component of brain-computer interface based systems. There are two major problems hindering the improvement of it. First, traditional methods do not fully exploit multimodal…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Chuanqi Tan , Fuchun Sun , Wenchang Zhang

The principal reason for measuring mental workload is to quantify the cognitive cost of performing tasks to predict human performance. Unfortunately, a method for assessing mental workload that has general applicability does not exist yet.…

Signal Processing · Electrical Eng. & Systems 2022-09-23 Luca Longo

Deep neural networks (DNNs) used for brain-computer-interface (BCI) classification are commonly expected to learn general features when trained across a variety of contexts, such that these features could be fine-tuned to specific contexts.…

Machine Learning · Computer Science 2021-01-29 Demetres Kostas , Stephane Aroca-Ouellette , Frank Rudzicz

Brain connectivity can be estimated through a wide number of analyses applied to electroencephalographic (EEG) data. However, substantial heterogeneity in the implementation of connectivity methods exist. Heterogeneity in conceptualization…

Neurons and Cognition · Quantitative Biology 2021-09-01 Aleksandra Miljevic , Neil W. Bailey , Fidel Vila-Rodriguez , Sally E. Herring , Paul B. Fitzgerald

We present an end-to-end deep network model that performs meeting diarization from single-channel audio recordings. End-to-end diarization models have the advantage of handling speaker overlap and enabling straightforward handling of…

Sound · Computer Science 2021-05-06 Soumi Maiti , Hakan Erdogan , Kevin Wilson , Scott Wisdom , Shinji Watanabe , John R. Hershey

Machine learning techniques have enabled researchers to leverage neuroimaging data to decode speech from brain activity, with some amazing recent successes achieved by applications built using invasive devices. However, research requiring…

Machine Learning · Computer Science 2024-10-29 Jeremiah Ridge , Oiwi Parker Jones

Decoding language from neural signals holds considerable theoretical and practical importance. Previous research has indicated the feasibility of decoding text or speech from invasive neural signals. However, when using non-invasive neural…

Human-Computer Interaction · Computer Science 2023-09-15 Bo Wang , Xiran Xu , Longxiang Zhang , Boda Xiao , Xihong Wu , Jing Chen

Speech language models (Speech LMs) enable end-to-end speech-text modeling within a single model, offering a promising direction for spoken dialogue systems. The choice of speech-text jointly decoding paradigm plays a critical role in…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-12 Haibin Wu , Yuxuan Hu , Ruchao Fan , Xiaofei Wang , Kenichi Kumatani , Bo Ren , Jianwei Yu , Heng Lu , Lijuan Wang , Yao Qian , Jinyu Li

The current electroencephalogram (EEG) based deep learning models are typically designed for specific datasets and applications in brain-computer interaction (BCI), limiting the scale of the models and thus diminishing their perceptual…

Machine Learning · Computer Science 2024-06-06 Wei-Bang Jiang , Li-Ming Zhao , Bao-Liang Lu