English
Related papers

Related papers: Towards Decoding Brain Activity During Passive Lis…

200 papers

A fundamental challenge in neuroscience is to understand what structure in the world is represented in spatially distributed patterns of neural activity from multiple single-trial measurements. This is often accomplished by learning a…

Neural and Evolutionary Computing · Computer Science 2020-07-01 Jesse A. Livezey , Kristofer E. Bouchard , Edward F. Chang

In this review, we examine computational models that explore the role of neural oscillations in speech perception, spanning from early auditory processing to higher cognitive stages. We focus on models that use rhythmic brain activities,…

Neurons and Cognition · Quantitative Biology 2025-02-19 Olesia Dogonasheva , Denis Zakharov , Anne-Lise Giraud , Boris Gutkin

Decoding inner speech from the brain signal via hybridisation of fMRI and EEG data is explored to investigate the performance benefits over unimodal models. Two different bimodal fusion approaches are examined: concatenation of probability…

The decoding of continuously spoken speech from neuronal activity has the potential to become an important clinical solution for paralyzed patients. Deep Learning Brain Computer Interfaces (BCIs) have recently successfully mapped neuronal…

Machine Learning · Computer Science 2025-01-17 Tobias Fiedler , Leon Hermann , Florian Müller , Sarel Cohen , Peter Chin , Tobias Friedrich , Eilon Vaadia

Speech perception involves storing and integrating sequentially presented items. Recent work in cognitive neuroscience has identified temporal and contextual characteristics in humans' neural encoding of speech that may facilitate this…

Computation and Language · Computer Science 2024-05-15 Oli Danyi Liu , Hao Tang , Naomi Feldman , Sharon Goldwater

Brain-computer interfaces (BCIs) enable direct communication between the brain and external devices. This review highlights the core decoding algorithms that enable multimodal BCIs, including a dissection of the elements, a unified view of…

Human-Computer Interaction · Computer Science 2025-02-06 Siyang Li , Hongbin Wang , Xiaoqing Chen , Dongrui Wu

We explore whether neural networks can decode brain activity into speech by mapping EEG recordings to audio representations. Using EEG data recorded as subjects listened to natural speech, we train a model with a contrastive CLIP loss to…

Sound · Computer Science 2025-11-10 Quentin Auster , Kateryna Shapovalenko , Chuang Ma , Demaio Sun

This study introduces a pioneering approach in brain-computer interface (BCI) technology, featuring our novel concept of high-level visual imagery for non-invasive electroencephalography (EEG)-based communication. High-level visual imagery,…

Human-Computer Interaction · Computer Science 2025-11-03 Byoung-Hee Kwon , Minji Lee , Seong-Whan Lee

Recent advances in brain-computer interface (BCI) technology, particularly based on generative adversarial networks (GAN), have shown great promise for improving decoding performance for BCI. Within the realm of Brain-Computer Interfaces…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-01 Young-Eun Lee , Seo-Hyun Lee , Soowon Kim , Jung-Sun Lee , Deok-Seon Kim , Seong-Whan Lee

This chapter presents a quantum computing-based approach to study and harness neuronal correlates of mental activity for the development of Brain-Computer Interface (BCI) systems. It introduces the notion of a logic of the mind, where…

Emerging Technologies · Computer Science 2021-01-19 Eduardo Reck Miranda

We introduce a deep learning model for speech denoising, a long-standing challenge in audio analysis arising in numerous applications. Our approach is based on a key observation about human speech: there is often a short pause between each…

Sound · Computer Science 2020-10-26 Ruilin Xu , Rundi Wu , Yuko Ishiwaka , Carl Vondrick , Changxi Zheng

Decoding text, speech, or images from human neural signals holds promising potential both as neuroprosthesis for patients and as innovative communication tools for general users. Although neural signals contain various information on speech…

Neurons and Cognition · Quantitative Biology 2025-01-28 Ji-Ha Park , Seo-Hyun Lee , Soowon Kim , Seong-Whan Lee

Brain-computer interfaces (BCIs) with speech decoding from brain recordings have broad application potential in fields such as clinical rehabilitation and cognitive neuroscience. However, current decoding methods remain limited to…

Neurons and Cognition · Quantitative Biology 2025-06-05 Yi Guo , Yihang Dong , Michael Kwok-Po Ng , Shuqiang Wang

Brain-Computer Interface (BCI) is a powerful communication tool between users and systems, which enhances the capability of the human brain in communicating and interacting with the environment directly. Advances in neuroscience and…

Signal Processing · Electrical Eng. & Systems 2020-01-31 Xiaotong Gu , Zehong Cao , Alireza Jolfaei , Peng Xu , Dongrui Wu , Tzyy-Ping Jung , Chin-Teng Lin

This study introduces a pioneering approach in brain-computer interface (BCI) technology, featuring our novel concept of complex visual imagery for non-invasive electroencephalography (EEG)-based communication. Complex visual imagery, as…

Human-Computer Interaction · Computer Science 2025-11-20 Byoung-Hee Kwon

Decoding language from brain dynamics is an important open direction in the realm of brain-computer interface (BCI), especially considering the rapid growth of large language models. Compared to invasive-based signals which require…

Computation and Language · Computer Science 2024-06-04 Yiqian Yang , Yiqun Duan , Qiang Zhang , Hyejeong Jo , Jinni Zhou , Won Hee Lee , Renjing Xu , Hui Xiong

Decoding brain signals has gained many attention and has found much applications in recent years such as Brain Computer Interfaces, communicating with controlling external devices using the user's intentions, occupies an emerging field with…

Signal Processing · Electrical Eng. & Systems 2020-06-26 Mirfarid Musavian Ghazani , Anh Huy Phan

An asynchronous Brain--Computer Interface (BCI) based on imagined speech is a tool that allows to control an external device or to emit a message at the moment the user desires to by decoding EEG signals of imagined speech. In order to…

Human-Computer Interaction · Computer Science 2021-05-11 Tonatiuh Hernández-Del-Toro , Carlos A. Reyes-García , Luis Villaseñor-Pineda

Brain Computer Interface (BCI) technologies have the potential to improve the lives of millions of people around the world, whether through assistive technologies or clinical diagnostic tools. Despite advancements in the field, however, at…

Machine Learning · Computer Science 2023-01-31 Chad Mello , Troy Weingart , Ethan M. Rudd

Deciphering natural language from brain activity through non-invasive devices remains a formidable challenge. Previous non-invasive decoders either require multiple experiments with identical stimuli to pinpoint cortical regions and enhance…

Computation and Language · Computer Science 2024-03-20 Cenyuan Zhang , Xiaoqing Zheng , Ruicheng Yin , Shujie Geng , Jianhan Xu , Xuan Gao , Changze Lv , Zixuan Ling , Xuanjing Huang , Miao Cao , Jianfeng Feng