English
Related papers

Related papers: Brain2Char: A Deep Architecture for Decoding Text …

200 papers

Brain-to-speech (BTS) systems represent a groundbreaking approach to human communication by enabling the direct transformation of neural activity into linguistic expressions. While recent non-invasive BTS studies have largely focused on…

Human-Computer Interaction · Computer Science 2025-11-03 Deok-Seon Kim , Seo-Hyun Lee , Kang Yin , Seong-Whan Lee

A Brain-Computer Interface (BCI) acquires brain signals, analyzes and translates them into commands that are relayed to actuation devices for carrying out desired actions. With the widespread connectivity of everyday devices realized by the…

Human-Computer Interaction · Computer Science 2018-10-24 Xiang Zhang , Lina Yao , Shuai Zhang , Salil S. Kanhere , Quan Z. Sheng , Yunhao Liu

Brain-to-speech technology represents a fusion of interdisciplinary applications encompassing fields of artificial intelligence, brain-computer interfaces, and speech synthesis. Neural representation learning based intention decoding and…

Artificial Intelligence · Computer Science 2024-02-28 Seo-Hyun Lee , Young-Eun Lee , Soowon Kim , Byung-Kwan Ko , Jun-Young Kim , Seong-Whan Lee

In the coming decade, artificial intelligence systems will continue to improve and revolutionise every industry and facet of human life. Designing effective, seamless and symbiotic communication paradigms between humans and AI agents is…

Human-Computer Interaction · Computer Science 2024-08-13 Suyi Zhang , Ekram Alam , Jack Baber , Francesca Bianco , Edward Turner , Maysam Chamanzar , Hamid Dehghani

In this study, we illustrate the progress of BCI research and present scores of unveiled contemporary approaches. First, we explore a decoding natural speech approach that is designed to decode human speech directly from the human brain…

Signal Processing · Electrical Eng. & Systems 2022-07-15 Md Jobair Hossain Faruk , Maria Valero , Hossain Shahriar

We propose a mixed deep neural network strategy, incorporating parallel combination of Convolutional (CNN) and Recurrent Neural Networks (RNN), cascaded with deep autoencoders and fully connected layers towards automatic identification of…

Machine Learning · Computer Science 2019-04-10 Pramit Saha , Sidney Fels

Understanding the neural mechanisms behind auditory and linguistic processing is key to advancing cognitive neuroscience. In this study, we use Magnetoencephalography (MEG) data to analyze brain responses to spoken language stimuli. We…

Neurons and Cognition · Quantitative Biology 2025-01-08 Matteo Ciferri , Matteo Ferrante , Nicola Toschi

Brain computer interface (BCI) research, as well as increasing portions of the field of neuroscience, have found success deploying large-scale artificial intelligence (AI) pre-training methods in conjunction with vast public repositories of…

Neurons and Cognition · Quantitative Biology 2025-06-03 Mattson Ogg , Rahul Hingorani , Diego Luna , Griffin W. Milsap , William G. Coon , Clara A. Scholl

Byte-pair encoding (BPE) is a ubiquitous algorithm in the subword tokenization process of language models as it provides multiple benefits. However, this process is solely based on pre-training data statistics, making it hard for the…

Computation and Language · Computer Science 2021-09-27 Gustavo Aguilar , Bryan McCann , Tong Niu , Nazneen Rajani , Nitish Keskar , Thamar Solorio

Decoding continuous speech from intracortical recordings is a central challenge for brain-computer interfaces (BCIs), with transformative potential for individuals with conditions that impair their ability to speak. While recent…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-17 Tommaso Boccato , Michal Olak , Matteo Ferrante

High-quality speech corpora are essential foundations for most speech applications. However, such speech data are expensive and limited since they are collected in professional recording environments. In this work, we propose an…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-11 Haoyu Li , Yang Ai , Junichi Yamagishi

Deep learning techniques have revolutionized the field of machine learning and were recently successfully applied to various classification problems in noninvasive electroencephalography (EEG). However, these methods were so far only rarely…

Electroencephalography (EEG)-based P300 brain-computer interfaces (BCIs) enable communication without physical movement by detecting stimulus-evoked neural responses. Accurate and efficient decoding remains challenging due to high…

Methodology · Statistics 2026-03-02 Guoxuan Ma , Yuan Zhong , Moyan Li , Yuxiao Nie , Jian Kang

Brain-computer interfaces (BCIs) have shown promise in enabling communication for individuals with motor impairments. Recent advancements like brain-to-speech technology aim to reconstruct speech from neural activity. However, decoding…

Artificial Intelligence · Computer Science 2024-12-02 Seo-Hyun Lee , Ji-Ha Park , Deok-Seon Kim

Recent work has demonstrated that complex visual stimuli can be decoded from human brain activity using deep generative models, offering new ways to probe how the brain represents real-world scenes. However, many existing approaches first…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Pinyuan Feng , Hossein Adeli , Wenxuan Guo , Fan Cheng , Ethan Hwang , Nikolaus Kriegeskorte

Most neuroimaging experiments are under-powered, limited by the number of subjects and cognitive processes that an individual study can investigate. Nonetheless, over decades of research, neuroscience has accumulated an extensive wealth of…

Neurons and Cognition · Quantitative Biology 2021-09-29 Gia H. Ngo , Minh Nguyen , Nancy F. Chen , Mert R. Sabuncu

We propose a novel recurrent encoder-decoder network model for real-time video-based face alignment. Our proposed model predicts 2D facial point maps regularized by a regression loss, while uniquely exploiting recurrent learning at both…

Computer Vision and Pattern Recognition · Computer Science 2016-08-24 Xi Peng , Rogerio S. Feris , Xiaoyu Wang , Dimitris N. Metaxas

Word vector representations enable machines to encode human language for spoken language understanding and processing. Confusion2vec, motivated from human speech production and perception, is a word vector representation which encodes…

Computation and Language · Computer Science 2022-05-04 Prashanth Gurunath Shivakumar , Panayiotis Georgiou , Shrikanth Narayanan

Brain-computer interfaces (BCIs) enable direct communication between the brain and external devices, providing critical support for individuals with motor impairments. However, accurate motor imagery (MI) decoding from…

Machine Learning · Computer Science 2026-04-08 Panagiotis Andrikopoulos , Siamak Mehrkanoon

Decoding brain signals has gained many attention and has found much applications in recent years such as Brain Computer Interfaces, communicating with controlling external devices using the user's intentions, occupies an emerging field with…

Signal Processing · Electrical Eng. & Systems 2020-06-26 Mirfarid Musavian Ghazani , Anh Huy Phan