中文
相关论文

相关论文: NeuSpeech: Decode Neural signal as Speech

200 篇论文

During speech perception, a listener's electroencephalogram (EEG) reflects acoustic-level processing as well as higher-level cognitive factors such as speech comprehension and attention. However, decoding speech from EEG recordings is…

音频与语音处理 · 电气工程与系统科学 2023-03-14 Mike Thornton , Danilo Mandic , Tobias Reichenbach

With the rapid advancement of large language models like Gemini, GPT, and others, bridging the gap between the human brain and language processing has become an important area of focus. To address this challenge, researchers have developed…

计算与语言 · 计算机科学 2025-12-10 Saydul Akbar Murad , Ashim Dahal , Nick Rahimi

Human language processing relies on the brain's capacity for predictive inference. We present a machine learning framework for decoding neural (EEG) responses to dynamic visual language stimuli in Deaf signers. Using coherence between…

神经元与认知 · 定量生物学 2025-12-25 Sean C. Borneman , Julia Krebs , Ronnie B. Wilbur , Evie A. Malaia

Brain-computer interfaces (BCIs) hold great potential for aiding individuals with speech impairments. Utilizing electroencephalography (EEG) to decode speech is particularly promising due to its non-invasive nature. However, recordings are…

神经元与认知 · 定量生物学 2024-07-11 Motoshige Sato , Kenichi Tomeoka , Ilya Horiguchi , Kai Arulkumaran , Ryota Kanai , Shuntaro Sasai

Decoding neurophysiological signals into language is of great research interest within brain-computer interface (BCI) applications. Electroencephalography (EEG), known for its non-invasiveness, ease of use, and cost-effectiveness, has been…

定量方法 · 定量生物学 2024-09-26 Yitian Tao , Yan Liang , Luoyu Wang , Yongqing Li , Qing Yang , Han Zhang

Brain-computer interfaces (BCI) offer numerous human-centered application possibilities, particularly affecting people with neurological disorders. Text or speech decoding from brain activities is a relevant domain that could augment the…

音频与语音处理 · 电气工程与系统科学 2025-01-10 Jihwan Lee , Tiantian Feng , Aditya Kommineni , Sudarsana Reddy Kadiri , Shrikanth Narayanan

Pretrained generative models have opened new frontiers in brain decoding by enabling the synthesis of realistic texts and images from non-invasive brain recordings. However, the reliability of such outputs remains questionable--whether they…

计算与语言 · 计算机科学 2025-05-26 Xiaozhao Liu , Dinggang Shen , Xihui Liu

Until recently, human behavioral data from reading has mainly been of interest to researchers to understand human cognition. However, these human language processing signals can also be beneficial in machine learning-based natural language…

计算与语言 · 计算机科学 2021-08-11 Nora Hollenstein , Cedric Renggli , Benjamin Glaus , Maria Barrett , Marius Troendle , Nicolas Langer , Ce Zhang

Decoding visual stimuli from neural recordings is a critical challenge in the development of brain-computer interfaces (BCIs). Although recent EEG-based decoding approaches have made progress in tasks such as visual classification,…

人机交互 · 计算机科学 2024-12-31 Dongyang Li , Haoyang Qin , Mingyang Wu , Jiahua Tang , Yuang Cao , Chen Wei , Quanying Liu

Decoding natural language from brain activity using non-invasive electroencephalography (EEG) remains a significant challenge in neuroscience and machine learning, particularly for open-vocabulary scenarios where traditional methods…

机器学习 · 计算机科学 2025-06-19 Mohamed Masry , Mohamed Amen , Mohamed Elzyat , Mohamed Hamed , Norhan Magdy , Maram Khaled

Reconstructing natural language from non-invasive electroencephalography (EEG) holds great promise as a language decoding technology for brain-computer interfaces (BCIs). However, EEG-based language decoding is still in its nascent stages,…

计算与语言 · 计算机科学 2024-09-27 Jiaqi Wang , Zhenxi Song , Zhengyu Ma , Xipeng Qiu , Min Zhang , Zhiguo Zhang

Brain-computer interface (BCI) is the technology that enables the communication between humans and devices by reflecting status and intentions of humans. When conducting imagined speech, the users imagine the pronunciation as if actually…

人机交互 · 计算机科学 2021-12-15 Dae-Hyeok Lee , Sung-Jin Kim , Keon-Woo Lee

Decoding visual experience from brain signals offers exciting possibilities for neuroscience and interpretable AI. While EEG is accessible and temporally precise, its limitations in spatial detail hinder image reconstruction. Our model…

计算机视觉与模式识别 · 计算机科学 2025-07-11 Arshak Rezvani , Ali Akbari , Kosar Sanjar Arani , Maryam Mirian , Emad Arasteh , Martin J. McKeown

Electroencephalography (EEG) decoding is a challenging task due to the limited availability of labelled data. While transfer learning is a promising technique to address this challenge, it assumes that transferable data domains and task are…

Deciphering natural language from brain activity through non-invasive devices remains a formidable challenge. Previous non-invasive decoders either require multiple experiments with identical stimuli to pinpoint cortical regions and enhance…

Neuroimaging techniques have shown to be useful when studying the brain's activity. This paper uses Magnetoencephalography (MEG) data, provided by the Human Connectome Project (HCP), in combination with various deep artificial neural…

机器学习 · 计算机科学 2020-07-07 Ismail Alaoui Abdellaoui , Jesus Garcia Fernandez , Caner Sahinli , Siamak Mehrkanoon

Handwriting imagery has emerged as a promising paradigm for brain-computer interfaces (BCIs) aimed at translating brain activity into text output. Compared with invasively recorded electroencephalography (EEG), non-invasive recording offers…

信号处理 · 电气工程与系统科学 2025-09-04 Hao Yang , Guang Ouyang

Current electroencephalogram (EEG) decoding models are typically trained on small numbers of subjects performing a single task. Here, we introduce a large-scale, code-submission-based competition comprising two challenges. First, the…

We present a novel approach to EEG decoding for non-invasive brain machine interfaces (BMIs), with a focus on motor-behavior classification. While conventional convolutional architectures such as EEGNet and DeepConvNet are effective in…

机器学习 · 计算机科学 2025-12-09 Tian Lan

Passive brain-computer interfaces offer a potential source of implicit feedback for alignment of large language models, but most mental state decoding has been done in controlled tasks. This paper investigates whether established EEG…

人机交互 · 计算机科学 2026-02-03 Lucija Mihić Zidar , Philipp Wicke , Praneel Bhatia , Rosa Lutz , Marius Klug , Thorsten O. Zander