English
Related papers

Related papers: SENSE: Efficient EEG-to-Text via Privacy-Preservin…

200 papers

EEG-based brain-computer interfaces (BCIs) have shown promise in various applications, such as motor imagery and cognitive state monitoring. However, decoding visual representations from EEG signals remains a significant challenge due to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Tariq Mehmood , Hamza Ahmad , Muhammad Haroon Shakeel , Murtaza Taj

Understanding semantic content from brain activity during sleep represents a major goal in neuroscience. While studies in rodents have shown spontaneous neural reactivation of memories during sleep, capturing the semantic content of human…

Machine Learning · Computer Science 2024-05-21 Hui Zheng , Zhong-Tao Chen , Hai-Teng Wang , Jian-Yang Zhou , Lin Zheng , Pei-Yang Lin , Yun-Zhe Liu

An asynchronous Brain--Computer Interface (BCI) based on imagined speech is a tool that allows to control an external device or to emit a message at the moment the user desires to by decoding EEG signals of imagined speech. In order to…

Human-Computer Interaction · Computer Science 2021-05-11 Tonatiuh Hernández-Del-Toro , Carlos A. Reyes-García , Luis Villaseñor-Pineda

Brain Computer Interface (BCI) can help patients of neuromuscular diseases restore parts of the movement and communication abilities that they have lost. Most of BCIs rely on mapping brain activities to device instructions, but limited…

Human-Computer Interaction · Computer Science 2017-05-23 Kang Wang , Xueqian Wang , Gang Li

The aim of the study is to investigate the complex mechanisms of speech perception and ultimately decode the electrical changes in the brain accruing while listening to speech. We attempt to decode heard speech from intracranial…

Human-Computer Interaction · Computer Science 2025-01-28 Milán András Fodor , Tamás Gábor Csapó , Frigyes Viktor Arthur

Brain-computer interface (BCI) speech decoding has emerged as a promising tool for assisting individuals with speech impairments. In this context, the integration of electroencephalography (EEG) and electromyography (EMG) signals offers…

Sound · Computer Science 2025-11-17 Yifan Zhuang , Calvin Huang , Zepeng Yu , Yongjie Zou , Jiawei Ju

Silent speech decoding, which performs unvocalized human speech recognition from electroencephalography/electromyography (EEG/EMG), increases accessibility for speech-impaired humans. However, data collection is difficult and performed…

Quantitative Methods · Quantitative Biology 2025-06-18 Masakazu Inoue , Motoshige Sato , Kenichi Tomeoka , Nathania Nah , Eri Hatakeyama , Kai Arulkumaran , Ilya Horiguchi , Shuntaro Sasai

Semantic communication (SC) aims to communicate reliably with minimal data transfer while simultaneously providing seamless connectivity to heterogeneous services and users. In this paper, a novel emergent SC (ESC) system framework is…

Machine Learning · Computer Science 2023-11-09 Christo Kurisummoottil Thomas , Walid Saad

Decoding sensory experiences from neural activity to reconstruct human-perceived visual stimuli and semantic content remains a challenge in neuroscience and artificial intelligence. Despite notable progress in current brain decoding models,…

Neurons and Cognition · Quantitative Biology 2025-10-13 Feihan Feng , Jingxin Nie

This thesis delves into the world of non-invasive electrophysiological brain signals like electroencephalography (EEG) and magnetoencephalography (MEG), focusing on modelling and decoding such data. The research aims to investigate what…

Signal Processing · Electrical Eng. & Systems 2025-10-30 Richard Csaky

Information Retrieval (IR) systems primarily rely on users' ability to translate their internal information needs into (text) queries. However, this translation process is often uncertain and cognitively demanding, leading to queries that…

Information Retrieval · Computer Science 2025-05-14 Niall McGuire , Yashar Moshfeghi

Decoding language from brain dynamics is an important open direction in the realm of brain-computer interface (BCI), especially considering the rapid growth of large language models. Compared to invasive-based signals which require…

Computation and Language · Computer Science 2024-06-04 Yiqian Yang , Yiqun Duan , Qiang Zhang , Hyejeong Jo , Jinni Zhou , Won Hee Lee , Renjing Xu , Hui Xiong

Silent speech interfaces (SSI) has been an exciting area of recent interest. In this paper, we present a non-invasive silent speech interface that uses inaudible acoustic signals to capture people's lip movements when they speak. We exploit…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-24 Jian Luo , Jianzong Wang , Ning Cheng , Guilin Jiang , Jing Xiao

Semantic communication (SemCom) significantly improves inter-vehicle interactions in intelligent connected vehicles (ICVs) within limited wireless spectrum. However, the open nature of wireless communications introduces eavesdropping risks.…

Cryptography and Security · Computer Science 2025-02-25 Bizhu Wang , Zhiqiang Bian , Yue Chen , Xiaodong Xu , Chen Sun , Wenqi Zhang , Ping Zhang

Brain-to-speech (BTS) systems represent a groundbreaking approach to human communication by enabling the direct transformation of neural activity into linguistic expressions. While recent non-invasive BTS studies have largely focused on…

Human-Computer Interaction · Computer Science 2025-11-03 Deok-Seon Kim , Seo-Hyun Lee , Kang Yin , Seong-Whan Lee

Electroencephalogram (EEG) signals have emerged as a promising modality for biometric identification. While previous studies have explored the use of imagined speech with semantically meaningful words for subject identification, most have…

Machine Learning · Computer Science 2026-01-29 Ali Derakhshesh , Zahra Dehghanian , Reza Ebrahimpour , Hamid R. Rabiee

We consider a semantic communication system for speech signals, named DeepSC-S. Motivated by the breakthroughs in deep learning (DL), we make an effort to recover the transmitted speech signals in the semantic communication systems, which…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-09 Zhenzi Weng , Zhijin Qin , Geoffrey Ye Li

Brain decoding is a field of computational neuroscience that uses measurable brain activity to infer mental states or internal representations of perceptual inputs. Therefore, we propose a novel approach to brain decoding that also relies…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Matteo Ferrante , Tommaso Boccato , Nicola Toschi

Brain-computer interfaces (BCIs) often suffer from limited robustness and poor long-term adaptability. Model performance rapidly degrades when user attention fluctuates, brain states shift over time, or irregular artifacts appear during…

Signal Processing · Electrical Eng. & Systems 2025-11-12 Yeon-Woo Choi , Hye-Bin Shin , Dan Li

We explore whether neural networks can decode brain activity into speech by mapping EEG recordings to audio representations. Using EEG data recorded as subjects listened to natural speech, we train a model with a contrastive CLIP loss to…

Sound · Computer Science 2025-11-10 Quentin Auster , Kateryna Shapovalenko , Chuang Ma , Demaio Sun