English
Related papers

Related papers: SEE: Semantically Aligned EEG-to-Text Translation

200 papers

Electroencephalography (EEG) is a popular and effective tool for emotion recognition. However, the propagation mechanisms of EEG in the human brain and its intrinsic correlation with emotions are still obscure to researchers. This work…

Robotics · Computer Science 2022-09-26 Jiyao Liu , Hao Wu , Li Zhang , Yanxi Zhao

Decoding language from neural signals holds considerable theoretical and practical importance. Previous research has indicated the feasibility of decoding text or speech from invasive neural signals. However, when using non-invasive neural…

Human-Computer Interaction · Computer Science 2023-09-15 Bo Wang , Xiran Xu , Longxiang Zhang , Boda Xiao , Xihong Wu , Jing Chen

Brain-computer interface (BCI) research, while promising, has largely been confined to static and fixed environments, limiting real-world applicability. To move towards practical BCI, we introduce a real-time wireless imagined speech…

Artificial Intelligence · Computer Science 2025-11-12 Ji-Ha Park , Heon-Gyu Kwak , Gi-Hwan Shin , Yoo-In Jeon , Sun-Min Park , Ji-Yeon Hwang , Seong-Whan Lee

Understanding and decoding brain activity into visual representations is a fundamental challenge at the intersection of neuroscience and artificial intelligence. While EEG visual decoding has shown promise due to its non-invasive, and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Minxu Liu , Donghai Guan , Chuhang Zheng , Chunwei Tian , Jie Wen , Qi Zhu

Motor imagery electroencephalogram (EEG)-based brain-computer interfaces (BCIs) offer significant advantages for individuals with restricted limb mobility. However, challenges such as low signal-to-noise ratio and limited spatial resolution…

Human-Computer Interaction · Computer Science 2024-06-21 Xicheng Lou , Xinwei Li , Hongying Meng , Jun Hu , Meili Xu , Yue Zhao , Jiazhang Yang , Zhangyong Li

Electroencephalography (EEG) signals reflect activities on certain brain areas. Effective classification of time-varying EEG signals is still challenging. First, EEG signal processing and feature engineering are time-consuming and highly…

Human-Computer Interaction · Computer Science 2019-08-27 Xiang Zhang , Lina Yao , Xianzhi Wang , Wenjie Zhang , Shuai Zhang , Yunhao Liu

EEG-based neural decoding requires large-scale benchmark datasets. Paired brain-language data across speaking, listening, and reading modalities are essential for aligning neural activity with the semantic representation of large language…

Signal Processing · Electrical Eng. & Systems 2025-08-07 Sitong Chen , Beiqianyi Li , Cuilin He , Dongyang Li , Mingyang Wu , Xinke Shen , Song Wang , Xuetao Wei , Xindi Wang , Haiyan Wu , Quanying Liu

Recently, physiological data such as electroencephalography (EEG) signals have attracted significant attention in affective computing. In this context, the main goal is to design an automated model that can assess emotional states. Lately,…

Machine Learning · Computer Science 2023-07-07 Shadi Sartipi , Mastaneh Torkamani-Azar , Mujdat Cetin

This paper introduces a novel cross-physiology translation task: synthesizing sleep electroencephalography (EEG) from respiration signals. To address the significant complexity gap between the two modalities, we propose a…

Machine Learning · Computer Science 2026-02-03 Kaiwen Zha , Chao Li , Hao He , Peng Cao , Tianhong Li , Ali Mirzazadeh , Ellen Zhang , Jong Woo Lee , Yoon Kim , Dina Katabi

Emotion recognition using electroencephalogram (EEG) signals has broad potential across various domains. EEG signals have ability to capture rich spatial information related to brain activity, yet effectively modeling and utilizing these…

Human-Computer Interaction · Computer Science 2025-01-28 Yuzhe Zhang , Chengxi Xie , Huan Liu , Yuhan Shi , Dalin Zhang

Application of electroencephalography (EEG) in educational research has grown substantially, yet a comprehensive integration of methodological frameworks, educational constructs, computational methods, and research gaps remains limited.…

Neurons and Cognition · Quantitative Biology 2025-10-01 Adi Wijaya , Said Hasibuan , Wiga Maulana Baihaqi , Rizki Darmawan , Rifkie Primartha , Catur Supriyanto

Electroencephalography (EEG) is a non-invasive technique to measure and record brain electrical activity, widely used in various BCI and healthcare applications. Early EEG decoding methods rely on supervised learning, limited by specific…

Signal Processing · Electrical Eng. & Systems 2025-11-07 Jiquan Wang , Sha Zhao , Zhiling Luo , Yangxuan Zhou , Haiteng Jiang , Shijian Li , Tao Li , Gang Pan

Decoding natural language from non-invasive electroencephalography (EEG) remains fundamentally limited by low signal-to-noise ratio and restricted information bandwidth. This raises a fundamental question regarding whether sentence-level…

Computation and Language · Computer Science 2026-04-21 Xiaoli Yang , Huiyuan Tian , Yurui Li , Jianyu Zhang , Shijian Li , Gang Pan

Electroencephalogram (EEG)-to-text remains challenging due to high-dimensional noise, subject variability, and error accumulation in autoregressive decoding. We introduce DELTA, which pairs a Residual Vector Quantization (RVQ) EEG tokenizer…

Computation and Language · Computer Science 2025-12-01 Mingyu Jeon , Hyobin Kim

Zero-shot EEG-to-image retrieval aims to decode perceived visual content from electroencephalography (EEG) by aligning neural responses with pretrained visual representations, providing a promising route toward scalable visual neural…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Lin Jiang , Qingshan She , Jiale Xu , Haiqi Xu , Duanpo Wu , Zhenzhong Kuang

Conventional augmentative and alternative communication (AAC) systems and language-learning platforms often fail to adapt in real time to the user's cognitive and linguistic needs, especially in neurological conditions such as post-stroke…

Human-Computer Interaction · Computer Science 2025-08-01 Ismail Hossain , Mridul Banik

Decoding visual information from time-resolved brain recordings, such as EEG and MEG, plays a pivotal role in real-time brain-computer interfaces. However, existing approaches primarily focus on direct brain-image feature alignment and are…

Human-Computer Interaction · Computer Science 2025-11-12 Chengjian Xu , Yonghao Song , Zelin Liao , Haochuan Zhang , Qiong Wang , Qingqing Zheng

Electroencephalogram (EEG)-based brain-computer interfaces (BCIs) face significant deployment challenges due to inter-subject variability, signal non-stationarity, and computational constraints. While test-time adaptation (TTA) mitigates…

Human-Computer Interaction · Computer Science 2026-01-13 Siyang Li , Jiayi Ouyang , Zhenyao Cui , Ziwei Wang , Tianwang Jia , Feng Wan , Dongrui Wu

Recently, many efforts have been made to explore how the brain processes speech using electroencephalographic (EEG) signals, where deep learning-based approaches were shown to be applicable in this field. In order to decode speech signals…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-24 Qiushi Zhu , Xiaoying Zhao , Jie Zhang , Yu Gu , Chao Weng , Yuchen Hu

At present, people usually use some methods based on convolutional neural networks (CNNs) for Electroencephalograph (EEG) decoding. However, CNNs have limitations in perceiving global dependencies, which is not adequate for common EEG…

Signal Processing · Electrical Eng. & Systems 2021-06-23 Yonghao Song , Xueyu Jia , Lie Yang , Longhan Xie