English
Related papers

Related papers: ETS: Open Vocabulary Electroencephalography-To-Tex…

200 papers

Electroencephalograph (EEG) is a crucial tool for studying brain activity. Recently, self-supervised learning methods leveraging large unlabeled datasets have emerged as a potential solution to the scarcity of widely available annotated EEG…

In the domain of cardiovascular healthcare, the Electrocardiogram (ECG) serves as a critical, non-invasive diagnostic tool. Although recent strides in self-supervised learning (SSL) have been promising for ECG representation learning, these…

Signal Processing · Electrical Eng. & Systems 2023-09-15 Che Liu , Zhongwei Wan , Sibo Cheng , Mi Zhang , Rossella Arcucci

Event-based semantic segmentation (ESS) is a fundamental yet challenging task for event camera sensing. The difficulties in interpreting and annotating event data limit its scalability. While domain adaptation from images to event data can…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Lingdong Kong , Youquan Liu , Lai Xing Ng , Benoit R. Cottereau , Wei Tsang Ooi

Emotional Support Conversation (ESC) is a typical dialogue that can effectively assist the user in mitigating emotional pressures. However, owing to the inherent subjectivity involved in analyzing emotions, current non-artificial…

Computation and Language · Computer Science 2024-08-05 Huaiwen Zhang , Yu Chen , Ming Wang , Shi Feng

Emotion recognition in conversation (ERC) has emerged as a research hotspot in domains such as conversational robots and question-answer systems. How to efficiently and adequately retrieve contextual emotional cues has been one of the key…

Computation and Language · Computer Science 2024-01-26 Jiang Li , Xiaoping Wang , Yingjian Liu , Zhigang Zeng

Event-related potential (ERP), a specialized paradigm of electroencephalographic (EEG), reflects neurological responses to external stimuli or events, generally associated with the brain's processing of specific cognitive tasks. ERP plays a…

Neural and Evolutionary Computing · Computer Science 2026-04-21 Yihe Wang , Zhiqiao Kang , Bohan Chen , Yu Zhang , Xiang Zhang

To handle the scarcity and heterogeneity of electroencephalography (EEG) data for Brain-Computer Interface (BCI) tasks, and to harness the power of large publicly available data sets, we propose Neuro-GPT, a foundation model consisting of…

Machine Learning · Computer Science 2024-03-05 Wenhui Cui , Woojae Jeong , Philipp Thölke , Takfarinas Medani , Karim Jerbi , Anand A. Joshi , Richard M. Leahy

Forecasting Electroncephalography (EEG) signals during cognitive events remains a fundamental challenge in neuroscience and Brain-Computer Interfaces (BCIs), as existing methods struggle to capture both the stochastic nature of neural…

Signal Processing · Electrical Eng. & Systems 2026-03-19 Mehran Shabanpour , Sadaf Khademi , Konstantinos N Plataniotis , Arash Mohammadi

Electroencephalography (EEG) offers detailed access to neural dynamics but remains constrained by noise and trial-by-trial variability, limiting decoding performance in data-restricted or complex paradigms. Data augmentation is often…

Signal Processing · Electrical Eng. & Systems 2025-11-18 Woojae Jeong , Wenhui Cui , Kleanthis Avramidis , Takfarinas Medani , Shrikanth Narayanan , Richard Leahy

Representation and classification of Electroencephalography (EEG) brain signals are critical processes for their analysis in cognitive tasks. Particularly, extraction of discriminative features from raw EEG signals, without any…

Machine Learning · Computer Science 2019-05-01 Emad-ul-Haq Qazi , Muhammad Hussain , Hatim Aboalsamh

In this article we present the results of our research related to the study of correlations between specific visual stimulation and the elicited brain's electro-physiological response collected by EEG sensors from a group of participants.…

Machine Learning · Computer Science 2017-08-04 Iaroslav Omelianenko

Timely diagnosis is important for saving the life of epileptic patients. In past few years, a lot of treatments are available for epilepsy. These treatments require use of anti-seizure drugs but are not effective in controlling frequency of…

Machine Learning · Computer Science 2021-11-08 Shivam Gupta , Jyoti Meena , O. P Gupta

Decoding natural language from non-invasive EEG signals is a promising yet challenging task. However, current state-of-the-art models remain constrained by three fundamental limitations: Semantic Bias (mode collapse into generic templates),…

Computation and Language · Computer Science 2026-04-06 Yuchen Wang , Haonan Wang , Yu Guo , Honglong Yang , Xiaomeng Li

Objective: The Electroencephalogram (EEG) is gaining popularity as a physiological measure for neuroergonomics in human factor studies because it is objective, less prone to bias, and capable of assessing the dynamics of cognitive states.…

Human-Computer Interaction · Computer Science 2023-05-16 Kuan-Jung Chiang , Steven Dong , Chung-Kuan Cheng , Tzyy-Ping Jung

We explore whether neural networks can decode brain activity into speech by mapping EEG recordings to audio representations. Using EEG data recorded as subjects listened to natural speech, we train a model with a contrastive CLIP loss to…

Sound · Computer Science 2025-11-10 Quentin Auster , Kateryna Shapovalenko , Chuang Ma , Demaio Sun

In this paper we explore continuous silent speech recognition using electroencephalography (EEG) signals. We implemented a connectionist temporal classification (CTC) automatic speech recognition (ASR) model to translate EEG signals…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-06 Gautam Krishna , Co Tran , Mason Carnahan , Ahmed Tewfik

This paper introduces a novel cross-physiology translation task: synthesizing sleep electroencephalography (EEG) from respiration signals. To address the significant complexity gap between the two modalities, we propose a…

Machine Learning · Computer Science 2026-02-03 Kaiwen Zha , Chao Li , Hao He , Peng Cao , Tianhong Li , Ali Mirzazadeh , Ellen Zhang , Jong Woo Lee , Yoon Kim , Dina Katabi

High-resolution neural datasets enable foundation models for the next generation of brain-computer interfaces and neurological treatments. The community requires rigorous benchmarks to discriminate between competing modeling approaches, yet…

Electroencephalography (EEG) is shown to be a valuable data source for evaluating subjects' mental states. However, the interpretation of multi-modal EEG signals is challenging, as they suffer from poor signal-to-noise-ratio, are highly…

Signal Processing · Electrical Eng. & Systems 2022-04-19 David Bethge , Philipp Hallgarten , Ozan Özdenizci , Ralf Mikut , Albrecht Schmidt , Tobias Grosse-Puppendahl

In this paper, we propose a deep learning framework, TSception, for emotion detection from electroencephalogram (EEG). TSception consists of temporal and spatial convolutional layers, which learn discriminative representations in the time…

Signal Processing · Electrical Eng. & Systems 2020-04-09 Yi Ding , Neethu Robinson , Qiuhao Zeng , Duo Chen , Aung Aung Phyo Wai , Tih-Shih Lee , Cuntai Guan