English
Related papers

Related papers: Wave2Word: A Multimodal Transformer Framework for …

200 papers

Self-supervised learning has emerged as a highly effective approach in the fields of natural language processing and computer vision. It is also applicable to brain signals such as electroencephalography (EEG) data, given the abundance of…

Signal Processing · Electrical Eng. & Systems 2024-01-22 Yuqi Chen , Kan Ren , Kaitao Song , Yansen Wang , Yifan Wang , Dongsheng Li , Lili Qiu

The utilization of deep learning on electrocardiogram (ECG) analysis has brought the advanced accuracy and efficiency of cardiac healthcare diagnostics. By leveraging the capabilities of deep learning in semantic understanding, especially…

Signal Processing · Electrical Eng. & Systems 2024-10-25 Han Yu , Peikun Guo , Akane Sano

Electroencephalogram (EEG) signals generally exhibit low signal-to-noise ratio (SNR) and high inter-subject variability, making generalization across subjects and domains challenging. Recent advances in deep learning, particularly…

Machine Learning · Computer Science 2026-04-08 Jiazhen Hong , Geoffrey Mackellar , Soheila Ghane

Physiological signals such as electrocardiograms (ECG) and electroencephalograms (EEG) provide complementary insights into human health and cognition, yet multi-modal integration is challenging due to limited multi-modal labeled data, and…

While electroencephalogram (EEG) has been a crucial tool for monitoring the brain and diagnosing neurological disorders (e.g., epilepsy), learning meaningful representations from raw EEG signals remains challenging due to limited…

Machine Learning · Computer Science 2025-09-03 Jia Hong Puah , Sim Kuan Goh , Ziwei Zhang , Zixuan Ye , Chow Khuen Chan , Kheng Seang Lim , Si Lei Fong , Kok Sin Woon , Cuntai Guan

Both the temporal dynamics and spatial correlations of Electroencephalogram (EEG), which contain discriminative emotion information, are essential for the emotion recognition. However, some redundant information within the EEG signals would…

Signal Processing · Electrical Eng. & Systems 2022-11-17 Zhe Wang , Yongxiong Wang , Chuanfei Hu , Zhong Yin , Yu Song

With the widespread application of electroencephalography (EEG) in neuroscience and clinical practice, efficiently retrieving and semantically interpreting large-scale, multi-source, heterogeneous EEG data has become a pressing challenge.…

Computation and Language · Computer Science 2025-10-14 Yi Wang , Haoran Luo , Lu Meng , Ziyu Jia , Xinliang Zhou , Qingsong Wen

Electroencephalography (EEG) and magnetoencephalography (MEG) play important and complementary roles in non-invasive brain-computer interface (BCI) decoding. However, compared to the low cost and portability of EEG, MEG is more expensive…

Signal Processing · Electrical Eng. & Systems 2026-02-10 Zhuo Li , Shuqiang Wang

A significant challenge in the electroencephalogram EEG lies in the fact that current data representations involve multiple electrode signals, resulting in data redundancy and dominant lead information. However extensive research conducted…

Signal Processing · Electrical Eng. & Systems 2024-07-31 Huyen Ngo , Khoi Do , Duong Nguyen , Viet Dung Nguyen , Lan Dang

Machine learning (ML) methods have the potential to automate clinical EEG analysis. They can be categorized into feature-based (with handcrafted features), and end-to-end approaches (with learned features). Previous studies on EEG pathology…

Recent advances in deep learning have had a methodological and practical impact on brain-computer interface research. Among the various deep network architectures, convolutional neural networks have been well suited for…

Signal Processing · Electrical Eng. & Systems 2020-03-06 Wonjun Ko , Eunjin Jeon , Seungwoo Jeong , Heung-Il Suk

Foundation models for electroencephalography (EEG) signals have recently demonstrated success in learning generalized representations of EEGs, outperforming specialized models in various downstream tasks. However, many of these models lack…

Classification models for electroencephalogram (EEG) data show a large decrease in performance when evaluated on unseen test sub jects. We reduce this performance decrease using new regularization techniques during model training. We…

Machine Learning · Computer Science 2023-10-16 Niklas Smedemark-Margulies , Ye Wang , Toshiaki Koike-Akino , Jing Liu , Kieran Parsons , Yunus Bicer , Deniz Erdogmus

This paper presents a novel approach towards creating a foundational model for aligning neural data and visual stimuli across multimodal representationsof brain activity by leveraging contrastive learning. We used electroencephalography…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Matteo Ferrante , Tommaso Boccato , Grigorii Rashkov , Nicola Toschi

Reliable seizure detection in mouse models is essential for preclinical epilepsy research, yet manual review of synchronized video-EEG recordings is labor-intensive and single-modality systems fail for complementary reasons: video-based…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Tong Lu , Ke Xu , Zimo Zhang , Zitong Zhao , Danwei Weng , Ruiyu Wang , Miao Liu , Zizuo Zhang , Jingyi Yao , Yixuan Zhao , Wenchao Zhang , Min Wang , Guoming Luan , Minmin Luo , Zhifeng Yue

This paper introduces a novel cross-physiology translation task: synthesizing sleep electroencephalography (EEG) from respiration signals. To address the significant complexity gap between the two modalities, we propose a…

Machine Learning · Computer Science 2026-02-03 Kaiwen Zha , Chao Li , Hao He , Peng Cao , Tianhong Li , Ali Mirzazadeh , Ellen Zhang , Jong Woo Lee , Yoon Kim , Dina Katabi

Electroencephalography (EEG)-based multimodal learning integrates brain signals with complementary modalities to improve mental state assessment, providing great clinical potential. The effectiveness of such paradigms largely depends on the…

Machine Learning · Computer Science 2026-05-12 Runhe Zhou , Shanglin Li , Guanxiang Huang , Xinliang Zhou , Qibin Zhao , Motoaki Kawanabe , Yi Ding , Cuntai Guan

Timely diagnosis is important for saving the life of epileptic patients. In past few years, a lot of treatments are available for epilepsy. These treatments require use of anti-seizure drugs but are not effective in controlling frequency of…

Machine Learning · Computer Science 2021-11-08 Shivam Gupta , Jyoti Meena , O. P Gupta

Learning transferable representations for electroencephalography (EEG) remains challenging because EEG signals are inherently multi-channel and non-stationary. Channels observed at the same time provide coupled measurements of neural…

Machine Learning · Computer Science 2026-05-13 Fan Ma , Qier An , Peng Chen , Lingfei Qian , Xiang Lan , Mingyang Jiang , Zhiling Gu , Xenophon Papademetris , Hua Xu

Automatic sleep staging is a critical task in healthcare due to the global prevalence of sleep disorders. This study focuses on single-channel electroencephalography (EEG), a practical and widely available signal for automatic sleep…

Machine Learning · Computer Science 2026-01-01 Amirali Vakili , Salar Jahanshiri , Armin Salimi-Badr