English
Related papers

Related papers: Enhancing EEG-to-Text Decoding through Transferabl…

200 papers

Electroencephalogram (EEG)-based brain-computer interfaces (BCIs) face significant deployment challenges due to inter-subject variability, signal non-stationarity, and computational constraints. While test-time adaptation (TTA) mitigates…

Human-Computer Interaction · Computer Science 2026-01-13 Siyang Li , Jiayi Ouyang , Zhenyao Cui , Ziwei Wang , Tianwang Jia , Feng Wan , Dongrui Wu

We introduce a new language representation model called BERT, which stands for Bidirectional Encoder Representations from Transformers. Unlike recent language representation models, BERT is designed to pre-train deep bidirectional…

Computation and Language · Computer Science 2019-05-28 Jacob Devlin , Ming-Wei Chang , Kenton Lee , Kristina Toutanova

We propose bootstrapped masked autoencoders (BootMAE), a new approach for vision BERT pretraining. BootMAE improves the original masked autoencoders (MAE) with two core designs: 1) momentum encoder that provides online feature as extra BERT…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Xiaoyi Dong , Jianmin Bao , Ting Zhang , Dongdong Chen , Weiming Zhang , Lu Yuan , Dong Chen , Fang Wen , Nenghai Yu

Decoding visual neural representations from Electroencephalography (EEG) signals remains a formidable challenge due to their high-dimensional, noisy, and non-Euclidean nature. In this work, we propose a Spatial-Functional Awareness…

Artificial Intelligence · Computer Science 2025-10-10 Yueming Sun , Long Yang

EEG foundation models aim to learn reusable representations across heterogeneous paradigms, yet existing approaches often use uniform adaptation mechanisms and are typically reported under separate downstream fine-tuning protocols. In this…

Signal Processing · Electrical Eng. & Systems 2026-05-19 Wei Xiong , Jiangtong Li , Kun Zhu , Jie Li

The 12-lead electrocardiogram (ECG) is a quasi-periodic, multi-channel signal with diagnostic content spanning timescales from millisecond waveform morphology to multi-second rhythm dynamics. Existing ECG representation learning relies on…

Computational Engineering, Finance, and Science · Computer Science 2026-05-26 Lei Xu , Fahad Sohrab , Mehmet Yamac , Merja Heinaniemi , Moncef Gabbouj

Building scalable models to learn from diverse, multimodal data remains an open challenge. For vision-language data, the dominant approaches are based on contrastive learning objectives that train a separate encoder for each modality. While…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Xinyang Geng , Hao Liu , Lisa Lee , Dale Schuurmans , Sergey Levine , Pieter Abbeel

The reconstruction of 3D objects from brain signals has gained significant attention in brain-computer interface (BCI) research. Current research predominantly utilizes functional magnetic resonance imaging (fMRI) for 3D reconstruction…

Graphics · Computer Science 2025-05-06 Xia Deng , Shen Chen , Jiale Zhou , Lei Li

Language model pre-training has proven to be useful in learning universal language representations. As a state-of-the-art language model pre-training model, BERT (Bidirectional Encoder Representations from Transformers) has achieved amazing…

Computation and Language · Computer Science 2020-02-06 Chi Sun , Xipeng Qiu , Yige Xu , Xuanjing Huang

Sequence-to-sequence (seq2seq) learning is a popular fashion for large-scale pretraining language models. However, the prior seq2seq pretraining models generally focus on reconstructive objectives on the decoder side and neglect the effect…

Computation and Language · Computer Science 2024-01-10 Qihuang Zhong , Liang Ding , Juhua Liu , Bo Du , Dacheng Tao

We exploit a self-supervised deep multi-task learning framework for electrocardiogram (ECG) -based emotion recognition. The proposed solution consists of two stages of learning a) learning ECG representations and b) learning to classify…

Signal Processing · Electrical Eng. & Systems 2020-08-11 Pritam Sarkar , Ali Etemad

State-of-the-art brain-to-text systems have achieved great success in decoding language directly from brain signals using neural networks. However, current approaches are limited to small closed vocabularies which are far from enough for…

Artificial Intelligence · Computer Science 2024-01-09 Zhenhailong Wang , Heng Ji

This work proposes a unified self-supervised pre-training framework for transferable multi-modal perception representation learning via masked multi-modal reconstruction in Neural Radiance Field (NeRF), namely NeRF-Supervised Masked…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Xiaohao Xu

The electrocardiogram (ECG) is one of the most commonly used non-invasive, convenient medical monitoring tools that assist in the clinical diagnosis of heart diseases. Recently, deep learning (DL) techniques, particularly self-supervised…

Machine Learning · Computer Science 2023-03-23 Jun Li , Che Liu , Sibo Cheng , Rossella Arcucci , Shenda Hong

Unsupervised learning methods have become increasingly important in deep learning due to their demonstrated large utilization of datasets and higher accuracy in computer vision and natural language processing tasks. There is a growing trend…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Guoxin Wang , Qingyuan Wang , Ganesh Neelakanta Iyer , Avishek Nag , Deepu John

Electroencephalography (EEG) is a non-invasive technique to measure and record brain electrical activity, widely used in various BCI and healthcare applications. Early EEG decoding methods rely on supervised learning, limited by specific…

Signal Processing · Electrical Eng. & Systems 2025-11-07 Jiquan Wang , Sha Zhao , Zhiling Luo , Yangxuan Zhou , Haiteng Jiang , Shijian Li , Tao Li , Gang Pan

Decoding brain activity into natural language is a major challenge in AI with important applications in assistive communication, neurotechnology, and human-computer interaction. Most existing Brain-Computer Interface (BCI) approaches rely…

Machine Learning · Computer Science 2026-03-19 Akshaj Murhekar , Christina Liu , Abhijit Mishra , Shounak Roychowdhury , Jacek Gwizdka

Decoding natural language from non-invasive EEG signals is a promising yet challenging task. However, current state-of-the-art models remain constrained by three fundamental limitations: Semantic Bias (mode collapse into generic templates),…

Computation and Language · Computer Science 2026-04-06 Yuchen Wang , Haonan Wang , Yu Guo , Honglong Yang , Xiaomeng Li

Physiological signals such as electrocardiograms (ECG) and electroencephalograms (EEG) provide complementary insights into human health and cognition, yet multi-modal integration is challenging due to limited multi-modal labeled data, and…

Accurate imputation of missing laboratory values in electronic health records (EHRs) is critical to enable robust clinical predictions and reduce biases in AI systems in healthcare. Existing methods, such as XGBoost, softimpute, GAIN,…

Machine Learning · Computer Science 2025-06-27 David Restrepo , Chenwei Wu , Yueran Jia , Jaden K. Sun , Jack Gallifant , Catherine G. Bielick , Yugang Jia , Leo A. Celi
‹ Prev 1 4 5 6 7 8 10 Next ›