English
Related papers

Related papers: A foundation model with multi-variate parallel att…

200 papers

Electroencephalography (EEG) is a widely used tool for studying brain function, with applications in clinical neuroscience, diagnosis, and brain-computer interfaces (BCIs). Recent EEG foundation models trained on large unlabeled corpora aim…

Machine Learning · Computer Science 2026-05-08 Saarang Panchavati , Uddhav Panchavati , Hiroki Nariai , Corey Arnold , William Speier

Current deep learning models for electroencephalography (EEG) are often task-specific and depend on large labeled datasets, limiting their adaptability. Although emerging foundation models aim for broader applicability, their rigid…

To handle the scarcity and heterogeneity of electroencephalography (EEG) data for Brain-Computer Interface (BCI) tasks, and to harness the power of large publicly available data sets, we propose Neuro-GPT, a foundation model consisting of…

Machine Learning · Computer Science 2024-03-05 Wenhui Cui , Woojae Jeong , Philipp Thölke , Takfarinas Medani , Karim Jerbi , Anand A. Joshi , Richard M. Leahy

Self-supervised learning has emerged as a highly effective approach in the fields of natural language processing and computer vision. It is also applicable to brain signals such as electroencephalography (EEG) data, given the abundance of…

Signal Processing · Electrical Eng. & Systems 2024-01-22 Yuqi Chen , Kan Ren , Kaitao Song , Yansen Wang , Yifan Wang , Dongsheng Li , Lili Qiu

Electroencephalography (EEG) foundation models hold significant promise for universal Brain-Computer Interfaces (BCIs). However, existing approaches often rely on end-to-end fine-tuning and exhibit limited efficacy under frozen-probing…

Machine Learning · Computer Science 2026-03-20 Jiquan Wang , Sha Zhao , Yangxuan Zhou , Yiming Kang , Shijian Li , Gang Pan

Electroencephalography (EEG) reflects the brain's functional state, making it a crucial tool for diverse detection applications like seizure detection and sleep stage classification. While deep learning-based approaches have recently shown…

Machine Learning · Computer Science 2025-10-07 Kerui Wu , Ziyue Zhao , Bülent Yener

Transformers have recently gained attention in the computer vision domain due to their ability to model long-range dependencies. However, the self-attention mechanism, which is the core part of the Transformer model, usually suffers from…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Reza Azad , René Arimond , Ehsan Khodapanah Aghdam , Amirhossein Kazerouni , Dorit Merhof

Electroencephalography (EEG) is a critical, non-invasive method to monitor electrical brain activity. EEGs can span anywhere from a couple seconds to multiple hours, posing a major hurdle for existing deep learning methods due to two major…

Artificial Intelligence · Computer Science 2026-05-28 Abhilash Durgam , Nyle Siddiqui , Jeffrey A. Chan-Santiago , Qiushi Fu , Elakkat D. Gireesh , Mubarak Shah

Electrocardiograms (ECGs) are among the most widely available clinical signals and play a central role in cardiovascular diagnosis. While recent foundation models (FMs) have shown promise for learning transferable ECG representations, most…

Biosignals such as electroencephalography (EEG), electrocardiography (ECG), and electromyography (EMG) encode physiological activity across multiple temporal and spectral scales, yielding representations that are rich but challenging for…

In multi-condition EEG experiments, brain activity is recorded as subjects perform various tasks or are exposed to different stimuli. The recorded signals are commonly transformed into time-frequency representations, which often display…

Methodology · Statistics 2025-07-29 Xiaomeng Ju , Thaddeus Tarpey , Hyung G Park

Neural decoding from electroencephalography (EEG) remains fundamentally limited by poor generalization to unseen subjects, driven by high inter-subject variability and the lack of large-scale datasets to model it effectively. Existing…

Machine Learning · Computer Science 2025-11-25 Mengchun Zhang , Kateryna Shapovalenko , Yucheng Shao , Eddie Guo , Parusha Pradhan

Characterizing the relationship between neural population activity and behavioral data is a central goal of neuroscience. While latent variable models (LVMs) are successful in describing high-dimensional time-series data, they are typically…

Machine Learning · Computer Science 2026-02-12 Rabia Gondur , Usama Bin Sikandar , Evan Schaffer , Mikio Christian Aoi , Stephen L Keeley

We discuss Bayesian analysis of multivariate time series with dynamic factor models that exploit time-adaptive sparsity in model parametrizations via the latent threshold approach. One central focus is on the transfer responses of multiple…

Applications · Statistics 2022-06-07 Jouchi Nakajima , Mike West

This paper presents a novel approach towards creating a foundational model for aligning neural data and visual stimuli across multimodal representationsof brain activity by leveraging contrastive learning. We used electroencephalography…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Matteo Ferrante , Tommaso Boccato , Grigorii Rashkov , Nicola Toschi

Multi-channel EEG signals are commonly used for the diagnosis and assessment of diseases such as epilepsy. Currently, various EEG diagnostic algorithms based on deep learning have been developed. However, most research efforts focus solely…

Signal Processing · Electrical Eng. & Systems 2024-10-24 Zekun Jiang , Wei Dai , Qu Wei , Ziyuan Qin , Kang Li , Le Zhang

Vision Transformers face a fundamental limitation: standard self-attention jointly processes spatial and channel dimensions, leading to entangled representations that prevent independent modeling of structural and semantic dependencies.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Jiashu Liao , Pietro Liò , Marc de Kamps , Duygu Sarikaya

The present study introduces an innovative approach to the synthesis of Electroencephalogram (EEG) signals by integrating diffusion models with reinforcement learning. This integration addresses key challenges associated with traditional…

Signal Processing · Electrical Eng. & Systems 2024-10-02 Yang An , Yuhao Tong , Weikai Wang , Steven W. Su

Virtual reality finds various applications in productivity, entertainment, and training scenarios requiring working memory and attentional resources. Working memory relies on prioritizing relevant information and suppressing irrelevant…

Human-Computer Interaction · Computer Science 2024-12-31 Francesco Chiossi , Changkun Ou , Carolina Gerhardt , Felix Putze , Sven Mayer

The increasing need for accurate and unified analysis of diverse biological signals, such as ECG and EEG, is paramount for comprehensive patient assessment, especially in synchronous monitoring. Despite advances in multi-sensor fusion, a…

Signal Processing · Electrical Eng. & Systems 2025-07-18 Mohammed Guhdar , Ramadhan J. Mstafa , Abdulhakeem O. Mohammed
‹ Prev 1 4 5 6 7 8 10 Next ›