English
Related papers

Related papers: A foundation model with multi-variate parallel att…

200 papers

Medical Visual Question Answering (VQA) is a multi-modal challenging task widely considered by research communities of the computer vision and natural language processing. Since most current medical VQA models focus on visual content,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Haiwei Pan , Shuning He , Kejia Zhang , Bo Qu , Chunling Chen , Kun Shi

Time series sequence prediction and modelling has proven to be a challenging endeavor in real world datasets. Two key issues are the multi-dimensionality of data and the interaction of independent dimensions forming a latent output signal,…

Machine Learning · Computer Science 2020-10-09 Jakob Aungiers

Epilepsy affects over 50 million people worldwide, and one-third of patients suffer drug-resistant seizures where surgery offers the best chance of seizure freedom. Accurate localization of the epileptogenic zone (EZ) relies on intracranial…

Irregular sampling occurs in many time series modeling applications where it presents a significant challenge to standard deep learning models. This work is motivated by the analysis of physiological time series data in electronic health…

Machine Learning · Computer Science 2021-06-08 Satya Narayan Shukla , Benjamin M. Marlin

Multi-headed Attention's (MHA) quadratic compute and linearly growing KV-cache make long-context transformers expensive to train and serve. Prior works such as Grouped Query Attention (GQA) and Multi-Latent Attention (MLA) shrink the cache,…

Computation and Language · Computer Science 2026-03-18 Tomas Figliolia , Nicholas Alonso , Rishi Iyer , Quentin Anthony , Beren Millidge

Electroencephalogram (EEG) signals generally exhibit low signal-to-noise ratio (SNR) and high inter-subject variability, making generalization across subjects and domains challenging. Recent advances in deep learning, particularly…

Machine Learning · Computer Science 2026-04-08 Jiazhen Hong , Geoffrey Mackellar , Soheila Ghane

Sleep is essential for maintaining human health and quality of life. Analyzing physiological signals during sleep is critical in assessing sleep quality and diagnosing sleep disorders. However, manual diagnoses by clinicians are…

Signal Processing · Electrical Eng. & Systems 2025-10-02 Cheol-Hui Lee , Hakseung Kim , Byung C. Yoon , Dong-Joo Kim

We propose a novel technique to assess functional brain connectivity in EEG/MEG signals. Our method, called Sparsely-Connected Sources Analysis (SCSA), can overcome the problem of volume conduction by modeling neural data innovatively with…

Methodology · Statistics 2010-08-05 Stefan Haufe , Ryota Tomioka , Guido Nolte , Klaus-Robert Mueller , Motoaki Kawanabe

Deciphering brain network topology can enhance the depth of neuroscientific knowledge and facilitate the development of neural engineering methods. Effective connectivity, a measure of brain network dynamics, is particularly useful for…

Neurons and Cognition · Quantitative Biology 2023-12-01 Chun-Hsiang Chuang , Shao-Xun Fang , Chih-Sheng Huang , Weiping Ding

EEG foundation models aim to learn reusable representations across heterogeneous paradigms, yet existing approaches often use uniform adaptation mechanisms and are typically reported under separate downstream fine-tuning protocols. In this…

Signal Processing · Electrical Eng. & Systems 2026-05-19 Wei Xiong , Jiangtong Li , Kun Zhu , Jie Li

In this study, a novel open-source brain-computer interface (BCI) platform was developed to decode scalp electroencephalography (EEG) signals associated with sustained attention. The EEG signal collection was conducted using a wireless…

Signal Processing · Electrical Eng. & Systems 2024-05-08 Maryam Norouzi , Mohammad Zaeri Amirani , Yalda Shahriari , Reza Abiri

Time Varying Functional Connectivity (TVFC) investigates how the interactions among brain regions vary over the course of an fMRI experiment. The transitions between different individual connectivity states can be modulated by changes in…

Time Series Foundation Models (TSFMs) have become a new component of the state-of-the-art in general time series forecasting. However, adapting them to specialized classification tasks remains constrained by two interconnected challenges:…

Machine Learning · Computer Science 2026-05-26 José Alberto Rodríguez , Luis Balderas , Miguel Lastra , Antonio Arauzo-Azofra , José M. Benítez

Although foundation models have demonstrated remarkable success in general domains, the application of these models to electroencephalography (EEG) analysis is constrained by substantial data requirements and high parameterization. These…

Artificial Intelligence · Computer Science 2026-05-25 Guoan Wang , Shihao Yang , Jun-En Ding , Feng Liu

Timely identification of harmful brain activities via electroencephalography (EEG) is critical for brain disease diagnosis and treatment, which remains limited application due to inter-rater variability, resource constraints, and poor…

Event-related potential (ERP), a specialized paradigm of electroencephalographic (EEG), reflects neurological responses to external stimuli or events, generally associated with the brain's processing of specific cognitive tasks. ERP plays a…

Neural and Evolutionary Computing · Computer Science 2026-04-21 Yihe Wang , Zhiqiao Kang , Bohan Chen , Yu Zhang , Xiang Zhang

Elucidating the functional mechanisms of the primary visual cortex (V1) remains a fundamental challenge in systems neuroscience. Current computational models face two critical limitations, namely the challenge of cross-modal integration…

Neurons and Cognition · Quantitative Biology 2024-12-20 Yu Zhu , Bo Lei , Chunfeng Song , Wanli Ouyang , Shan Yu , Tiejun Huang

Brain-computer interfaces (BCIs) enable direct communication between the brain and external devices. Recent EEG foundation models aim to learn generalized representations across diverse BCI paradigms. However, these approaches overlook…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Dingkun Liu , Zhu Chen , Jingwei Luo , Shijie Lian , Dongrui Wu

This article introduces DT4ECG, an innovative dual-task learning framework for Electrocardiogram (ECG)-based human identity recognition and activity detection. The framework employs a robust one-dimensional convolutional neural network…

Signal Processing · Electrical Eng. & Systems 2025-02-18 Siyu You , Boyuan Gu , Yanhui Yang , Shiyu Yu , Shisheng Guo

Electroencephalography foundation models (EEG-FMs) have advanced brain signal analysis, but the lack of standardized evaluation benchmarks impedes model comparison and scientific progress. Current evaluations rely on inconsistent protocols…

Signal Processing · Electrical Eng. & Systems 2026-02-16 Wei Xiong , Jiangtong Li , Jie Li , Kun Zhu , Changjun Jiang