English
Related papers

Related papers: EEG-Based Multimodal Learning via Hyperbolic Mixtu…

200 papers

Electroencephalography (EEG) offers detailed access to neural dynamics but remains constrained by noise and trial-by-trial variability, limiting decoding performance in data-restricted or complex paradigms. Data augmentation is often…

Signal Processing · Electrical Eng. & Systems 2025-11-18 Woojae Jeong , Wenhui Cui , Kleanthis Avramidis , Takfarinas Medani , Shrikanth Narayanan , Richard Leahy

To handle the scarcity and heterogeneity of electroencephalography (EEG) data for Brain-Computer Interface (BCI) tasks, and to harness the power of large publicly available data sets, we propose Neuro-GPT, a foundation model consisting of…

Machine Learning · Computer Science 2024-03-05 Wenhui Cui , Woojae Jeong , Philipp Thölke , Takfarinas Medani , Karim Jerbi , Anand A. Joshi , Richard M. Leahy

Electroencephalography (EEG) visual decoding remains challenging due to the modality gap between low-SNR neural signals and highly structured vision--language spaces, making direct cross-modal alignment unstable. To address this, we propose…

Image and Video Processing · Electrical Eng. & Systems 2026-05-28 Jiahe Meng , Weiming Zeng , Yueyang Li , Bo Chai , Hongjie Yan , Zhiguo Zhang , Wai Ting Siok , Nizhuan Wang

Cognitive load, the amount of mental effort required for task completion, plays an important role in performance and decision-making outcomes, making its classification and analysis essential in various sensitive domains. In this paper, we…

Machine Learning · Computer Science 2023-08-02 Dustin Pulver , Prithila Angkan , Paul Hungler , Ali Etemad

Understanding the intricate mappings between visual stimuli and neural responses is a fundamental challenge in cognitive neuroscience. While current approaches predominantly align images and functional magnetic resonance imaging (fMRI)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zihan Ma , Tian Xia , Kexin Wang , Xiao Li , Xiaowei He , Yudan Ren

Massive Open Online Courses (MOOCs) have become increasingly popular worldwide. However, learners primarily rely on watching videos, easily losing knowledge context and reducing learning effectiveness. We propose HyperMOOC, a novel approach…

Human-Computer Interaction · Computer Science 2026-02-02 Li Ye , Lei Wang , Lihong Cai , Ruiqi Yu , Yong Wang , Yigang Wang , Wei Chen , Zhiguang Zhou

Emotion recognition is essential for applications in affective computing and behavioral prediction, but conventional systems relying on single-modality data often fail to capture the complexity of affective states. To address this…

Multimedia · Computer Science 2025-09-08 Jianlu Wang , Yanan Wang , Tong Liu

Electroencephalography signals (EEGs) contain rich multi-scale information crucial for understanding brain states, with potential applications in diagnosing and advancing the drug development landscape. However, extracting meaningful…

Machine Learning · Computer Science 2025-09-26 D. Darankoum , C. Habermacher , J. Volle , S. Grudinin

Biological multimodal large language models (MLLMs) have emerged as powerful foundation models for scientific discovery. However, existing models are specialized to a single modality, limiting their ability to solve inherently cross-modal…

Machine Learning · Computer Science 2026-03-17 Wonbin Lee , Dongki Kim , Sung Ju Hwang

Emotion recognition is essential across numerous fields, including medical applications and brain-computer interface (BCI). Emotional responses include behavioral reactions, such as tone of voice and body movement, and changes in…

Signal Processing · Electrical Eng. & Systems 2024-10-02 Eleonora Lopez , Aurelio Uncini , Danilo Comminiello

Electrocardiograms (ECGs) are widely used non-invasive measurements of cardiac activity and play a central role in clinical diagnosis. Recent multimodal approaches align ECG signals with clinical reports to incorporate diagnostic semantics,…

Electroencephalography (EEG) often shows significant variability among people. This fluctuation disrupts reliable acquisition and may result in distortion or clipping. Modulo sampling is now a promising solution to this problem, by folding…

Signal Processing · Electrical Eng. & Systems 2025-10-31 Soujanya Hazra , Sanjay Ghosh

Decoding neurophysiological signals into language is of great research interest within brain-computer interface (BCI) applications. Electroencephalography (EEG), known for its non-invasiveness, ease of use, and cost-effectiveness, has been…

Quantitative Methods · Quantitative Biology 2024-09-26 Yitian Tao , Yan Liang , Luoyu Wang , Yongqing Li , Qing Yang , Han Zhang

Computational models lie at the intersection of basic neuroscience and healthcare applications because they allow researchers to test hypotheses \textit{in silico} and predict the outcome of experiments and interactions that are very hard…

Neurons and Cognition · Quantitative Biology 2020-09-18 Katharina Glomb , Joana Cabral , Anna Cattani , Alberto Mazzoni , Ashish Raj , Benedetta Franceschiello

Recently, electroencephalography (EEG) signals have been actively incorporated to decode brain activity to visual or textual stimuli and achieve object recognition in multi-modal AI. Accordingly, endeavors have been focused on building…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Xu Zheng , Ling Wang , Kanghao Chen , Yuanhuiyi Lyu , Jiazhou Zhou , Lin Wang

Evaluation of quality of experience (QoE) based on electroencephalography (EEG) has received great attention due to its capability of real-time QoE monitoring of users. However, it still suffers from rather low recognition accuracy. In this…

Human-Computer Interaction · Computer Science 2018-09-13 Seong-Eun Moon , Soobeom Jang , Jong-Seok Lee

An electroencephalogram (EEG) records the spatially averaged electrical activity of neurons in the brain, measured from the human scalp. Prior studies have explored EEG-based classification of objects or concepts, often for passive viewing…

Machine Learning · Computer Science 2026-02-25 Anupam Sharma , Harish Katti , Prajwal Singh , Shanmuganathan Raman , Krishna Miyapuram

Temporal knowledge graph (TKG) reasoning predicts future events based on historical data, but it's challenging due to the complex semantic and hierarchical information involved. Existing Euclidean models excel at capturing semantics but…

Machine Learning · Computer Science 2024-09-04 Siling Feng , Zhisheng Qi , Cong Lin

Electroencephalograph (EEG) is a crucial tool for studying brain activity. Recently, self-supervised learning methods leveraging large unlabeled datasets have emerged as a potential solution to the scarcity of widely available annotated EEG…

Electroencephalography (EEG) analysis is critical for brain-computer interfaces and neuroscience, but the intrinsic noise and high dimensionality of EEG signals hinder effective feature learning. We propose a self-supervised framework based…

Signal Processing · Electrical Eng. & Systems 2026-02-05 Yinghao Wang , Lintao Xu , Shujian Yu , Enzo Tartaglione , Van-Tam Nguyen