English
Related papers

Related papers: EEG-Based Multimodal Learning via Hyperbolic Mixtu…

200 papers

Self-supervised learning has been a powerful training paradigm to facilitate representation learning. In this study, we design a masked autoencoder (MAE) to guide deep learning models to learn electroencephalography (EEG) signal…

Human-Computer Interaction · Computer Science 2024-09-04 Yifei Zhou , Sitong Liu

Understanding human intentions (e.g., emotions) from videos has received considerable attention recently. Video streams generally constitute a blend of temporal data stemming from distinct modalities, including natural language, facial…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Dingkang Yang , Mingcheng Li , Linhao Qu , Kun Yang , Peng Zhai , Song Wang , Lihua Zhang

Recent advancements in multimodal large language models (MLLMs) have demonstrated considerable potential for comprehensive 3D scene understanding. However, existing approaches typically utilize only one or a limited subset of 3D modalities,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Yue Zhang , Yingzhao Jian , Hehe Fan , Yi Yang , Roger Zimmermann

Multimodal fingerprinting is a crucial technique to sub-meter 6G integrated sensing and communications (ISAC) localization, but two hurdles block deployment: (i) the contribution each modality makes to the target position varies with the…

The generalization and robustness of an electroencephalogram (EEG)-based computer aided diagnostic system are crucial requirements in actual clinical practice. To reach these goals, we propose a new EEG representation that provides a more…

Machine Learning · Computer Science 2017-02-10 Khadijeh Sadatnejad , Saeed S. Ghidary , Reza Rostami , Reza Kazemi

Self-supervised learning has emerged as a highly effective approach in the fields of natural language processing and computer vision. It is also applicable to brain signals such as electroencephalography (EEG) data, given the abundance of…

Signal Processing · Electrical Eng. & Systems 2024-01-22 Yuqi Chen , Kan Ren , Kaitao Song , Yansen Wang , Yifan Wang , Dongsheng Li , Lili Qiu

Deep learning based neural decoding from stereotactic electroencephalography (sEEG) would likely benefit from scaling up both dataset and model size. To achieve this, combining data across multiple subjects is crucial. However, in sEEG…

While analytics of sleep electroencephalography (EEG) holds certain advantages over other methods in clinical applications, high variability across subjects poses a significant challenge when it comes to deploying machine learning models…

Machine Learning · Computer Science 2023-10-05 Manoj Vishwanath , Steven Cao , Nikil Dutt , Amir M. Rahmani , Miranda M. Lim , Hung Cao

Use of the electroencephalogram (EEG) and machine learning approaches to recognize emotions can facilitate affective human computer interactions. However, the type of EEG data constitutes an obstacle for cross-individual EEG feature…

Machine Learning · Computer Science 2021-05-26 Xiaolong Zhong , Zhong Yin

Emotion Recognition in Conversations (ERC) is hard because discriminative evidence is sparse, localized, and often asynchronous across modalities. We center ERC on emotion hotspots and present a unified model that detects per-utterance…

Computation and Language · Computer Science 2025-10-13 Yu Liu , Hanlei Shi , Haoxun Li , Yuqing Sun , Yuxuan Ding , Linlin Gong , Leyuan Qu , Taihao Li

Electroencephalography (EEG) decoding is a challenging task due to the limited availability of labelled data. While transfer learning is a promising technique to address this challenge, it assumes that transferable data domains and task are…

Signal Processing · Electrical Eng. & Systems 2023-08-07 Bruno Aristimunha , Raphael Y. de Camargo , Walter H. Lopez Pinaya , Sylvain Chevallier , Alexandre Gramfort , Cedric Rommel

The Mixture of Experts (MoE) for language models has been proven effective in augmenting the capacity of models by dynamically routing each input token to a specific subset of experts for processing. Despite the success, most existing…

Machine Learning · Computer Science 2024-07-26 Hao Zhao , Zihan Qiu , Huijia Wu , Zili Wang , Zhaofeng He , Jie Fu

The electroencephalography classifier is the most important component of brain-computer interface based systems. There are two major problems hindering the improvement of it. First, traditional methods do not fully exploit multimodal…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Chuanqi Tan , Fuchun Sun , Wenchang Zhang

Objective: The Electroencephalogram (EEG) is gaining popularity as a physiological measure for neuroergonomics in human factor studies because it is objective, less prone to bias, and capable of assessing the dynamics of cognitive states.…

Human-Computer Interaction · Computer Science 2023-05-16 Kuan-Jung Chiang , Steven Dong , Chung-Kuan Cheng , Tzyy-Ping Jung

Machine learning (ML) methods have the potential to automate clinical EEG analysis. They can be categorized into feature-based (with handcrafted features), and end-to-end approaches (with learned features). Previous studies on EEG pathology…

The electroencephalogram (EEG) has been the gold standard for quantifying mental workload; however, due to its complexity and non-portability, it can be constraining. ECG signals, which are feasible on wearable equipment pieces such as…

Machine Learning · Computer Science 2026-01-13 Malavika Pradeep , Akshay Sasi , Nusaibah Farrukh , Rahul Venugopal , Elizabeth Sherly

Electroencephalography (EEG) signals provide a promising and involuntary reflection of brain activity related to emotional states, offering significant advantages over behavioral cues like facial expressions. However, EEG signals are often…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Kai Cui , Jia Li , Yu Liu , Xuesong Zhang , Zhenzhen Hu , Meng Wang

This article addresses the issue of representing electroencephalographic (EEG) signals in an efficient way. While classical approaches use a fixed Gabor dictionary to analyze EEG signals, this article proposes a data-driven method to obtain…

Machine Learning · Computer Science 2013-03-22 Quentin Barthélemy , Cédric Gouy-Pailler , Yoann Isaac , Antoine Souloumiac , Anthony Larue , Jérôme I. Mars

Foundation models for medical image segmentation have achieved remarkable performance. Adaptive fine-tuning of natural image segmentation foundation models is crucial for medical image segmentation tasks. However, some limitations exist in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Xinwei Zhang , Hu Chen , Zhe Yuan , Sukun Tian , Peng Feng

In intensive care units (ICUs), critically ill patients are monitored with electroencephalograms (EEGs) to prevent serious brain injury. The number of patients who can be monitored is constrained by the availability of trained physicians to…