English
Related papers

Related papers: BiMoE: Brain-Inspired Experts for EEG-Dominant Aff…

200 papers

Emotion recognition based on EEG (electroencephalography) has been widely used in human-computer interaction, distance education and health care. However, the conventional methods ignore the adjacent and symmetrical characteristics of EEG…

Signal Processing · Electrical Eng. & Systems 2021-08-30 Xiangwen Deng , Junlin Zhu , Shangming Yang

In recent years, Affective Computing and its applications have become a fast-growing research topic. Furthermore, the rise of Deep Learning has introduced significant improvements in the emotion recognition system compared to classical…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Joaquim Comas , Decky Aspandi , Xavier Binefa

Healthcare models are transitioning from unimodal prediction toward multimodal reasoning over heterogeneous diagnostic inputs. In computational pathology, for complex tumor subtypes where morphology alone can be challenging to distinguish,…

In-vehicle emotion recognition underpins adaptive driver-assistance systems and, ultimately, occupant safety. However, practical deployment is hindered by (i) modality fragility - poor lighting and occlusions degrade vision-based methods;…

Machine Learning · Computer Science 2025-07-23 Baran Can Gül , Suraksha Nadig , Stefanos Tziampazis , Nasser Jazdi , Michael Weyrich

In order to develop more precise and functional affective applications, it is necessary to achieve a balance between the psychology and the engineering applied to emotions. Signals from the central and peripheral nervous systems have been…

Human-Computer Interaction · Computer Science 2019-05-02 Jennifer Sorinas , Jose Manuel Ferrández , Eduardo Fernandez

Multimodal learning has been proven to be an effective method to improve speech enhancement (SE) performance, especially in challenging situations such as low signal-to-noise ratios, speech noise, or unseen noise types. In previous studies,…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-15 Kuan-Chen Wang , Kai-Chun Liu , Hsin-Min Wang , Yu Tsao

Micro-actions, fleeting and low-amplitude motions, such as glances, nods, or minor posture shifts, carry rich social meaning but remain difficult for current action recognition models to recognize due to their subtlety, short duration, and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Nishit Poddar , Aglind Reka , Diana-Laura Borza , Snehashis Majhi , Michal Balazia , Abhijit Das , Francois Bremond

Electroencephalography (EEG)-based emotion recognition plays a critical role in affective computing and emerging decision-support systems, yet remains challenging due to high-dimensional, noisy, and subject-dependent signals. This study…

Machine Learning · Computer Science 2026-02-09 S M Rakib UI Karim , Wenyi Lu , Diponkor Bala , Rownak Ara Rasul , Sean Goggins

Survival analysis, as a challenging task, requires integrating Whole Slide Images (WSIs) and genomic data for comprehensive decision-making. There are two main challenges in this task: significant heterogeneity and complex inter- and…

Image and Video Processing · Electrical Eng. & Systems 2024-06-17 Conghao Xiong , Hao Chen , Hao Zheng , Dong Wei , Yefeng Zheng , Joseph J. Y. Sung , Irwin King

Emotion recognition through physiological signals such as electroencephalogram (EEG) has become an essential aspect of affective computing and provides an objective way to capture human emotions. However, physiological data characterized by…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Adnan Ahmad , Bahareh Nakisa , Mohammad Naim Rastgoo

Throughout the past decade, many studies have classified human emotions using only a single sensing modality such as face video, electroencephalogram (EEG), electrocardiogram (ECG), galvanic skin response (GSR), etc. The results of these…

Human-Computer Interaction · Computer Science 2018-06-22 Siddharth Siddharth , Tzyy-Ping Jung , Terrence J. Sejnowski

Decoding the orchestration of neural activity in electroencephalography (EEG) signals is a central challenge in bridging neuroscience with artificial intelligence. Foundation models have made strides in generalized EEG decoding, yet many…

Machine Learning · Computer Science 2026-03-31 Davy Darankoum , Chloé Habermacher , Julien Volle , Sergei Grudinin

We present our submission to the Hume-ABAW10 Emotional Mimicry Intensity (EMI) Challenge, which aims to predict six continuous emotion intensity dimensions: Admiration, Amusement, Determination, Empathic Pain, Excitement, and Joy, from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Dinithi Dissanayake , Shaveen Silva , Ovindu Atukorala , Prasanth Sasikumar , Suranga Nanayakkara

This paper explores the development of a multimodal sentiment analysis model that integrates text, audio, and visual data to enhance sentiment classification. The goal is to improve emotion detection by capturing the complex interactions…

Computation and Language · Computer Science 2025-01-15 Hui Lee , Singh Suniljit , Yong Siang Ong

Multimodal Sentiment Analysis (MSA) aims to infer human sentiment from textual, acoustic, and visual signals. In real-world scenarios, however, multimodal inputs are often compromised by dynamic noise or modality missingness. Existing…

Artificial Intelligence · Computer Science 2026-04-09 Yitong Zhu , Yuxuan Jiang , Guanxuan Jiang , Bojing Hou , Peng Yuan Zhou , Ge Lin Kan , Yuyang Wang

Accurately monitoring cognitive load in real time is critical for Brain-Computer Interfaces (BCIs) that adapt to user engagement and support personalized learning. Electroencephalography (EEG) offers a non-invasive, cost-effective modality…

Human-Computer Interaction · Computer Science 2026-05-04 Deeksha M. Shama , Dimitra Emmanouilidou , Ivan J. Tashev

Emotional Recognition in Conversation (ERC) is valuable for diagnosing health conditions such as autism and depression, and for understanding the emotions of individuals who struggle to express their feelings. Current ERC methods primarily…

Human-Computer Interaction · Computer Science 2026-05-06 Zijian Kang , Yueyang Li , Shengyu Gong , Weiming Zeng , Hongjie Yan , Lingbin Bian , Zhiguo Zhang , Wai Ting Siok , Nizhuan Wang

Emotions are crucial in human life, influencing perceptions, relationships, behaviour, and choices. Emotion recognition using Electroencephalography (EEG) in the Brain-Computer Interface (BCI) domain presents significant challenges,…

Human-Computer Interaction · Computer Science 2025-12-12 Gourav Siddhad , Masakazu Iwamura , Partha Pratim Roy

Compared with the rich studies on the motor brain-computer interface (BCI), the recently emerging affective BCI presents distinct challenges since the brain functional connectivity networks involving emotion are not well investigated.…

Human-Computer Interaction · Computer Science 2020-04-07 Xun Wu , Wei-Long Zheng , Bao-Liang Lu

Electroencephalography (EEG) is a non-invasive technique for recording brain electrical activity, widely used in brain-computer interface (BCI) and healthcare. Recent EEG foundation models trained on large-scale datasets have shown improved…

Machine Learning · Computer Science 2025-09-29 Yi Ding , Muyun Jiang , Weibang Jiang , Shuailei Zhang , Xinliang Zhou , Chenyu Liu , Shanglin Li , Yong Li , Cuntai Guan