English
Related papers

Related papers: A Supervised Information Enhanced Multi-Granularit…

200 papers

Emotion recognition based on electroencephalography (EEG) holds significant promise for affective brain-computer interfaces (aBCIs). However, its practical deployment faces challenges due to the variability within inter-subject and the…

Human-Computer Interaction · Computer Science 2025-09-25 Jiahao Tang , Youjun Li , Xiangting Fan , Yangxuan Zheng , Siyuan Lu , Xueping Li , Peng Fang , Chenxi Li , Zi-Gang Huang

Applications in behavioural research, human-computer interaction, and mental health depend on the ability to recognize emotions. In order to improve the accuracy of emotion recognition using electroencephalography (EEG) data, this work…

Signal Processing · Electrical Eng. & Systems 2024-11-28 Ali Asgar Chandanwala , Srutakirti Bhowmik , Parna Chaudhury , Sheena Christabel Pravin

We present M3ER, a learning-based method for emotion recognition from multiple input modalities. Our approach combines cues from multiple co-occurring modalities (such as face, text, and speech) and also is more robust than other methods to…

Signal Processing · Electrical Eng. & Systems 2019-11-25 Trisha Mittal , Uttaran Bhattacharya , Rohan Chandra , Aniket Bera , Dinesh Manocha

Among the different modalities to assess emotion, electroencephalogram (EEG), representing the electrical brain activity, achieved motivating results over the last decade. Emotion estimation from EEG could help in the diagnosis or…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Victor Delvigne , Antoine Facchini , Hazem Wannous , Thierry Dutoit , Laurence Ris , Jean-Philippe Vandeborre

The field of emotion recognition of conversation (ERC) has been focusing on separating sentence feature encoding and context modeling, lacking exploration in generative paradigms based on unified designs. In this study, we propose a novel…

Computation and Language · Computer Science 2024-08-30 Shanglin Lei , Guanting Dong , Xiaoping Wang , Keheng Wang , Runqi Qiao , Sirui Wang

Contrastive learning has demonstrated promising performance in image and text domains either in a self-supervised or a supervised manner. In this work, we extend the supervised contrastive learning framework to clinical risk prediction…

Machine Learning · Computer Science 2021-10-12 Chengxi Zang , Fei Wang

Electroencephalographic (EEG) signals have long been applied in the field of affective brain-computer interfaces (aBCIs). Cross-subject EEG-based emotion recognition has demonstrated significant potential in practical applications due to…

Machine Learning · Computer Science 2025-12-23 Yici Liu , Qi Wei Oung , Hoi Leong Lee

Due to the abundant neurophysiological information in the electroencephalogram (EEG) signal, EEG signals integrated with deep learning methods have gained substantial traction across numerous real-world tasks. However, the development of…

Signal Processing · Electrical Eng. & Systems 2023-10-09 Weining Weng , Yang Gu , Qihui Zhang , Yingying Huang , Chunyan Miao , Yiqiang Chen

Both the temporal dynamics and spatial correlations of Electroencephalogram (EEG), which contain discriminative emotion information, are essential for the emotion recognition. However, some redundant information within the EEG signals would…

Signal Processing · Electrical Eng. & Systems 2022-11-17 Zhe Wang , Yongxiong Wang , Chuanfei Hu , Zhong Yin , Yu Song

Machine learning methods, such as deep learning, show promising results in the medical domain. However, the lack of interpretability of these algorithms may hinder their applicability to medical decision support systems. This paper studies…

Signal Processing · Electrical Eng. & Systems 2021-07-23 Juan Manuel Mayor-Torres , Mirco Ravanelli , Sara E. Medina-DeVilliers , Matthew D. Lerner , Giuseppe Riccardi

Speech Emotion Recognition (SER) aims to help the machine to understand human's subjective emotion from only audio information. However, extracting and utilizing comprehensive in-depth audio information is still a challenging task. In this…

Sound · Computer Science 2022-03-30 Heqing Zou , Yuke Si , Chen Chen , Deepu Rajan , Eng Siong Chng

Mitochondria segmentation in electron microscopy images is essential in neuroscience. However, due to the image degradation during the imaging process, the large variety of mitochondrial structures, as well as the presence of noise,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Zhili Li , Xuejin Chen , Jie Zhao , Zhiwei Xiong

This paper introduces Meta-PerSER, a novel meta-learning framework that personalizes Speech Emotion Recognition (SER) by adapting to each listener's unique way of interpreting emotion. Conventional SER systems rely on aggregated…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-23 Liang-Yeh Shen , Shi-Xin Fang , Yi-Cheng Lin , Huang-Cheng Chou , Hung-yi Lee

Generalisation to unseen subjects in EEG-based emotion classification remains a challenge due to high inter-and intra-subject variability. Continual learning (CL) poses a promising solution by learning from a sequence of tasks while…

Machine Learning · Computer Science 2026-01-14 Nina Peire , Yupei Li , Björn Schuller

Contrastive learning is a well-established paradigm in representation learning. The standard framework of contrastive learning minimizes the distance between "similar" instances and maximizes the distance between dissimilar ones in the…

Machine Learning · Computer Science 2025-02-06 Naghmeh Ghanooni , Barbod Pajoum , Harshit Rawal , Sophie Fellenz , Vo Nguyen Le Duy , Marius Kloft

Learning rich visual representations using contrastive self-supervised learning has been extremely successful. However, it is still a major question whether we could use a similar approach to learn superior auditory representations. In this…

Sound · Computer Science 2020-10-20 Haider Al-Tahan , Yalda Mohsenzadeh

Recent advancements in Deep and Self-Supervised Learning (SSL) have led to substantial improvements in Speech Emotion Recognition (SER) performance, reaching unprecedented levels. However, obtaining sufficient amounts of accurately labeled…

Computation and Language · Computer Science 2025-02-25 Bulat Khaertdinov , Pedro Jeuris , Annanda Sousa , Enrique Hortal

Speech Emotion Recognition (SER) is a fundamental task to predict the emotion label from speech data. Recent works mostly focus on using convolutional neural networks~(CNNs) to learn local attention map on fixed-scale feature representation…

Sound · Computer Science 2022-04-13 Wenjing Zhu , Xiang Li

Emotional Recognition in Conversation (ERC) is valuable for diagnosing health conditions such as autism and depression, and for understanding the emotions of individuals who struggle to express their feelings. Current ERC methods primarily…

Human-Computer Interaction · Computer Science 2026-05-06 Zijian Kang , Yueyang Li , Shengyu Gong , Weiming Zeng , Hongjie Yan , Lingbin Bian , Zhiguo Zhang , Wai Ting Siok , Nizhuan Wang

Neural representations induced by naturalistic stimuli offer insights into how humans respond to stimuli in daily life. Understanding neural mechanisms underlying naturalistic stimuli processing hinges on the precise identification and…

Neurons and Cognition · Quantitative Biology 2024-07-16 Xinke Shen , Lingyi Tao , Xuyang Chen , Sen Song , Quanying Liu , Dan Zhang