English
Related papers

Related papers: Joint Contrastive Learning with Feature Alignment …

200 papers

Emotion recognition has a pivotal role in affective computing and in human-computer interaction. The current technological developments lead to increased possibilities of collecting data about the emotional state of a person. In general,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Andreea Birhala , Catalin Nicolae Ristea , Anamaria Radoi , Liviu Cristian Dutu

Context-aware emotion recognition (CAER) has recently boosted the practical applications of affective computing techniques in unconstrained environments. Mainstream CAER methods invariably extract ensemble representations from diverse…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Dingkang Yang , Kun Yang , Mingcheng Li , Shunli Wang , Shuaibing Wang , Lihua Zhang

The emoticons are symbolic representations that generally accompany the textual content to visually enhance or summarize the true intention of a written message. Although widely utilized in the realm of social media, the core semantics of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Ananya Pandey , Dinesh Kumar Vishwakarma

Convolutional neural networks (CNNs) are widely used to recognize the user's state through electroencephalography (EEG) signals. In the previous studies, the EEG signals are usually fed into the CNNs in the form of high-dimensional raw…

Machine Learning · Computer Science 2021-01-19 Seong-Eun Moon , Chun-Jui Chen , Cho-Jui Hsieh , Jane-Ling Wang , Jong-Seok Lee

Affective brain-computer interfaces based on electroencephalography (EEG) is an important branch in the field of affective computing. However, individual differences and noisy labels seriously limit the effectiveness and generalizability of…

Human-Computer Interaction · Computer Science 2022-05-09 Rushuang Zhou , Zhiguo Zhang , Hong Fu , Li Zhang , Linling Li , Gan Huang , Yining Dong , Fali Li , Xin Yang , Zhen Liang

This work presents a novel framework CISFA (Contrastive Image synthesis and Self-supervised Feature Adaptation)that builds on image domain translation and unsupervised feature adaptation for cross-modality biomedical image segmentation.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Xinrong Hu , Corey Wang , Yiyu Shi

Alignment remains a crucial task in multi-modal deep learning, and contrastive learning has been widely applied in this field. However, when there are more than two modalities, existing methods typically calculate pairwise loss function and…

Applications · Statistics 2025-05-07 Yiqiao Chen , Zijian Huang

Emotion Recognition in Conversations (ERC) is hard because discriminative evidence is sparse, localized, and often asynchronous across modalities. We center ERC on emotion hotspots and present a unified model that detects per-utterance…

Computation and Language · Computer Science 2025-10-13 Yu Liu , Hanlei Shi , Haoxun Li , Yuqing Sun , Yuxuan Ding , Linlin Gong , Leyuan Qu , Taihao Li

Automatic emotion recognition (ER) has recently gained lot of interest due to its potential in many real-world applications. In this context, multimodal approaches have been shown to improve performance (over unimodal approaches) by…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 R Gnana Praveen , Eric Granger , Patrick Cardinal

Multimodal emotion recognition (MER) aims to infer human affect by jointly modeling audio and visual cues; however, existing approaches often struggle with temporal misalignment, weakly discriminative feature representations, and suboptimal…

Multimedia · Computer Science 2026-01-21 Joe Dhanith P R , Shravan Venkatraman , Vigya Sharma , Santhosh Malarvannan

Psychological studies have shown that Micro Gestures (MG) are closely linked to human emotions. MG-based emotion understanding has attracted much attention because it allows for emotion understanding through nonverbal body gestures without…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Deng Li , Bohao Xing , Xin Liu

EEG-based emotion recognition plays an important role in developing adaptive brain-computer communication systems, yet faces two fundamental challenges in practical implementations: (1) effective integration of non-stationary…

Machine Learning · Computer Science 2025-08-20 Xuetao Lin , Tianhao Peng , Peihong Dai , Yu Liang , Wenjun Wu

This study delves into the intricacies of emotional contagion and its impact on performance within dyadic interactions. Specifically, it focuses on the context of stereotype-based stress (SBS) during collaborative problem-solving tasks…

Signal Processing · Electrical Eng. & Systems 2023-09-26 Jingyun Huang , Rachel C. Amey , Mengting Liu , Chad E. Forbes

Electroencephalography has been validated as an effective technique for detecting Parkinson's disease,particularly in its early stages.However,the high cost of EEG data annotation often results in limited dataset size and considerable…

Machine Learning · Computer Science 2025-08-22 Qian Zhang , Ruilin Zhang , Jun Xiao , Yifan Liu , Zhe Wang

Electroencephalogram (EEG)-based emotion recognition is an important affective computing task, and recent EEG foundation models provide useful generic representations for downstream adaptation. However, under the fine-tuning setting, three…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Haoliang Gong , Qingshan She , Jiale Xu , Yunyan Gao , Xugang Xi

While speech emotion recognition (SER) research has made significant progress, achieving generalization across various corpora continues to pose a problem. We propose a novel domain adaptation technique that embodies a multitask framework…

Computation and Language · Computer Science 2023-10-10 Chung-Soo Ahn , Jagath C. Rajapakse , Rajib Rana

Studies in the area of neuroscience have revealed the relationship between emotional patterns and brain functional regions, demonstrating that dynamic relationships between different brain regions are an essential factor affecting emotion…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Yijin Zhou , Fu Li , Yang Li , Youshuo Ji , Guangming Shi , Wenming Zheng , Lijian Zhang , Yuanfang Chen , Rui Cheng

Electroencephalography (EEG) is a prominent non-invasive neuroimaging technique providing insights into brain function. Unfortunately, EEG data exhibit a high degree of noise and variability across subjects hampering generalizable signal…

Machine Learning · Computer Science 2023-11-15 Anders Vestergaard Nørskov , Alexander Neergaard Zahid , Morten Mørup

Facial expression recognition is a pivotal component in machine learning, facilitating various applications. However, convolutional neural networks (CNNs) are often plagued by catastrophic forgetting, impeding their adaptability. The…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Israel A. Laurensi , Alceu de Souza Britto , Jean Paul Barddal , Alessandro Lameiras Koerich

Emotion Prediction in Conversation (EPC) aims to forecast the emotions of forthcoming utterances by utilizing preceding dialogues. Previous EPC approaches relied on simple context modeling for emotion extraction, overlooking fine-grained…

Multimedia · Computer Science 2024-08-09 Haoxiang Shi , Ziqi Liang , Jun Yu