English
Related papers

Related papers: Edu-EmotionNet: Cross-Modality Attention Alignment…

200 papers

Multimodal sentiment analysis (MSA) and emotion recognition in conversation (ERC) are key research topics for computers to understand human behaviors. From a psychological perspective, emotions are the expression of affect or feelings…

Computation and Language · Computer Science 2022-11-22 Guimin Hu , Ting-En Lin , Yi Zhao , Guangming Lu , Yuchuan Wu , Yongbin Li

In many domains, including online education, healthcare, security, and human-computer interaction, facial emotion recognition (FER) is essential. Real-world FER is still difficult despite its significance because of some factors such as…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Deeptimaan Banerjee , Prateek Gothwal , Ashis Kumer Biswas

With the fast development of artificial intelligence and short videos, emotion recognition in short videos has become one of the most important research topics in human-computer interaction. At present, most emotion recognition methods…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xuecheng Wu , Mengmeng Tian , Lanhang Zhai

This study presents high-throughput, real-time multi-agent affective computing framework designed to enhance classroom learning through emotional state monitoring. As large classroom sizes and limited teacher student interaction…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Hai Nguyen , Hieu Dao , Hung Nguyen , Nam Vu , Cong Tran

Multimodal Emotion Recognition (MER) aims to accurately identify human emotional states by integrating heterogeneous modalities such as visual, auditory, and textual data. Existing approaches predominantly rely on unified emotion labels to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Wen Yin , Siyu Zhan , Cencen Liu , Xin Hu , Guiduo Duan , Xiurui Xie , Yuan-Fang Li , Tao He

Multimodal sentiment analysis aims to identify the emotions expressed by individuals through visual, language, and acoustic cues. However, most existing research assume that all modalities are available during both training and testing,…

Sound · Computer Science 2026-04-21 Weide Liu , Huijing Zhan

Multimodal emotion recognition (MER) extracts emotions from multimodal data, including visual, speech, and text inputs, playing a key role in human-computer interaction. Attention-based fusion methods dominate MER research, achieving strong…

Artificial Intelligence · Computer Science 2025-06-03 Jiajun He , Jinyi Mi , Tomoki Toda

In the context of education technology, empathic interaction with the user and feedback by the learning system using multiple inputs such as video, voice and text inputs is an important area of research. In this paper, a nonintrusive,…

Computer Vision and Pattern Recognition · Computer Science 2018-07-16 S L Happy , A. Dasgupta , P. Patnaik , A. Routray

Multi-modal emotion recognition has garnered increasing attention as it plays a significant role in human-computer interaction (HCI) in recent years. Since different discrete emotions may exist at the same time, compared with single-class…

Machine Learning · Computer Science 2025-07-29 Chuhang Zheng , Chunwei Tian , Jie Wen , Daoqiang Zhang , Qi Zhu

Emotion Prediction in Conversation (EPC) aims to forecast the emotions of forthcoming utterances by utilizing preceding dialogues. Previous EPC approaches relied on simple context modeling for emotion extraction, overlooking fine-grained…

Multimedia · Computer Science 2024-08-09 Haoxiang Shi , Ziqi Liang , Jun Yu

Emotion Recognition in Conversation (ERC) plays a crucial role in enabling dialogue systems to effectively respond to user requests. The emotions in a conversation can be identified by the representations from various modalities, such as…

Computation and Language · Computer Science 2024-04-02 Taeyang Yun , Hyunkuk Lim , Jeonghwan Lee , Min Song

Emotion recognition is a topic of significant interest in assistive robotics due to the need to equip robots with the ability to comprehend human behavior, facilitating their effective interaction in our society. Consequently, efficient and…

Human-Computer Interaction · Computer Science 2023-12-05 Rutherford Agbeshi Patamia , Paulo E. Santos , Kingsley Nketia Acheampong , Favour Ekong , Kwabena Sarpong , She Kun

Emotion Recognition in Conversations (ERC) is hard because discriminative evidence is sparse, localized, and often asynchronous across modalities. We center ERC on emotion hotspots and present a unified model that detects per-utterance…

Computation and Language · Computer Science 2025-10-13 Yu Liu , Hanlei Shi , Haoxun Li , Yuqing Sun , Yuxuan Ding , Linlin Gong , Leyuan Qu , Taihao Li

Emotion recognition has a pivotal role in affective computing and in human-computer interaction. The current technological developments lead to increased possibilities of collecting data about the emotional state of a person. In general,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Andreea Birhala , Catalin Nicolae Ristea , Anamaria Radoi , Liviu Cristian Dutu

There remain two critical challenges that hinder the development of ERC. Firstly, there is a lack of exploration into mining deeper insights from the data itself for conversational emotion tasks. Secondly, the systems exhibit vulnerability…

Multimedia · Computer Science 2024-06-04 Haiyang Sun , Zheng Lian , Chenglong Wang , Kang Chen , Licai Sun , Bin Liu , Jianhua Tao

Emotion recognition based on Electroencephalography (EEG) has gained significant attention and diversified development in fields such as neural signal processing and affective computing. However, the unique brain anatomy of individuals…

Signal Processing · Electrical Eng. & Systems 2024-05-31 Yihang Dong , Xuhang Chen , Yanyan Shen , Michael Kwok-Po Ng , Tao Qian , Shuqiang Wang

This paper addresses the question of emotion classification. The task consists in predicting emotion labels (taken among a set of possible labels) best describing the emotions contained in short video clips. Building on a standard framework…

Computer Vision and Pattern Recognition · Computer Science 2017-09-22 Valentin Vielzeuf , Stéphane Pateux , Frédéric Jurie

Emotion recognition plays a vital role in enhancing human-computer interaction. In this study, we tackle the MER-SEMI challenge of the MER2025 competition by proposing a novel multimodal emotion recognition framework. To address the issue…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Juewen Hu , Yexin Li , Jiulin Li , Shuo Chen , Pring Wong

Understanding Affect from video segments has brought researchers from the language, audio and video domains together. Most of the current multimodal research in this area deals with various techniques to fuse the modalities, and mostly…

Computation and Language · Computer Science 2018-06-11 Saurav Sahay , Shachi H Kumar , Rui Xia , Jonathan Huang , Lama Nachman

Emotion recognition from physiological signals remains challenging due to their non-stationary, noisy, and subject-dependent characteristics. This work presents, to the best of our knowledge, the first comprehensive application of liquid…

Signal Processing · Electrical Eng. & Systems 2026-02-10 Anindya Bhattacharjee , Nittya Ananda Biswas , K. A. Shahriar , Adib Rahman