English
Related papers

Related papers: EMERSK -- Explainable Multimodal Emotion Recogniti…

200 papers

For many years, the emotion recognition task has remained one of the most interesting and important problems in the field of human-computer interaction. In this study, we consider the emotion recognition task as a classification as well as…

Computer Vision and Pattern Recognition · Computer Science 2020-06-22 Denis Rangulov , Muhammad Fahim

Facial expressions play a crucial role in human communication serving as a powerful and impactful means to express a wide range of emotions. With advancements in artificial intelligence and computer vision, deep neural networks have emerged…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Yassine El Boudouri , Amine Bohi

Multimodal emotion recognition (MER) is crucial for human-computer interaction, yet real-world challenges like dynamic modality incompleteness and asynchrony severely limit its robustness. Existing methods often assume consistently complete…

Human-Computer Interaction · Computer Science 2025-08-19 Yitong Zhu , Lei Han , Guanxuan Jiang , PengYuan Zhou , Yuyang Wang

Facial Emotion Recognition is an inherently difficult problem, due to vast differences in facial structures of individuals and ambiguity in the emotion displayed by a person. Recently, a lot of work is being done in the field of Facial…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Aakash Saroop , Pathik Ghugare , Sashank Mathamsetty , Vaibhav Vasani

Emotion has an important role in daily life, as it helps people better communicate with and understand each other more efficiently. Facial expressions can be classified into 7 categories: angry, disgust, fear, happy, neutral, sad and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Shaoyuan Xu , Yang Cheng , Qian Lin , Jan P. Allebach

Facial expressions vary from person to person, and the brightness, contrast, and resolution of every random image are different. This is why recognizing facial expressions is very difficult. This article proposes an efficient system for…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Faisal Ghaffar

Studies on emotion recognition (ER) show that combining lexical and acoustic information results in more robust and accurate models. The majority of the studies focus on settings where both modalities are available in training and…

Computation and Language · Computer Science 2019-06-26 Gustavo Aguilar , Viktor Rozgić , Weiran Wang , Chao Wang

In this work, we present a lightweight and privacy-preserving Multimodal Emotion Recognition (MER) framework designed for deployment on edge devices. To demonstrate framework's versatility, our implementation uses three modalities - speech,…

Artificial Intelligence · Computer Science 2026-02-11 Rémi Grzeczkowicz , Eric Soriano , Ali Janati , Miyu Zhang , Gerard Comas-Quiles , Victor Carballo Araruna , Aneesh Jonelagadda

Video-based emotion recognition is a challenging task because it requires to distinguish the small deformations of the human face that represent emotions, while being invariant to stronger visual differences due to different identities.…

Machine Learning · Computer Science 2019-10-07 Masih Aminbeidokhti , Marco Pedersoli , Patrick Cardinal , Eric Granger

Multimodal learning has been a popular area of research, yet integrating electroencephalogram (EEG) data poses unique challenges due to its inherent variability and limited availability. In this paper, we introduce a novel multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Kang Yin , Hye-Bin Shin , Dan Li , Seong-Whan Lee

Traditional psychological evaluations rely heavily on human observation and interpretation, which are prone to subjectivity, bias, fatigue, and inconsistency. To address these limitations, this work presents a multimodal emotion recognition…

Human-Computer Interaction · Computer Science 2024-12-25 Kris Kraack

Emotion recognition and sentiment analysis are pivotal tasks in speech and language processing, particularly in real-world scenarios involving multi-party, conversational data. This paper presents a multimodal approach to tackle these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Aref Farhadipour , Hossein Ranjbar , Masoumeh Chapariniya , Teodora Vukovic , Sarah Ebling , Volker Dellwo

Recognizing the patient's emotions using deep learning techniques has attracted significant attention recently due to technological advancements. Automatically identifying the emotions can help build smart healthcare centers that can detect…

Machine Learning · Computer Science 2021-07-14 Marwan Dhuheir , Abdullatif Albaseer , Emna Baccour , Aiman Erbad , Mohamed Abdallah , Mounir Hamdi

This paper aims to demonstrate the importance and feasibility of fusing multimodal information for emotion recognition. It introduces a multimodal framework for emotion understanding by fusing the information from visual facial features and…

Artificial Intelligence · Computer Science 2023-06-06 Puneet Kumar , Xiaobai Li

Facial emotional recognition is one of the essential tools used by recognition psychology to diagnose patients. Face and facial emotional recognition are areas where machine learning is excelling. Facial Emotion Recognition in an…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Nitesh Banskota , Abeer Alsadoon , P. W. C. Prasad , Ahmed Dawoud , Tarik A. Rashid , Omar Hisham Alsadoon

Multimodal emotion recognition plays a crucial role in enhancing user experience in human-computer interaction. Over the past few decades, researchers have proposed a series of algorithms and achieved impressive progress. Although each…

Human-Computer Interaction · Computer Science 2024-04-23 Zheng Lian , Licai Sun , Yong Ren , Hao Gu , Haiyang Sun , Lan Chen , Bin Liu , Jianhua Tao

Automatic emotion recognition is one of the central concerns of the Human-Computer Interaction field as it can bridge the gap between humans and machines. Current works train deep learning models on low-level data representations to solve…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-22 Mariana Rodrigues Makiuchi , Kuniaki Uto , Koichi Shinoda

In our everyday lives and social interactions we often try to perceive the emotional states of people. There has been a lot of research in providing machines with a similar capacity of recognizing emotions. From a computer vision…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Ronak Kosti , Jose M. Alvarez , Adria Recasens , Agata Lapedriza

The Complex Emotion Recognition System (CERS) deciphers complex emotional states by examining combinations of basic emotions expressed, their interconnections, and the dynamic variations. Through the utilization of advanced algorithms, CERS…

Signal Processing · Electrical Eng. & Systems 2024-09-13 Javad Hassannataj Joloudari , Mohammad Maftoun , Bahareh Nakisa , Roohallah Alizadehsani , Meisam Yadollahzadeh-Tabari

EEG is a non-invasive, safe, and low-risk method to record electrophysiological signals inside the brain. Especially with recent technology developments like dry electrodes, consumer-grade EEG devices, and rapid advances in machine…

Machine Learning · Computer Science 2025-06-23 Tri Duc Ly , Gia H. Ngo