中文
相关论文

相关论文: EMERSK -- Explainable Multimodal Emotion Recogniti…

200 篇论文

For many years, the emotion recognition task has remained one of the most interesting and important problems in the field of human-computer interaction. In this study, we consider the emotion recognition task as a classification as well as…

计算机视觉与模式识别 · 计算机科学 2020-06-22 Denis Rangulov , Muhammad Fahim

Facial expressions play a crucial role in human communication serving as a powerful and impactful means to express a wide range of emotions. With advancements in artificial intelligence and computer vision, deep neural networks have emerged…

计算机视觉与模式识别 · 计算机科学 2025-01-15 Yassine El Boudouri , Amine Bohi

Multimodal emotion recognition (MER) is crucial for human-computer interaction, yet real-world challenges like dynamic modality incompleteness and asynchrony severely limit its robustness. Existing methods often assume consistently complete…

人机交互 · 计算机科学 2025-08-19 Yitong Zhu , Lei Han , Guanxuan Jiang , PengYuan Zhou , Yuyang Wang

Facial Emotion Recognition is an inherently difficult problem, due to vast differences in facial structures of individuals and ambiguity in the emotion displayed by a person. Recently, a lot of work is being done in the field of Facial…

计算机视觉与模式识别 · 计算机科学 2021-10-29 Aakash Saroop , Pathik Ghugare , Sashank Mathamsetty , Vaibhav Vasani

Emotion has an important role in daily life, as it helps people better communicate with and understand each other more efficiently. Facial expressions can be classified into 7 categories: angry, disgust, fear, happy, neutral, sad and…

计算机视觉与模式识别 · 计算机科学 2025-04-07 Shaoyuan Xu , Yang Cheng , Qian Lin , Jan P. Allebach

Facial expressions vary from person to person, and the brightness, contrast, and resolution of every random image are different. This is why recognizing facial expressions is very difficult. This article proposes an efficient system for…

计算机视觉与模式识别 · 计算机科学 2022-09-26 Faisal Ghaffar

Studies on emotion recognition (ER) show that combining lexical and acoustic information results in more robust and accurate models. The majority of the studies focus on settings where both modalities are available in training and…

计算与语言 · 计算机科学 2019-06-26 Gustavo Aguilar , Viktor Rozgić , Weiran Wang , Chao Wang

In this work, we present a lightweight and privacy-preserving Multimodal Emotion Recognition (MER) framework designed for deployment on edge devices. To demonstrate framework's versatility, our implementation uses three modalities - speech,…

Video-based emotion recognition is a challenging task because it requires to distinguish the small deformations of the human face that represent emotions, while being invariant to stronger visual differences due to different identities.…

机器学习 · 计算机科学 2019-10-07 Masih Aminbeidokhti , Marco Pedersoli , Patrick Cardinal , Eric Granger

Multimodal learning has been a popular area of research, yet integrating electroencephalogram (EEG) data poses unique challenges due to its inherent variability and limited availability. In this paper, we introduce a novel multimodal…

计算机视觉与模式识别 · 计算机科学 2024-11-05 Kang Yin , Hye-Bin Shin , Dan Li , Seong-Whan Lee

Traditional psychological evaluations rely heavily on human observation and interpretation, which are prone to subjectivity, bias, fatigue, and inconsistency. To address these limitations, this work presents a multimodal emotion recognition…

人机交互 · 计算机科学 2024-12-25 Kris Kraack

Emotion recognition and sentiment analysis are pivotal tasks in speech and language processing, particularly in real-world scenarios involving multi-party, conversational data. This paper presents a multimodal approach to tackle these…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Aref Farhadipour , Hossein Ranjbar , Masoumeh Chapariniya , Teodora Vukovic , Sarah Ebling , Volker Dellwo

Recognizing the patient's emotions using deep learning techniques has attracted significant attention recently due to technological advancements. Automatically identifying the emotions can help build smart healthcare centers that can detect…

机器学习 · 计算机科学 2021-07-14 Marwan Dhuheir , Abdullatif Albaseer , Emna Baccour , Aiman Erbad , Mohamed Abdallah , Mounir Hamdi

This paper aims to demonstrate the importance and feasibility of fusing multimodal information for emotion recognition. It introduces a multimodal framework for emotion understanding by fusing the information from visual facial features and…

人工智能 · 计算机科学 2023-06-06 Puneet Kumar , Xiaobai Li

Facial emotional recognition is one of the essential tools used by recognition psychology to diagnose patients. Face and facial emotional recognition are areas where machine learning is excelling. Facial Emotion Recognition in an…

计算机视觉与模式识别 · 计算机科学 2022-08-08 Nitesh Banskota , Abeer Alsadoon , P. W. C. Prasad , Ahmed Dawoud , Tarik A. Rashid , Omar Hisham Alsadoon

Multimodal emotion recognition plays a crucial role in enhancing user experience in human-computer interaction. Over the past few decades, researchers have proposed a series of algorithms and achieved impressive progress. Although each…

人机交互 · 计算机科学 2024-04-23 Zheng Lian , Licai Sun , Yong Ren , Hao Gu , Haiyang Sun , Lan Chen , Bin Liu , Jianhua Tao

Automatic emotion recognition is one of the central concerns of the Human-Computer Interaction field as it can bridge the gap between humans and machines. Current works train deep learning models on low-level data representations to solve…

音频与语音处理 · 电气工程与系统科学 2021-11-22 Mariana Rodrigues Makiuchi , Kuniaki Uto , Koichi Shinoda

In our everyday lives and social interactions we often try to perceive the emotional states of people. There has been a lot of research in providing machines with a similar capacity of recognizing emotions. From a computer vision…

计算机视觉与模式识别 · 计算机科学 2020-03-31 Ronak Kosti , Jose M. Alvarez , Adria Recasens , Agata Lapedriza

The Complex Emotion Recognition System (CERS) deciphers complex emotional states by examining combinations of basic emotions expressed, their interconnections, and the dynamic variations. Through the utilization of advanced algorithms, CERS…

EEG is a non-invasive, safe, and low-risk method to record electrophysiological signals inside the brain. Especially with recent technology developments like dry electrodes, consumer-grade EEG devices, and rapid advances in machine…

机器学习 · 计算机科学 2025-06-23 Tri Duc Ly , Gia H. Ngo