English
Related papers

Related papers: Interpretable Explainability in Facial Emotion Rec…

200 papers

Emotions play a critical role in our everyday lives by altering how we perceive, process and respond to our environment. Affective computing aims to instill in computers the ability to detect and act on the emotions of human actors. A core…

Computation and Language · Computer Science 2020-08-31 Connor T. Heaton , David M. Schwartz

We present a Fourier-based machine learning technique that characterizes and detects facial emotions. The main challenging task in the development of machine learning (ML) models for classifying facial emotions is the detection of accurate…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Aishwarya Gouru , Shan Suthaharan

Human emotion is expressed, perceived and captured using a variety of dynamic data modalities, such as speech (verbal), videos (facial expressions) and motion sensors (body gestures). We propose a generalized approach to emotion recognition…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 A. Shirian , S. Tripathi , T. Guha

Emotional understanding and generation are often treated as separate tasks, yet they are inherently complementary and can mutually enhance each other. In this paper, we propose the UniEmo, a unified framework that seamlessly integrates…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Yijie Zhu , Lingsen Zhang , Zitong Yu , Rui Shao , Tao Tan , Liqiang Nie

Emotion Recognition (ER) is the process of identifying human emotions from given data. Currently, the field heavily relies on facial expression recognition (FER) because facial expressions contain rich emotional cues. However, it is…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Yuanyuan Liu , Lin Wei , Kejun Liu , Yibing Zhan , Zijing Chen , Zhe Chen , Shiguang Shan

3D facial animation is often produced by manipulating facial deformation models (or rigs), that are traditionally parameterized by expression controls. A key component that is usually overlooked is expression 'style', as in, how a…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Lingchen Yang , Gaspard Zoss , Prashanth Chandran , Paulo Gotardo , Markus Gross , Barbara Solenthaler , Eftychios Sifakis , Derek Bradley

Facial analysis models are increasingly applied in real-world applications that have significant impact on peoples' lives. However, as literature has shown, models that automatically classify facial attributes might exhibit algorithmic…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Camila Kolling , Victor Araujo , Adriano Veloso , Soraia Raupp Musse

Daily monitoring of intra-personal facial changes associated with health and emotional conditions has great potential to be useful for medical, healthcare, and emotion recognition fields. However, the approach for capturing intra-personal…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Yusuke Akamatsu , Terumi Umematsu , Hitoshi Imaoka , Shizuko Gomi , Hideo Tsurushima

Artificial Intelligence (AI) algorithms, trained on emotion data extracted from physiological signals, provide a promising approach to monitoring emotions, affect, and mental well-being. However, the field encounters challenges because…

Human-Computer Interaction · Computer Science 2024-06-24 Pragya Singh , Mohan Kumar , Pushpendra Singh

Adaptive game systems aim to enrich player experiences by dynamically adjusting game content in response to user data. While extensive research has addressed content personalization and player experience modeling, the integration of these…

Human-Computer Interaction · Computer Science 2025-05-05 Phil Lopes , Nuno Fachada , Maria Fonseca

Traditional video-induced physiological datasets usually rely on whole-trial labels, which introduce temporal label noise in dynamic emotion recognition. We present FIRMED, a peak-centered multimodal dataset based on an immediate-recall…

Human-Computer Interaction · Computer Science 2026-04-01 Hao Tang , Songyun Xie , Xinzhou Xie , Can Liao , Bohan Li , Zhongyu Tian , Dalu Zheng

Emotion classifiers traditionally predict discrete emotions. However, emotion expressions are often subjective, thus requiring a method to handle subjective labels. We explore the use of crowdsourcing to acquire reliable soft-target labels…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Peter Washington , Onur Cezmi Mutlu , Emilie Leblanc , Aaron Kline , Cathy Hou , Brianna Chrisman , Nate Stockham , Kelley Paskov , Catalin Voss , Nick Haber , Dennis Wall

Trust and perceived safety play a crucial role in the public acceptance of automated vehicles. To understand perceived risk, an experiment was conducted using a driving simulator under two automated driving styles and optionally introducing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Abel van Elburg , Konstantinos Gkentsidis , Mathieu Sarrazin , Sarah Barendswaard , Varun Kotian , Riender Happee

The facial expression generation capability of humanoid social robots is critical for achieving natural and human-like interactions, playing a vital role in enhancing the fluidity of human-robot interactions and the accuracy of emotional…

Robotics · Computer Science 2025-10-28 Yongtong Zhu , Lei Li , Iggy Qian , WenBin Zhou , Ye Yuan , Qingdu Li , Na Liu , Jianwei Zhang

The ability to accurately capture and express emotions is a critical aspect of creating believable characters in video games and other forms of entertainment. Traditionally, this animation has been achieved with artistic effort or…

Graphics · Computer Science 2023-07-19 Jack Saunders , Steven Caulkin , Vinay Namboodiri

Faces and their expressions are one of the potent subjects for digital images. Detecting emotions from images is an ancient task in the field of computer vision; however, performing its reverse -- synthesizing facial expressions from images…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Mohammad Imrul Jubair , Md. Masud Rana , Md. Amir Hamza , Mohsena Ashraf , Fahim Ahsan Khan , Ahnaf Tahseen Prince

Talking Face Generation (TFG) strives to create realistic and emotionally expressive digital faces. While previous TFG works have mastered the creation of naturalistic facial movements, they typically express a fixed target emotion in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Hao Yang , Yanyan Zhao , Tian Zheng , Hongbo Zhang , Bichen Wang , Di Wu , Xing Fu , Xuda Zhi , Yongbo Huang , Hao He

Facial emotion recognition is a vast and complex problem space within the domain of computer vision and thus requires a universally accepted baseline method with which to evaluate proposed models. While test datasets have served this…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Nyle Siddiqui , Rushit Dave , Tyler Bauer , Thomas Reither , Dylan Black , Mitchell Hanson

Understanding affect is central to anticipating human behavior, yet current egocentric vision benchmarks largely ignore the person's emotional states that shape their decisions and actions. Existing tasks in egocentric perception focus on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Matthias Jammot , Björn Braun , Paul Streli , Rafael Wampfler , Christian Holz

Emotion analysis in texts suffers from two major limitations: annotated gold-standard corpora are mostly small and homogeneous, and emotion identification is often simplified as a sentence-level classification problem. To address these…

Computation and Language · Computer Science 2022-10-12 Gustave Cortal , Alain Finkel , Patrick Paroubek , Lina Ye