English
Related papers

Related papers: xTrace: A Facial Expressive Behaviour Analysis Too…

200 papers

Automated deception detection systems can enhance health, justice, and security in society by helping humans detect deceivers in high-stakes situations across medical and legal domains, among others. This paper presents a novel analysis of…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Leena Mathur , Maja J Matarić

In this paper, we present our solutions for the 5th Workshop and Competition on Affective Behavior Analysis in-the-wild (ABAW), which includes four sub-challenges of Valence-Arousal (VA) Estimation, Expression (Expr) Classification, Action…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Ziyang Zhang , Liuwei An , Zishun Cui , Ao xu , Tengteng Dong , Yueqi Jiang , Jingyi Shi , Xin Liu , Xiao Sun , Meng Wang

As one of the most important affective signals, facial affect analysis (FAA) is essential for developing human-computer interaction systems. Early methods focus on extracting appearance and geometry features associated with human affects…

Computer Vision and Pattern Recognition · Computer Science 2022-02-14 Yang Liu , Xingming Zhang , Yante Li , Jinzhao Zhou , Xin Li , Guoying Zhao

Automatic machine-based Facial Expression Analysis (FEA) has made substantial progress in the past few decades driven by its importance for applications in psychology, security, health, entertainment and human computer interaction. The vast…

Computer Vision and Pattern Recognition · Computer Science 2018-02-27 Ligang Zhang , Brijesh Verma , Dian Tjondronegoro , Vinod Chandran

Video-based facial affect analysis has recently attracted increasing attention owing to its critical role in human-computer interaction. Previous studies mainly focus on developing various deep learning architectures and training them in a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Licai Sun , Zheng Lian , Kexin Wang , Yu He , Mingyu Xu , Haiyang Sun , Bin Liu , Jianhua Tao

Eye-based information channels include the pupils, gaze, saccades, fixational movements, and numerous forms of eye opening and closure. Pupil size variation indicates cognitive load and emotion, while a person's gaze direction is said to be…

Human-Computer Interaction · Computer Science 2020-01-24 Jonny O'Dwyer , Niall Murray , Ronan Flynn

Traditional psychological evaluations rely heavily on human observation and interpretation, which are prone to subjectivity, bias, fatigue, and inconsistency. To address these limitations, this work presents a multimodal emotion recognition…

Human-Computer Interaction · Computer Science 2024-12-25 Kris Kraack

In recent years, there has been increasing interest in automatic facial behavior analysis systems from computing communities such as vision, multimodal interaction, robotics, and affective computing. Building upon the widespread utility of…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Jiewen Hu , Leena Mathur , Paul Pu Liang , Louis-Philippe Morency

EXplainable Artificial Intelligence (XAI) approaches are widely applied for identifying fairness issues in Artificial Intelligence (AI) systems. However, in the context of facial analysis, existing XAI approaches, such as pixel attribution…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Ioannis Sarridis , Christos Koutlis , Symeon Papadopoulos , Christos Diou

The Facial Action Coding System (FACS) has been used by numerous studies to investigate the links between facial behavior and mental health. The laborious and costly process of FACS coding has motivated the development of machine learning…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Evangelos Sariyanidi , Lisa Yankowitz , Robert T. Schultz , John D. Herrington , Birkan Tunc , Jeffrey Cohn

Facial emotion recognition is the task to classify human emotions in face images. It is a difficult task due to high aleatoric uncertainty and visual ambiguity. A large part of the literature aims to show progress by increasing accuracy on…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Maryam Matin , Matias Valdenegro-Toro

We present X-Avatar, a novel avatar model that captures the full expressiveness of digital humans to bring about life-like experiences in telepresence, AR/VR and beyond. Our method models bodies, hands, facial expressions and appearance in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Kaiyue Shen , Chen Guo , Manuel Kaufmann , Juan Jose Zarate , Julien Valentin , Jie Song , Otmar Hilliges

A person's face discloses important information about their affective state. Although there has been extensive research on recognition of facial expressions, the performance of existing approaches is challenged by facial occlusions. Facial…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Behnaz Nojavanasghari , Charles. E. Hughes , Tadas Baltrusaitis , Louis-philippe Morency

The quantification of visual affect data (e.g. face images) is essential to build and monitor automated affect modeling systems efficiently. Considering this, this work proposes quantified facial Temporal-expressiveness Dynamics (TED) to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-29 Md Taufeeq Uddin , Shaun Canavan

Detecting concealed emotions within apparently normal expressions is crucial for identifying potential mental health issues and facilitating timely support and intervention. The task of spotting macro and micro-expressions involves…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Pei-Sze Tan , Sailaja Rajanala , Arghya Pal , Raphaël C. -W. Phan , Huey-Fang Ong

Recently audio-driven talking face video generation has attracted considerable attention. However, very few researches address the issue of emotional editing of these talking face videos with continuously controllable expressions, which is…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Zhiyao Sun , Yu-Hui Wen , Tian Lv , Yanan Sun , Ziyang Zhang , Yaoyuan Wang , Yong-Jin Liu

In our everyday lives and social interactions we often try to perceive the emotional states of people. There has been a lot of research in providing machines with a similar capacity of recognizing emotions. From a computer vision…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Ronak Kosti , Jose M. Alvarez , Adria Recasens , Agata Lapedriza

Emotion recognition using digital image processing is a multifarious task because facial emotions depend on warped facial features as well as on gender, age, and culture. Furthermore, there are several factors such as varied illumination…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Aasma Aslam , Babar Hussian

Affective computing has recently gained popularity, especially in the field of human-computer interaction systems, where effectively evoking and detecting emotions is of paramount importance to enhance users experience. However, several…

Human-Computer Interaction · Computer Science 2024-07-15 S. M. Hossein Mousavi , Matteo Besenzoni , Davide Andreoletti , Achille Peternier , Silvia Giordano

The use of deep learning techniques for automatic facial expression recognition has recently attracted great interest but developed models are still unable to generalize well due to the lack of large emotion datasets for deep learning. To…

Computer Vision and Pattern Recognition · Computer Science 2018-05-28 Dung Nguyen , Kien Nguyen , Sridha Sridharan , Iman Abbasnejad , David Dean , Clinton Fookes