English
Related papers

Related papers: Robust Light-Weight Facial Affective Behavior Reco…

200 papers

Attention mechanism has recently attracted increasing attentions in the field of facial action unit (AU) detection. By finding the region of interest of each AU with the attention mechanism, AU-related local features can be captured. Most…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Zhiwen Shao , Zhilei Liu , Jianfei Cai , Yunsheng Wu , Lizhuang Ma

Facial Expression Recognition (FER) is a critical task within computer vision with diverse applications across various domains. Addressing the challenge of limited FER datasets, which hampers the generalization capability of expression…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Bach Nguyen-Xuan , Thien Nguyen-Hoang , Thanh-Huy Nguyen , Nhu Tai-Do

This paper details the methodology and results of the EmotioNet challenge. This challenge is the first to test the ability of computer vision algorithms in the automatic analysis of a large number of images of facial expressions of emotion…

Computer Vision and Pattern Recognition · Computer Science 2017-03-06 C. Fabian Benitez-Quiroz , Ramprakash Srinivasan , Qianli Feng , Yan Wang , Aleix M. Martinez

Since Facial Action Unit (AU) annotations require domain expertise, common AU datasets only contain a limited number of subjects. As a result, a crucial challenge for AU detection is addressing identity overfitting. We find that AUs and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Zhipeng Hu , Wei Zhang , Lincheng Li , Yu Ding , Wei Chen , Zhigang Deng , Xin Yu

Analyzing human affect is vital for human-computer interaction systems. Most methods are developed in restricted scenarios which are not practical for in-the-wild settings. The Affective Behavior Analysis in-the-wild (ABAW) 2021 Contest…

Computer Vision and Pattern Recognition · Computer Science 2021-07-16 Yue Jin , Tianqing Zheng , Chao Gao , Guoqiang Xu

Temporal context is key to the recognition of expressions of emotion. Existing methods, that rely on recurrent or self-attention models to enforce temporal consistency, work on the feature level, ignoring the task-specific temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Enrique Sanchez , Mani Kumar Tellamekala , Michel Valstar , Georgios Tzimiropoulos

Multimodal emotion recognition (MER) aims to identify human emotions by combining data from various modalities such as language, audio, and vision. Despite the recent advances of MER approaches, the limitations in obtaining extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yehun Song , Sunyoung Cho

Affective computing and cognitive theory are widely used in modern human-computer interaction scenarios. Human faces, as the most prominent and easily accessible features, have attracted great attention from researchers. Since humans have…

Computer Vision and Pattern Recognition · Computer Science 2020-01-20 Wenxuan Wang , Yanwei Fu , Qiang Sun , Tao Chen , Chenjie Cao , Ziqi Zheng , Guoqiang Xu , Han Qiu , Yu-Gang Jiang , Xiangyang Xue

Affective computing plays a key role in human-computer interactions, entertainment, teaching, safe driving, and multimedia integration. Major breakthroughs have been made recently in the areas of affective computing (i.e., emotion…

Multimedia · Computer Science 2022-03-22 Yan Wang , Wei Song , Wei Tao , Antonio Liotta , Dawei Yang , Xinlei Li , Shuyong Gao , Yixuan Sun , Weifeng Ge , Wei Zhang , Wenqiang Zhang

Facial Action Coding System is an important approach of facial expression analysis.This paper describes our submission to the third Affective Behavior Analysis (ABAW) 2022 competition. We proposed a transfomer based model to detect facial…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Lingfeng Wang , Shisen Wang , Jin Qi

Facial valence/arousal, expression and action unit are related tasks in facial affective analysis. However, the tasks only have limited performance in the wild due to the various collected conditions. The 4th competition on affective…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Yanan Chang , Yi Wu , Xiangyu Miao , Jiahe Wang , Shangfei Wang

Automatic understanding of human affect using visual signals is a problem that has attracted significant interest over the past 20 years. However, human emotional states are quite complex. To appraise such states displayed in real-world…

Computer Vision and Pattern Recognition · Computer Science 2019-12-17 Dimitrios Kollias , Stefanos Zafeiriou

The ability to recognize and interpret facial emotions is a critical component of human communication, as it allows individuals to understand and respond to emotions conveyed through facial expressions and vocal tones. The recognition of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Arpita Vats , Aman Chadha

The Facial Action Coding System (FACS) has been used by numerous studies to investigate the links between facial behavior and mental health. The laborious and costly process of FACS coding has motivated the development of machine learning…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Evangelos Sariyanidi , Lisa Yankowitz , Robert T. Schultz , John D. Herrington , Birkan Tunc , Jeffrey Cohn

Affective computing is a field of great interest in many computer vision applications, including video surveillance, behaviour analysis, and human-robot interaction. Most of the existing literature has addressed this field by analysing…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Danilo Avola , Luigi Cinque , Alessio Fagioli , Gian Luca Foresti , Cristiano Massaroni

Video content is rich in semantics and has the ability to evoke various emotions in viewers. In recent years, with the rapid development of affective computing and the explosive growth of visual data, affective video content analysis (AVCA)…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Junxiao Xue , Jie Wang , Xuecheng Wu , Qian Zhang

Multimodal sentiment analysis, a pivotal task in affective computing, seeks to understand human emotions by integrating cues from language, audio, and visual signals. While many recent approaches leverage complex attention mechanisms and…

Computation and Language · Computer Science 2025-05-09 Nischal Mandal , Yang Li

In this paper we address the problem of multi-cue affect recognition in challenging scenarios such as child-robot interaction. Towards this goal we propose a method for automatic recognition of affect that leverages body expressions…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Panagiotis P. Filntisis , Niki Efthymiou , Petros Koutras , Gerasimos Potamianos , Petros Maragos

The detection of facial action units (AUs) has been studied as it has the competition due to the wide-ranging applications thereof. In this paper, we propose a novel framework for the AU detection from a single input image by grasping the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Ziqiang Shi , Liu Liu , Zhongling Liu , Rujie Liu , Xiaoyu Mi , and Kentaro Murase

Compound Expression Recognition (CER) is vital for effective interpersonal interactions. Human emotional expressions are inherently complex due to the presence of compound expressions, requiring the consideration of both local and global…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Xuxiong Liu , Kang Shen , Jun Yao , Boyan Wang , Minrui Liu , Liuwei An , Zishun Cui , Weijie Feng , Xiao Sun