English
Related papers

Related papers: From Affect to Complex Behavior: Advancing Multimo…

200 papers

In recent years, deep learning has achieved innovative advancements in various fields, including the analysis of human emotions and behaviors. Initiatives such as the Affective Behavior Analysis in-the-wild (ABAW) competition have been…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Seongjae Min , Junseok Yang , Sangjun Lim , Junyong Lee , Sangwon Lee , Sejoon Lim

This paper describes the proposed methodology, data used and the results of our participation in the ChallengeTrack 2 (Expr Challenge Track) of the Affective Behavior Analysis in-the-wild (ABAW) Competition 2020. In this competition, we…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Hafiq Anas , Bacha Rehman , Wee Hong Ong

This book provides a comprehensive exploration of affective computing and human-computer interaction technologies. It begins with the historical development and basic concepts of human-computer interaction, delving into the technical…

Human-Computer Interaction · Computer Science 2025-06-19 Changzeng Fu

The increasing integration of machine learning algorithms in daily life underscores the critical need for fairness and equity in their deployment. As these technologies play a pivotal role in decision-making, addressing biases across…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Guanyu Hu , Eleni Papadopoulou , Dimitrios Kollias , Paraskevi Tzouveli , Jie Wei , Xinyu Yang

Affective computing plays a key role in human-computer interactions, entertainment, teaching, safe driving, and multimedia integration. Major breakthroughs have been made recently in the areas of affective computing (i.e., emotion…

Multimedia · Computer Science 2022-03-22 Yan Wang , Wei Song , Wei Tao , Antonio Liotta , Dawei Yang , Xinlei Li , Shuyong Gao , Yixuan Sun , Weifeng Ge , Wei Zhang , Wenqiang Zhang

Automatic human affect recognition is a key step towards more natural human-computer interaction. Recent trends include recognition in the wild using a fusion of audiovisual and physiological sensors, a challenging setting for conventional…

Machine Learning · Computer Science 2019-01-11 Philipp V. Rouast , Marc T. P. Adam , Raymond Chiong

The importance of automated Facial Emotion Recognition (FER) grows the more common human-machine interactions become, which will only continue to increase dramatically with time. A common method to describe human sentiment or feeling is the…

Computer Vision and Pattern Recognition · Computer Science 2019-11-14 Carl Norman

Affective Computing (AC) integrates computer science, psychology, and cognitive science to enable machines to recognize, interpret, and simulate human emotions across domains such as social media, finance, healthcare, and education. AC…

Computation and Language · Computer Science 2025-09-09 Yiqun Zhang , Xiaocui Yang , Xingle Xu , Zeran Gao , Yijie Huang , Shiyi Mu , Shi Feng , Daling Wang , Yifei Zhang , Kaisong Song , Ge Yu

Recent advances in neurosciences and psychology have provided evidence that affective phenomena pervade intelligence at many levels, being inseparable from the cognitionaction loop. Perception, attention, memory, learning, decisionmaking,…

Artificial Intelligence · Computer Science 2008-09-30 Luis Paulo Reis , Daria Barteneva , Nuno Lau

Previous studies regarding the perception of emotions for embodied virtual agents have shown the effectiveness of using virtual characters in conveying emotions through interactions with humans. However, creating an autonomous embodied…

Human-Computer Interaction · Computer Science 2023-12-08 Che-Jui Chang , Samuel S. Sohn , Sen Zhang , Rajath Jayashankar , Muhammad Usman , Mubbasir Kapadia

In this paper, we present our solutions for the 5th Workshop and Competition on Affective Behavior Analysis in-the-wild (ABAW), which includes four sub-challenges of Valence-Arousal (VA) Estimation, Expression (Expr) Classification, Action…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Ziyang Zhang , Liuwei An , Zishun Cui , Ao xu , Tengteng Dong , Yueqi Jiang , Jingyi Shi , Xin Liu , Xiao Sun , Meng Wang

In this paper, we describe the results of the HSEmotion team in two tasks of the seventh Affective Behavior Analysis in-the-wild (ABAW) competition, namely, multi-task learning for simultaneous prediction of facial expression, valence,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Andrey V. Savchenko

Facial expression recognition (FER) in the wild is crucial for building reliable human-computer interactive systems. However, annotations of large scale datasets in FER has been a key challenge as these datasets suffer from noise due to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Darshan Gera , S Balasubramanian

Emotional Mimicry Intensity (EMI) estimation plays a pivotal role in understanding human social behavior and advancing human-computer interaction. The core challenges lie in dynamic correlation modeling and robust fusion of multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Jun Yu , Lingsi Zhu , Yanjun Chi , Yunxiang Zhang , Yang Zheng , Yongqi Wang , Xilong Lu

Facial Expression Recognition (FER) plays a crucial role in human affective analysis and has been widely applied in computer vision tasks such as human-computer interaction and psychological assessment. The 8th Affective Behavior Analysis…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 JunGyu Lee , Kunyoung Lee , Haesol Park , Ig-Jae Kim , Gi Pyo Nam

In this paper, we propose a new automatic Action Units (AUs) recognition method used in a competition, Affective Behavior Analysis in-the-wild (ABAW). Our method tackles a problem of AUs label inconsistency among subjects by using pairwise…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Junya Saito , Ryosuke Kawamura , Akiyoshi Uchida , Sachihiro Youoku , Yuushi Toyoda , Takahisa Yamamoto , Xiaoyu Mi , Kentaro Murase

The emotion recognition has attracted more attention in recent decades. Although significant progress has been made in the recognition technology of the seven basic emotions, existing methods are still hard to tackle compound emotion…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Sunan Li , Hailun Lian , Cheng Lu , Yan Zhao , Tianhua Qi , Hao Yang , Yuan Zong , Wenming Zheng

Affective judgment in real interaction is rarely a purely local prediction problem. Emotional meaning often depends on prior trajectory, accumulated context, and multimodal evidence that may be weak, noisy, or incomplete at the current…

Artificial Intelligence · Computer Science 2026-03-25 Deliang Wen , Ke Sun , Yu Wang

Facial expression recognition(FER) in the wild is crucial for building reliable human-computer interactive systems. However, current FER systems fail to perform well under various natural and un-controlled conditions. This report presents…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Darshan Gera , S Balasubramanian

In this paper, we present our contribution to ABAW facial expression challenge. We report the proposed system and the official challenge results adhering to the challenge protocol. Using end-to-end deep learning and benefiting from transfer…

Machine Learning · Computer Science 2020-11-03 Denis Dresvyanskiy , Elena Ryumina , Heysem Kaya , Maxim Markitantov , Alexey Karpov , Wolfgang Minker