English
Related papers

Related papers: Two-Aspect Information Fusion Model For ABAW4 Mult…

200 papers

Human affective recognition is an important factor in human-computer interaction. However, the method development with in-the-wild data is not yet accurate enough for practical usage. In this paper, we introduce the affective recognition…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Sachihiro Youoku , Yuushi Toyoda , Takahisa Yamamoto , Junya Saito , Ryosuke Kawamura , Xiaoyu Mi , Kentaro Murase

Human emotions recognization contributes to the development of human-computer interaction. The machines understanding human emotions in the real world will significantly contribute to life in the future. This paper will introduce the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Hong-Hai Nguyen , Van-Thong Huynh , Soo-Hyung Kim

Human emotion recognition plays an important role in human-computer interaction. In this paper, we present our approach to the Valence-Arousal (VA) Estimation Challenge, Expression (Expr) Classification Challenge, and Action Unit (AU)…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Weiwei Zhou , Jiada Lu , Zhaolong Xiong , Weifeng Wang

Multi-task learning (MTL) can advance assistive driving by exploring inter-task correlations through shared representations. However, existing methods face two critical limitations: single-modality constraints limiting comprehensive scene…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Wenzhuo Liu , Yicheng Qiao , Zhen Wang , Qiannan Guo , Zilong Chen , Meihua Zhou , Xinran Li , Letian Wang , Zhiwei Li , Huaping Liu , Wenshuo Wang

Facial Action Coding System is an approach for modeling the complexity of human emotional expression. Automatic action unit (AU) detection is a crucial research area in human-computer interaction. This paper describes our submission to the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Duy Le Hoai , Eunchae Lim , Eunbin Choi , Sieun Kim , Sudarshan Pant , Guee-Sang Lee , Soo-Huyng Kim , Hyung-Jeong Yang

Analysis of human affect plays a vital role in human-computer interaction (HCI) systems. Due to the difficulty in capturing large amounts of real-life data, most of the current methods have mainly focused on controlled environments, which…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Jun Yu , Zhongpeng Cai , Peng He , Guocheng Xie , Qiang Ling

We used two multimodal models for continuous valence-arousal recognition using visual, audio, and linguistic information. The first model is the same as we used in ABAW2 and ABAW3, which employs the leader-follower attention. The second…

Multimedia · Computer Science 2023-04-18 Su Zhang , Ziyuan Zhao , Cuntai Guan

Emotional Mimicry Intensity (EMI) estimation plays a pivotal role in understanding human social behavior and advancing human-computer interaction. The core challenges lie in dynamic correlation modeling and robust fusion of multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Jun Yu , Lingsi Zhu , Yanjun Chi , Yunxiang Zhang , Yang Zheng , Yongqi Wang , Xilong Lu

Emotional Reaction Intensity(ERI) estimation is an important task in multimodal scenarios, and has fundamental applications in medicine, safe driving and other fields. In this paper, we propose a solution to the ERI challenge of the fifth…

Artificial Intelligence · Computer Science 2023-03-17 Jun Yu , Jichao Zhu , Wangyuan Zhu , Zhongpeng Cai , Guochen Xie , Renda Li , Gongpeng Zhao

Isolated facial movements, so-called Action Units, can describe combined emotions or physical states such as pain. As datasets are limited and mostly imbalanced, we present an approach incorporating a multi-label class balancing algorithm.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Jaspar Pahl , Ines Rieger , Dominik Seuss

The fifth Affective Behavior Analysis in-the-wild (ABAW) competition has multiple challenges such as Valence-Arousal Estimation Challenge, Expression Classification Challenge, Action Unit Detection Challenge, Emotional Reaction Intensity…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Darshan Gera , Badveeti Naveen Siva Kumar , Bobbili Veerendra Raj Kumar , S Balasubramanian

For computers to recognize human emotions, expression classification is an equally important problem in the human-computer interaction area. In the 3rd Affective Behavior Analysis In-The-Wild competition, the task of expression…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Kim Ngan Phan , Hong-Hai Nguyen , Van-Thong Huynh , Soo-Hyung Kim

In recent years, transformer architecture has been a dominating paradigm in many applications, including affective computing. In this report, we propose our transformer-based model to handle Emotion Classification Task in the 5th Affective…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Dang-Khanh Nguyen , Ngoc-Huynh Ho , Sudarshan Pant , Hyung-Jeong Yang

Facial expression recognition is a challenging classification task that holds broad application prospects in the field of human-computer interaction. This paper aims to introduce the method we will adopt in the 8th Affective and Behavioral…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Jun Yu , Yang Zheng , Lei Wang , Yongqi Wang , Shengfan Xu

Environmental sound analysis is currently getting more and more attentions. In the domain, acoustic scene classification and acoustic event classification are two closely related tasks. In this letter, a two-stage method is proposed for the…

Sound · Computer Science 2021-03-31 Weiping Zheng , Dacan Jiang , Gansen Zhao

Automatic affect recognition has applications in many areas such as education, gaming, software development, automotives, medical care, etc. but it is non trivial task to achieve appreciable performance on in-the-wild data sets. In-the-wild…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Darshan Gera , Badveeti Naveen Siva Kumar , Bobbili Veerendra Raj Kumar , S Balasubramanian

This paper addresses the expression (EXPR) recognition challenge in the 10th Affective Behavior Analysis in-the-Wild (ABAW) workshop and competition, which requires frame-level classification of eight facial emotional expressions from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Jiajun Sun , Zhe Gao

The integration of information across multiple modalities and across time is a promising way to enhance the emotion recognition performance of affective systems. Much previous work has focused on instantaneous emotion recognition. The 2018…

Image and Video Processing · Electrical Eng. & Systems 2018-05-07 Didan Deng , Yuqian Zhou , Jimin Pi , Bertram E. Shi

Aspect-based sentiment analysis produces a list of aspect terms and their corresponding sentiments for a natural language sentence. This task is usually done in a pipeline manner, with aspect term extraction performed first, followed by…

Computation and Language · Computer Science 2019-06-18 Ruidan He , Wee Sun Lee , Hwee Tou Ng , Daniel Dahlmeier

As we exceed upon the procedures for modelling the different aspects of behaviour, expression recognition has become a key field of research in Human Computer Interactions. Expression recognition in the wild is a very interesting problem…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-03 Sowmya Rasipuram , Junaid Hamid Bhat , Anutosh Maitra