English
Related papers

Related papers: From Affect to Complex Behavior: Advancing Multimo…

200 papers

Affective computing has made significant strides in emotion recognition and generation, yet current approaches mainly focus on short-term pattern recognition and lack a comprehensive framework to guide affective agents toward long-term…

Human-Computer Interaction · Computer Science 2025-02-26 Bin Yin , Chong-Yi Liu , Liya Fu , Jinkun Zhang

We participated in the 10th ABAW Challenge, focusing on the Emotional Mimicry Intensity (EMI) Estimation track on the Hume-Vidmimic2 dataset. This task aims to predict six continuous emotion dimensions: Admiration, Amusement, Determination,…

Artificial Intelligence · Computer Science 2026-03-17 Jiawen Huang , Chenxi Huang , Zhuofan Wen , Hailiang Yao , Shun Chen , Longjiang Yang , Cong Yu , Fengyu Zhang , Ran Liu , Bin Liu

This paper presents our submission to the Expression Classification Challenge of the fifth Affective Behavior Analysis in-the-wild (ABAW) Competition. In our method, multimodal feature combinations extracted by several different pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Chuanhe Liu , Xinjie Zhang , Xiaolong Liu , Tenggan Zhang , Liyu Meng , Yuchen Liu , Yuanyuan Deng , Wenqiang Jiang

This paper presents our system for the Multi-Task Learning (MTL) Challenge in the 4th Affective Behavior Analysis in-the-wild (ABAW) competition. We explore the research problems of this challenge from three aspects: 1) For obtaining…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Tenggan Zhang , Chuanhe Liu , Xiaolong Liu , Yuchen Liu , Liyu Meng , Lei Sun , Wenqiang Jiang , Fengyuan Zhang , Jinming Zhao , Qin Jin

Multimodal affective computing, learning to recognize and interpret human affects and subjective information from multiple data sources, is still challenging because: (i) it is hard to extract informative features to represent human affects…

Computation and Language · Computer Science 2018-05-23 Yue Gu , Kangning Yang , Shiyu Fu , Shuhong Chen , Xinyu Li , Ivan Marsic

Ambivalence/hesitancy recognition in unconstrained videos is a challenging problem due to the subtle, multimodal, and context-dependent nature of this behavioral state. In this paper, a multimodal approach for video-level…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Elena Ryumina , Alexandr Axyonov , Dmitry Sysoev , Timur Abdulkadirov , Kirill Almetov , Yulia Morozova , Dmitry Ryumin

In this article, the results of our team for the fifth Affective Behavior Analysis in-the-wild (ABAW) competition are presented. The usage of the pre-trained convolutional networks from the EmotiEffNet family for frame-level feature…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Andrey V. Savchenko

The development of agents with emotional intelligence is becoming increasingly vital due to their significant role in human-computer interaction and the growing integration of computer systems across various sectors of society. Affective…

Human-Computer Interaction · Computer Science 2026-05-05 Raziyeh Zall , Alireza Kheyrkhah , Erik Cambria , Zahra Naseri , M. Reza Kangavari

The ability to represent emotion plays a significant role in human cognition and social interaction, yet the high-dimensional geometry of this affective space and its neural underpinnings remain debated. A key challenge, the…

Human-Computer Interaction · Computer Science 2025-09-30 Changde Du , Yizhuo Lu , Zhongyu Huang , Yi Sun , Zisen Zhou , Shaozheng Qin , Huiguang He

As we exceed upon the procedures for modelling the different aspects of behaviour, expression recognition has become a key field of research in Human Computer Interactions. Expression recognition in the wild is a very interesting problem…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-03 Sowmya Rasipuram , Junaid Hamid Bhat , Anutosh Maitra

This paper describes a novel method for building affectively intelligent human-interactive agents. The method is based on a key sociological insight that has been developed and extensively verified over the last twenty years, but has yet to…

Human-Computer Interaction · Computer Science 2015-10-23 Jesse Hoey , Tobias Schroeder , Areej Alhothali

Automatic understanding of human affect using visual signals is a problem that has attracted significant interest over the past 20 years. However, human emotional states are quite complex. To appraise such states displayed in real-world…

Computer Vision and Pattern Recognition · Computer Science 2019-12-17 Dimitrios Kollias , Stefanos Zafeiriou

In our multicultural world, affect-aware AI systems that support humans need the ability to perceive affect across variations in emotion expression patterns across cultures. These systems must perform well in cultural contexts without…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Leena Mathur , Ralph Adolphs , Maja J Matarić

In recent years, the use of bio-sensing signals such as electroencephalogram (EEG), electrocardiogram (ECG), etc. have garnered interest towards applications in affective computing. The parallel trend of deep-learning has led to a huge leap…

Machine Learning · Computer Science 2019-05-20 Siddharth Siddharth , Tzyy-Ping Jung , Terrence J. Sejnowski

Human affective behavior analysis plays a vital role in human-computer interaction (HCI) systems. In this paper, we introduce our submission to the CVPR 2023 Competition on Affective Behavior Analysis in-the-wild (ABAW). We propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Jun Yu , Renda Li , Zhongpeng Cai , Gongpeng Zhao , Guochen Xie , Jichao Zhu , Wangyuan Zhu

The presence of artificial agents in human social networks is growing. From chatbots to robots, human experience in the developed world is moving towards a socio-technical system in which agents can be technological or biological, with…

Artificial Intelligence · Computer Science 2019-09-04 Jesse Hoey , Neil J. MacKinnon

Emotions have a major interactive role in defining how humans interact with their environment by encoding their perception to external events and accordingly, influencing their cognition and decision-making process. Therefore, increasing…

Human-Computer Interaction · Computer Science 2021-03-30 Mustaffa Alfatlawi

Analysis of human affect plays a vital role in human-computer interaction (HCI) systems. Due to the difficulty in capturing large amounts of real-life data, most of the current methods have mainly focused on controlled environments, which…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Jun Yu , Zhongpeng Cai , Peng He , Guocheng Xie , Qiang Ling

Affective reactions have deep biological foundations, however in humans the development of emotion concepts is also shaped by language and higher-order cognition. A recent breakthrough in AI has been the creation of multimodal language…

Human-Computer Interaction · Computer Science 2025-07-29 Zaira Romeo , Alberto Testolin

Automated emotion recognition has applications in various fields, such as human-machine interaction, healthcare, security, education, and emotion-aware recommendation/feedback systems. Developing methods to analyze human emotions accurately…

Systems and Control · Electrical Eng. & Systems 2024-09-11 Ruijie Fang , Ruoyu Zhang , Elahe Hosseini , Chongzhou Fang , Mahdi Eslaminehr , Setareh Rafatirad , Houman Homayoun
‹ Prev 1 3 4 5 6 7 10 Next ›