中文
相关论文

相关论文: From Affect to Complex Behavior: Advancing Multimo…

200 篇论文

Affective computing has made significant strides in emotion recognition and generation, yet current approaches mainly focus on short-term pattern recognition and lack a comprehensive framework to guide affective agents toward long-term…

人机交互 · 计算机科学 2025-02-26 Bin Yin , Chong-Yi Liu , Liya Fu , Jinkun Zhang

We participated in the 10th ABAW Challenge, focusing on the Emotional Mimicry Intensity (EMI) Estimation track on the Hume-Vidmimic2 dataset. This task aims to predict six continuous emotion dimensions: Admiration, Amusement, Determination,…

人工智能 · 计算机科学 2026-03-17 Jiawen Huang , Chenxi Huang , Zhuofan Wen , Hailiang Yao , Shun Chen , Longjiang Yang , Cong Yu , Fengyu Zhang , Ran Liu , Bin Liu

This paper presents our submission to the Expression Classification Challenge of the fifth Affective Behavior Analysis in-the-wild (ABAW) Competition. In our method, multimodal feature combinations extracted by several different pre-trained…

计算机视觉与模式识别 · 计算机科学 2023-03-20 Chuanhe Liu , Xinjie Zhang , Xiaolong Liu , Tenggan Zhang , Liyu Meng , Yuchen Liu , Yuanyuan Deng , Wenqiang Jiang

This paper presents our system for the Multi-Task Learning (MTL) Challenge in the 4th Affective Behavior Analysis in-the-wild (ABAW) competition. We explore the research problems of this challenge from three aspects: 1) For obtaining…

计算机视觉与模式识别 · 计算机科学 2022-08-31 Tenggan Zhang , Chuanhe Liu , Xiaolong Liu , Yuchen Liu , Liyu Meng , Lei Sun , Wenqiang Jiang , Fengyuan Zhang , Jinming Zhao , Qin Jin

Multimodal affective computing, learning to recognize and interpret human affects and subjective information from multiple data sources, is still challenging because: (i) it is hard to extract informative features to represent human affects…

计算与语言 · 计算机科学 2018-05-23 Yue Gu , Kangning Yang , Shiyu Fu , Shuhong Chen , Xinyu Li , Ivan Marsic

Ambivalence/hesitancy recognition in unconstrained videos is a challenging problem due to the subtle, multimodal, and context-dependent nature of this behavioral state. In this paper, a multimodal approach for video-level…

计算机视觉与模式识别 · 计算机科学 2026-03-16 Elena Ryumina , Alexandr Axyonov , Dmitry Sysoev , Timur Abdulkadirov , Kirill Almetov , Yulia Morozova , Dmitry Ryumin

In this article, the results of our team for the fifth Affective Behavior Analysis in-the-wild (ABAW) competition are presented. The usage of the pre-trained convolutional networks from the EmotiEffNet family for frame-level feature…

计算机视觉与模式识别 · 计算机科学 2023-03-17 Andrey V. Savchenko

The development of agents with emotional intelligence is becoming increasingly vital due to their significant role in human-computer interaction and the growing integration of computer systems across various sectors of society. Affective…

人机交互 · 计算机科学 2026-05-05 Raziyeh Zall , Alireza Kheyrkhah , Erik Cambria , Zahra Naseri , M. Reza Kangavari

The ability to represent emotion plays a significant role in human cognition and social interaction, yet the high-dimensional geometry of this affective space and its neural underpinnings remain debated. A key challenge, the…

人机交互 · 计算机科学 2025-09-30 Changde Du , Yizhuo Lu , Zhongyu Huang , Yi Sun , Zisen Zhou , Shaozheng Qin , Huiguang He

As we exceed upon the procedures for modelling the different aspects of behaviour, expression recognition has become a key field of research in Human Computer Interactions. Expression recognition in the wild is a very interesting problem…

音频与语音处理 · 电气工程与系统科学 2020-03-03 Sowmya Rasipuram , Junaid Hamid Bhat , Anutosh Maitra

This paper describes a novel method for building affectively intelligent human-interactive agents. The method is based on a key sociological insight that has been developed and extensively verified over the last twenty years, but has yet to…

人机交互 · 计算机科学 2015-10-23 Jesse Hoey , Tobias Schroeder , Areej Alhothali

Automatic understanding of human affect using visual signals is a problem that has attracted significant interest over the past 20 years. However, human emotional states are quite complex. To appraise such states displayed in real-world…

计算机视觉与模式识别 · 计算机科学 2019-12-17 Dimitrios Kollias , Stefanos Zafeiriou

In our multicultural world, affect-aware AI systems that support humans need the ability to perceive affect across variations in emotion expression patterns across cultures. These systems must perform well in cultural contexts without…

计算机视觉与模式识别 · 计算机科学 2022-11-01 Leena Mathur , Ralph Adolphs , Maja J Matarić

In recent years, the use of bio-sensing signals such as electroencephalogram (EEG), electrocardiogram (ECG), etc. have garnered interest towards applications in affective computing. The parallel trend of deep-learning has led to a huge leap…

机器学习 · 计算机科学 2019-05-20 Siddharth Siddharth , Tzyy-Ping Jung , Terrence J. Sejnowski

Human affective behavior analysis plays a vital role in human-computer interaction (HCI) systems. In this paper, we introduce our submission to the CVPR 2023 Competition on Affective Behavior Analysis in-the-wild (ABAW). We propose a…

计算机视觉与模式识别 · 计算机科学 2023-03-21 Jun Yu , Renda Li , Zhongpeng Cai , Gongpeng Zhao , Guochen Xie , Jichao Zhu , Wangyuan Zhu

The presence of artificial agents in human social networks is growing. From chatbots to robots, human experience in the developed world is moving towards a socio-technical system in which agents can be technological or biological, with…

人工智能 · 计算机科学 2019-09-04 Jesse Hoey , Neil J. MacKinnon

Emotions have a major interactive role in defining how humans interact with their environment by encoding their perception to external events and accordingly, influencing their cognition and decision-making process. Therefore, increasing…

人机交互 · 计算机科学 2021-03-30 Mustaffa Alfatlawi

Analysis of human affect plays a vital role in human-computer interaction (HCI) systems. Due to the difficulty in capturing large amounts of real-life data, most of the current methods have mainly focused on controlled environments, which…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Jun Yu , Zhongpeng Cai , Peng He , Guocheng Xie , Qiang Ling

Affective reactions have deep biological foundations, however in humans the development of emotion concepts is also shaped by language and higher-order cognition. A recent breakthrough in AI has been the creation of multimodal language…

人机交互 · 计算机科学 2025-07-29 Zaira Romeo , Alberto Testolin

Automated emotion recognition has applications in various fields, such as human-machine interaction, healthcare, security, education, and emotion-aware recommendation/feedback systems. Developing methods to analyze human emotions accurately…

系统与控制 · 电气工程与系统科学 2024-09-11 Ruijie Fang , Ruoyu Zhang , Elahe Hosseini , Chongzhou Fang , Mahdi Eslaminehr , Setareh Rafatirad , Houman Homayoun