English
Related papers

Related papers: From Affect to Complex Behavior: Advancing Multimo…

200 papers

In recent years, transformer architecture has been a dominating paradigm in many applications, including affective computing. In this report, we propose our transformer-based model to handle Emotion Classification Task in the 5th Affective…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Dang-Khanh Nguyen , Ngoc-Huynh Ho , Sudarshan Pant , Hyung-Jeong Yang

In the contemporary era of intelligent connectivity, Affective Computing (AC), which enables systems to recognize, interpret, and respond to human behavior states, has become an integrated part of many AI systems. As one of the most…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Xinyu Li , Marwa Mahmoud

Human behavior expression and experience are inherently multi-modal, and characterized by vast individual and contextual heterogeneity. To achieve meaningful human-computer and human-robot interactions, multi-modal models of the users…

Machine Learning · Computer Science 2019-06-10 Ognjen Rudovic , Meiru Zhang , Bjorn Schuller , Rosalind W. Picard

In this study, we present our methodology for two tasks: the Emotional Mimicry Intensity (EMI) Estimation Challenge and the Behavioural Ambivalence/Hesitancy (BAH) Recognition Challenge, both conducted as part of the 8th Workshop and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Tobias Hallmen , Robin-Nico Kampa , Fabian Deuser , Norbert Oswald , Elisabeth André

Multimodal Emotion Recognition (MER) focuses on identifying and interpreting emotions from modality-compound inputs. Closely mirroring human cognitive processes in real-world environments, MER has drawn substantial attention from both…

Multimedia · Computer Science 2026-05-21 Hongrui Zhang , Daiqing Wu , Yangyang Li , Kuien Liu , Yuhui Wang , Yu Zhou , Sicheng Zhao

As machine learning approaches are increasingly used to augment human decision-making, eXplainable Artificial Intelligence (XAI) research has explored methods for communicating system behavior to humans. However, these approaches often fail…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Luke Guerdan , Alex Raymond , Hatice Gunes

The remarkable progress in Natural Language Processing (NLP) brought about by deep learning, particularly with the recent advent of large pre-trained neural language models, is brought into scrutiny as several studies began to discuss and…

Computation and Language · Computer Science 2023-01-25 Anoop K. , Manjary P. Gangan , Deepak P. , Lajish V. L

Among human affective behavior research, facial expression recognition research is improving in performance along with the development of deep learning. However, for improved performance, not only past images but also future images should…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Geesung Oh , Euiseok Jeong , Sejoon Lim

Multimodal emotion recognition is a challenging research area that aims to fuse different modalities to predict human emotion. However, most existing models that are based on attention mechanisms have difficulty in learning emotionally…

Computation and Language · Computer Science 2023-03-08 Zihan Zhao , Yu Wang , Yanfeng Wang

With the growing integration of human-computer interaction into everyday life, advances in machine learning have enabled systems to better perceive and respond to users' emotional states. Most existing affect recognition datasets focus on…

Machine Learning · Computer Science 2026-05-04 Karim Alghoul , Faisal Mohd , Fedwa Laamarti , Hussein Al Osman , Abdulmotaleb El Saddik

Multimodal Affective Computing (MAC) aims to recognize and interpret human emotions by integrating information from diverse modalities such as text, video, and audio. Recent advancements in Multimodal Large Language Models (MLLMs) have…

Artificial Intelligence · Computer Science 2025-08-05 Miaosen Luo , Jiesen Long , Zequn Li , Yunying Yang , Yuncheng Jiang , Sijie Mai

As the application of Embodied AI Agents in avatars, wearable devices, and robotic systems continues to deepen, their core research challenges have gradually shifted from physical environment interaction to the accurate understanding of…

Robotics · Computer Science 2026-01-07 Biyuan Liu , Daigang Xu , Lei Jiang , Wenjun Guo , Ping Chen

Affective Computing (AC) is essential in bridging the gap between human emotional experiences and machine understanding. Traditionally, AC tasks in natural language processing (NLP) have been approached through pipeline architectures, which…

Computation and Language · Computer Science 2025-06-03 Wenna Lai , Haoran Xie , Guandong Xu , Qing Li , S. Joe Qin

Emotions widely affect human decision-making. This fact is taken into account by affective computing with the goal of tailoring decision support to the emotional states of individuals. However, the accurate recognition of emotions within…

Computation and Language · Computer Science 2018-11-14 Bernhard Kratzwald , Suzana Ilic , Mathias Kraus , Stefan Feuerriegel , Helmut Prendinger

As conversational AI becomes capable of sustained, affectively responsive interaction, users may form bonds beyond instrumental use. Existing measures often adapt interpersonal frameworks or focus on specific relational outcomes, leaving…

Human-Computer Interaction · Computer Science 2026-05-29 Lu Chen , Xiaoran Xue , Rongqi Ding , Fenghua Tang , Anji Zhou , Chenxi Wang , Mengyu Miranda Gao , Zhuo Rachel Han

As Large Language Models (LLMs) evolve from code generators into collaborative partners for software engineers, our methods for evaluation are lagging. Current benchmarks, focused on code correctness, fail to capture the nuanced,…

Software Engineering · Computer Science 2026-01-01 Tao Dong , Harini Sampath , Ja Young Lee , Sherry Y. Shi , Andrew Macvean

This paper presents our Facial Action Units (AUs) detection submission to the fifth Affective Behavior Analysis in-the-wild Competition (ABAW). Our approach consists of three main modules: (i) a pre-trained facial representation encoder…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Zihan Wang , Siyang Song , Cheng Luo , Yuzhi Zhou , Shiling Wu , Weicheng Xie , Linlin Shen

As the name suggests, affective computing aims to recognize human emotions, sentiments, and feelings. There is a wide range of fields that study affective computing, including languages, sociology, psychology, computer science, and…

Artificial Intelligence · Computer Science 2023-05-16 Sitara Afzal , Haseeb Ali Khan , Imran Ullah Khan , Md. Jalil Piran , Jong Weon Lee

Scientific experimentation and manufacturing rely on prolonged protocol development and complex, multi-step implementation, which require continuous human expertise for precise execution and decision-making, limiting interpretability and…

Artificial Intelligence · Computer Science 2026-02-09 Xinyi Lin , Yuyang Zhang , Yuanhang Gan , Juntao Chen , Hao Shen , Yichun He , Lijun Li , Ze Yuan , Shuang Wang , Chaohao Wang , Rui Zhang , Na Li , Jia Liu

Affect recognition aims to detect a person's affective state based on observables, with the goal to e.g. provide reasoning for decision making or support mental wellbeing. Recently, besides approaches based on audio, visual or text…

Human-Computer Interaction · Computer Science 2018-11-22 Philip Schmidt , Attila Reiss , Robert Duerichen , Kristof Van Laerhoven