English
Related papers

Related papers: From Affect to Complex Behavior: Advancing Multimo…

200 papers

Human emotions recognization contributes to the development of human-computer interaction. The machines understanding human emotions in the real world will significantly contribute to life in the future. This paper will introduce the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Hong-Hai Nguyen , Van-Thong Huynh , Soo-Hyung Kim

The EmoPain 2020 Challenge is the first international competition aimed at creating a uniform platform for the comparison of machine learning and multimedia processing methods of automatic chronic pain assessment from human expressive…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Joy O. Egede , Siyang Song , Temitayo A. Olugbade , Chongyang Wang , Amanda Williams , Hongying Meng , Min Aung , Nicholas D. Lane , Michel Valstar , Nadia Bianchi-Berthouze

Existing affective-computing, social-signal-processing, and meeting corpora capture important parts of human interaction, but they rarely support analysis of affect in co-located groups as a coupled individual, interpersonal, and…

In recent years, the affective computing (AC) and human-robot interaction (HRI) research communities have put fairness at the centre of their research agenda. However, none of the existing work has addressed the problem of machine learning…

Robotics · Computer Science 2024-07-03 Jiaee Cheong , Micol Spitale , Hatice Gunes

The 2026 ACII Dyadic Conversations (ACII-DaiKon) Workshop & Challenge introduces a benchmark for modeling interpersonal affect and social dynamics in dyadic conversations. Although conversational affect modeling has advanced rapidly, most…

In this paper, we briefly introduce our submission to the Valence-Arousal Estimation Challenge of the 3rd Affective Behavior Analysis in-the-wild (ABAW) competition. Our method utilizes the multi-modal information, i.e., the visual and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Liyu Meng , Yuchen Liu , Xiaolong Liu , Zhaopei Huang , Yuan Cheng , Meng Wang , Chuanhe Liu , Qin Jin

The ACII Affective Vocal Bursts Workshop & Competition is focused on understanding multiple affective dimensions of vocal bursts: laughs, gasps, cries, screams, and many other non-linguistic vocalizations central to the expression of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-31 Alice Baird , Panagiotis Tzirakis , Jeffrey A. Brooks , Christopher B. Gregory , Björn Schuller , Anton Batliner , Dacher Keltner , Alan Cowen

Affective computing has been largely limited in terms of available data resources. The need to collect and annotate diverse in-the-wild datasets has become apparent with the rise of deep learning models, as the default approach to address…

Computer Vision and Pattern Recognition · Computer Science 2019-10-14 Dimitrios Kollias , Stefanos Zafeiriou

Emotional Reaction Intensity(ERI) estimation is an important task in multimodal scenarios, and has fundamental applications in medicine, safe driving and other fields. In this paper, we propose a solution to the ERI challenge of the fifth…

Artificial Intelligence · Computer Science 2023-03-17 Jun Yu , Jichao Zhu , Wangyuan Zhu , Zhongpeng Cai , Guochen Xie , Renda Li , Gongpeng Zhao

In recent years, Affective Computing and its applications have become a fast-growing research topic. Furthermore, the rise of Deep Learning has introduced significant improvements in the emotion recognition system compared to classical…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Joaquim Comas , Decky Aspandi , Xavier Binefa

Human-Computer Interaction (HCI) is a multi-modal, interdisciplinary field focused on designing, studying, and improving the interactions between people and computer systems. This involves the design of systems that can recognize,…

Human-Computer Interaction · Computer Science 2025-08-15 Paul Schreiber , Beyza Cinar , Lennart Mackert , Maria Maleshkova

Embodied Artificial Intelligence (Embodied AI) is an emerging frontier in robotics, driven by the need for autonomous systems that can perceive, reason, and act in complex physical environments. While single-arm systems have shown strong…

The Audio/Visual Emotion Challenge and Workshop (AVEC 2016) "Depression, Mood and Emotion" will be the sixth competition event aimed at comparison of multimedia processing and machine learning methods for automatic audio, visual and…

Computer Vision and Pattern Recognition · Computer Science 2016-11-23 Michel Valstar , Jonathan Gratch , Bjorn Schuller , Fabien Ringeval , Denis Lalanne , Mercedes Torres Torres , Stefan Scherer , Guiota Stratou , Roddy Cowie , Maja Pantic

In personalized machine learning, the aim of personalization is to train a model that caters to a specific individual or group of individuals by optimizing one or more performance metrics and adhering to specific constraints. In this paper,…

Human-Computer Interaction · Computer Science 2026-01-15 Jialin Li , Maha Elgarf , Alia Waleed , Hanan Salam

Human behavior prediction models enable robots to anticipate how humans may react to their actions, and hence are instrumental to devising safe and proactive robot planning algorithms. However, modeling complex interaction dynamics and…

Robotics · Computer Science 2020-11-24 Boris Ivanovic , Karen Leung , Edward Schmerling , Marco Pavone

As Generative AI systems increasingly engage in long-term, personal, and relational interactions, human-AI engagements are becoming significantly complex, making them more challenging to understand and govern. These Interactive AI systems…

Computers and Society · Computer Science 2025-08-26 Yulu Pi , Cagatay Turkay , Daniel Bogiatzis-Gibbons

Social anxiety is a prevalent condition that affects interpersonal interactions and social functioning. Recent advances in artificial intelligence and social robotics offer new opportunities to examine social anxiety in the human-robot…

Robotics · Computer Science 2025-11-18 Vesna Poprcova , Iulia Lefter , Matthias Wieser , Martijn Warnier , Frances Brazier

Multi-modal emotion recognition in conversations is a challenging problem due to the complex and complementary interactions between different modalities. Audio and textual cues are particularly important for understanding emotions from a…

Sound · Computer Science 2025-04-02 Jiachen Luo , Huy Phan , Lin Wang , Joshua Reiss

Some of the most severe bottlenecks preventing widespread development of machine learning models for human behavior include a dearth of labeled training data and difficulty of acquiring high quality labels. Active learning is a paradigm for…

We present our contribution to the 7th ABAW challenge at ECCV 2024, by utilizing a Dual-Direction Attention Mixed Feature Network (DDAMFN) for multitask facial expression recognition, we achieve results far beyond the proposed baseline for…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Josep Cabacas-Maso , Elena Ortega-Beltrán , Ismael Benito-Altamirano , Carles Ventura