English
Related papers

Related papers: Reproducible Physiological Features in Affective C…

200 papers

Agents must monitor their partners' affective states continuously in order to understand and engage in social interactions. However, methods for evaluating affect recognition do not account for changes in classification performance that may…

Human-Computer Interaction · Computer Science 2025-09-08 Allen Chang , Lauren Klein , Marcelo R. Rosales , Weiyang Deng , Beth A. Smith , Maja J. Matarić

This work presents MAD (Multimodal Affection Dataset), a multimodal emotion dataset designed for affective computing and neurophysiological modeling. MAD is built upon synchronous collection of diverse physiological signals (EEG, ECG, EOG,…

Signal Processing · Electrical Eng. & Systems 2026-03-09 Shengwei Guo , Yunqing Qiao , Wenzhan Zhang , Bo Liu , Yong Wang , Guobing Sun

Auditory attention to natural speech is a complex brain process. Its quantification from physiological signals can be valuable to improving and widening the range of applications of current brain-computer-interface systems, however it…

Human-Computer Interaction · Computer Science 2020-05-26 Nikesh Bajaj , Jesús Requena Carrión , Francesco Bellotti

The technical report presents our emotion recognition pipeline for high-dimensional emotion task (A-VB High) in The ACII Affective Vocal Bursts (A-VB) 2022 Workshop \& Competition. Our proposed method contains three stages. Firstly, we…

Sound · Computer Science 2022-09-27 Dang-Linh Trinh , Minh-Cong Vo , Guee-Sang Lee

Understanding human affect from facial behavior requires not only accurate recognition but also structured reasoning over the latent dependencies that drive muscle activations and their expressive outcomes. Although Action Units (AUs) have…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Guanyu Hu , Tangzheng Lian , Dimitrios Kollias , Oya Celiktutan , Xinyu Yang

Continuous emotion recognition in terms of valence and arousal under in-the-wild (ITW) conditions remains a challenging problem due to large variations in appearance, head pose, illumination, occlusions, and subject-specific patterns of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Elena Ryumina , Maxim Markitantov , Alexandr Axyonov , Dmitry Ryumin , Mikhail Dolgushin , Denis Dresvyanskiy , Alexey Karpov

Temporal context is key to the recognition of expressions of emotion. Existing methods, that rely on recurrent or self-attention models to enforce temporal consistency, work on the feature level, ignoring the task-specific temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Enrique Sanchez , Mani Kumar Tellamekala , Michel Valstar , Georgios Tzimiropoulos

Automatic understanding of human affect using visual signals is of great importance in everyday human-machine interactions. Appraising human emotional states, behaviors and reactions displayed in real-world settings, can be accomplished…

Computer Vision and Pattern Recognition · Computer Science 2019-02-04 Dimitrios Kollias , Panagiotis Tzirakis , Mihalis A. Nicolaou , Athanasios Papaioannou , Guoying Zhao , Björn Schuller , Irene Kotsia , Stefanos Zafeiriou

Humans have a selective memory, remembering relevant episodes and forgetting the less relevant information. Possessing awareness of event memorability for a user could help intelligent systems in more accurate user modelling, especially for…

Human-Computer Interaction · Computer Science 2025-07-21 Maria Tsfasman , Ramin Ghorbani , Catholijn M. Jonker , Bernd Dudzik

Physiological signals hold immense potential for ubiquitous emotion monitoring, presenting numerous applications in emotion recognition. However, harnessing this potential is hindered by significant challenges, particularly in the…

Human-Computer Interaction · Computer Science 2025-03-30 Pragya Singh , Ritvik Budhiraja , Pankaj Jalote , Mohan Kumar , Pushpendra Singh

Acoustic emotion recognition aims to categorize the affective state of the speaker and is still a difficult task for machine learning models. The difficulties come from the scarcity of training data, general subjectivity in emotion…

Computation and Language · Computer Science 2018-04-02 Egor Lakomkin , Cornelius Weber , Sven Magg , Stefan Wermter

The paper concerns affective information systems that represent and visualize human emotional states. The goal of the study was to find typical representations of discrete and dimensional emotion models in terms of color, size, speed,…

Human-Computer Interaction · Computer Science 2026-04-14 Michal R Wrobel , Agnieszka Landowska , Karolina Makuch

Despite recent advances in the field of explainable artificial intelligence systems, a concrete quantitative measure for evaluating the usability of such systems is nonexistent. Ensuring the success of an explanatory interface in…

Human-Computer Interaction · Computer Science 2020-10-26 Byung Hyung Kim , Seunghun Koh , Sejoon Huh , Sungho Jo , Sunghee Choi

In recent years, the use of bio-sensing signals such as electroencephalogram (EEG), electrocardiogram (ECG), etc. have garnered interest towards applications in affective computing. The parallel trend of deep-learning has led to a huge leap…

Machine Learning · Computer Science 2019-05-20 Siddharth Siddharth , Tzyy-Ping Jung , Terrence J. Sejnowski

Facial mimicry - the automatic, unconscious imitation of others' expressions - is vital for emotional understanding. This study investigates how mimicry differs across emotions using Face Action Units from videos and participants'…

Human-Computer Interaction · Computer Science 2025-08-12 Meisam Jamshidi Seikavandi , Jostein Fimland , Maria Jung Barrett , Paolo Burelli

The fifth Affective Behavior Analysis in-the-wild (ABAW) Competition is part of the respective ABAW Workshop which will be held in conjunction with IEEE Computer Vision and Pattern Recognition Conference (CVPR), 2023. The 5th ABAW…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Dimitrios Kollias , Panagiotis Tzirakis , Alice Baird , Alan Cowen , Stefanos Zafeiriou

This paper is devoted to improve automatic emotion recognition from speech by incorporating rhythm and temporal features. Research on automatic emotion recognition so far has mostly been based on applying features like MFCCs, pitch and…

Computer Vision and Pattern Recognition · Computer Science 2013-03-08 Mayank Bhargava , Tim Polzehl

A fundamental challenge in emotion research is measuring feeling states with high granularity and temporal precision without disrupting the emotion generation process. Here we introduce and validate a new approach in which responses are…

Information Retrieval · Computer Science 2022-10-06 Eshin Jolly , Max Farrens , Nathan Greenstein , Hedwig Eisenbarth , Marianne Reddan , Eric Andrews , Tor D. Wager , Luke J. Chang

Emotion recognition has received considerable attention from the Computer Vision community in the last 20 years. However, most of the research focused on analyzing the six basic emotions (e.g. joy, anger, surprise), with a limited work…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Mina Bishay , Jay Turcot , Graham Page , Mohammad Mavadati

Applications of an efficient emotion recognition system can be found in several domains such as medicine, driver fatigue surveillance, social robotics, and human-computer interaction. Appraising human emotional states, behaviors, and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Savinay Nagendra , Prapti Panigrahi