English
Related papers

Related papers: Affect Intensity Estimation Using Multiple Modalit…

200 papers

Affective computing is a field of study that focuses on developing systems and technologies that can understand, interpret, and respond to human emotions. Speech Emotion Recognition (SER), in particular, has got a lot of attention from…

Computation and Language · Computer Science 2023-12-20 Varun Sharma

Developing and integrating emotion-understanding models are essential for a wide range of human-computer interaction tasks, including customer feedback analysis, marketing research, and social media monitoring. Given that users often…

Computation and Language · Computer Science 2026-03-20 Tadesse Destaw Belay , Dawit Ketema Gete , Abinew Ali Ayele , Olga Kolesnikova , Iqra Ameer , Grigori Sidorov , Seid Muhie Yimam

We propose an automatic method for pain intensity measurement from video. For each video, pain intensity was measured using the dynamics of facial movement using 66 facial points. Gram matrices formulation was used for facial points…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Benjamin Szczapa , Mohamed Daoudi , Stefano Berretti , Pietro Pala , Alberto Del Bimbo , Zakia Hammal

Machine learning advances in the last decade have relied significantly on large-scale datasets that continue to grow in size. Increasingly, those datasets also contain different data modalities. However, large multi-modal datasets are hard…

Machine Learning · Computer Science 2021-10-28 Itai Gat , Idan Schwartz , Alexander Schwing

When recognizing emotions, subtle nuances in displays of emotion generate ambiguity or uncertainty in emotion perception. Emotion uncertainty has been previously interpreted as inter-rater disagreement among multiple annotators. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Didan Deng , Liang Wu , Bertram E. Shi

Emotion recognition and classification is a very active area of research. In this paper, we present a first approach to emotion classification using persistent entropy and support vector machines. A topology-based model is applied to obtain…

Sound · Computer Science 2019-03-22 R. Gonzalez-Diaz , E. Paluzo-Hidalgo , J. F. Quesada

Multimodal sentiment analysis is a key technology in the fields of human-computer interaction and affective computing. Accurately recognizing human emotional states is crucial for facilitating smooth communication between humans and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Wangyuan Zhu , Jun Yu

Emotional Reaction Intensity(ERI) estimation is an important task in multimodal scenarios, and has fundamental applications in medicine, safe driving and other fields. In this paper, we propose a solution to the ERI challenge of the fifth…

Artificial Intelligence · Computer Science 2023-03-17 Jun Yu , Jichao Zhu , Wangyuan Zhu , Zhongpeng Cai , Guochen Xie , Renda Li , Gongpeng Zhao

Emotional states, as indicators of affect, are pivotal to overall health, making their accurate prediction before onset crucial. Current studies are primarily centered on immediate short-term affect detection using data from wearable and…

Multimodal affective computing has gained increasing attention due to its broad applications in understanding human behavior and intentions, particularly in text-centric multimodal scenarios. Existing research spans diverse tasks,…

Computation and Language · Computer Science 2026-04-08 Guimin Hu , Weimin Lyu , Chang Sun , Zhihong Zhu , Lin Gui , Ruichu Cai , Erik Cambria , Hasti Seifi

Speech Emotion Recognition (SER) is a challenging task. In this paper, we introduce a modality conversion concept aimed at enhancing emotion recognition performance on the MELD dataset. We assess our approach through two experiments: first,…

Sound · Computer Science 2023-07-24 Zeinab Sadat Taghavi , Ali Satvaty , Hossein Sameti

Analyzing individual emotions during group conversation is crucial in developing intelligent agents capable of natural human-machine interaction. While reliable emotion recognition techniques depend on different modalities (text, audio,…

Temporal context is key to the recognition of expressions of emotion. Existing methods, that rely on recurrent or self-attention models to enforce temporal consistency, work on the feature level, ignoring the task-specific temporal…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Enrique Sanchez , Mani Kumar Tellamekala , Michel Valstar , Georgios Tzimiropoulos

In this work, we present a lightweight and privacy-preserving Multimodal Emotion Recognition (MER) framework designed for deployment on edge devices. To demonstrate framework's versatility, our implementation uses three modalities - speech,…

Artificial Intelligence · Computer Science 2026-02-11 Rémi Grzeczkowicz , Eric Soriano , Ali Janati , Miyu Zhang , Gerard Comas-Quiles , Victor Carballo Araruna , Aneesh Jonelagadda

Applications of an efficient emotion recognition system can be found in several domains such as medicine, driver fatigue surveillance, social robotics, and human-computer interaction. Appraising human emotional states, behaviors, and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Savinay Nagendra , Prapti Panigrahi

In our multicultural world, affect-aware AI systems that support humans need the ability to perceive affect across variations in emotion expression patterns across cultures. These systems must perform well in cultural contexts without…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Leena Mathur , Ralph Adolphs , Maja J Matarić

Speech emotion recognition is an important and challenging task in the realm of human-computer interaction. Prior work proposed a variety of models and feature sets for training a system. In this work, we conduct extensive experiments using…

Computation and Language · Computer Science 2017-06-05 Michael Neumann , Ngoc Thang Vu

Emotion Prediction in Conversation (EPC) aims to forecast the emotions of forthcoming utterances by utilizing preceding dialogues. Previous EPC approaches relied on simple context modeling for emotion extraction, overlooking fine-grained…

Multimedia · Computer Science 2024-08-09 Haoxiang Shi , Ziqi Liang , Jun Yu

Affective computing plays a key role in human-computer interactions, entertainment, teaching, safe driving, and multimedia integration. Major breakthroughs have been made recently in the areas of affective computing (i.e., emotion…

Multimedia · Computer Science 2022-03-22 Yan Wang , Wei Song , Wei Tao , Antonio Liotta , Dawei Yang , Xinlei Li , Shuyong Gao , Yixuan Sun , Weifeng Ge , Wei Zhang , Wenqiang Zhang

The continuous improvement of human-computer interaction technology makes it possible to compute emotions. In this paper, we introduce our submission to the CVPR 2023 Competition on Affective Behavior Analysis in-the-wild (ABAW). Sentiment…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Tao Shu , Xinke Wang , Ruotong Wang , Chuang Chen , Yixin Zhang , Xiao Sun