English
Related papers

Related papers: Technical Report for Valence-Arousal Estimation in…

200 papers

Analysis of human affect plays a vital role in human-computer interaction (HCI) systems. Due to the difficulty in capturing large amounts of real-life data, most of the current methods have mainly focused on controlled environments, which…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Jun Yu , Zhongpeng Cai , Peng He , Guocheng Xie , Qiang Ling

Physiological signals that provide the objective repression of human affective states are attracted increasing attention in the emotion recognition field. However, the single signal is difficult to obtain completely and accurately…

Machine Learning · Computer Science 2020-01-03 Jing Zhang , Yong Zhang , Suhua Zhan , Cheng Cheng

This work presents the experiments and solution outline for our teams winning submission in the Learn To Race Autonomous Racing Virtual Challenge 2022 hosted by AIcrowd. The objective of the Learn-to-Race competition is to push the boundary…

Systems and Control · Electrical Eng. & Systems 2024-10-25 Lachlan Mares , Stefan Podgorski , Ian Reid

Vocal bursts play an important role in communicating affect, making them valuable for improving speech emotion recognition. Here, we present our approach for classifying vocal bursts and predicting their emotional significance in the ACII…

Sound · Computer Science 2022-09-28 Vincent Karas , Andreas Triantafyllopoulos , Meishu Song , Björn W. Schuller

Emotional Reaction Intensity(ERI) estimation is an important task in multimodal scenarios, and has fundamental applications in medicine, safe driving and other fields. In this paper, we propose a solution to the ERI challenge of the fifth…

Artificial Intelligence · Computer Science 2023-03-17 Jun Yu , Jichao Zhu , Wangyuan Zhu , Zhongpeng Cai , Guochen Xie , Renda Li , Gongpeng Zhao

We propose to use a ResNet-18 architecture that was pre-trained on the FER+ dataset for tackling the problem of affective behavior analysis in-the-wild (ABAW) for classification of the seven basic expressions, namely, neutral, anger,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Satnam Singh , Doris Schicker

Active research pertaining to the affective phenomenon of empathy and distress is invaluable for improving human-machine interaction. Predicting intensities of such complex emotions from textual data is difficult, as these constructs are…

Computation and Language · Computer Science 2021-03-08 Atharva Kulkarni , Sunanda Somwase , Shivam Rajput , Manisha Marathe

Multimodal fusion is a significant method for most multimodal tasks. With the recent surge in the number of large pre-trained models, combining both multimodal fusion methods and pre-trained model features can achieve outstanding…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Zhuofan Wen , Fengyu Zhang , Siyuan Zhang , Haiyang Sun , Mingyu Xu , Licai Sun , Zheng Lian , Bin Liu , Jianhua Tao

By utilizing label distribution learning, a probability distribution is assigned for a facial image to express a compound emotion, which effectively improves the problem of label uncertainties and noises occurred in one-hot labels. In…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Shasha Mao , Guanghui Shi , Licheng Jiao , Shuiping Gou , Yangyang Li , Lin Xiong , Boxin Shi

This paper describes audEERING's submissions as well as additional evaluations for the One-Minute-Gradual (OMG) emotion recognition challenge. We provide the results for audio and video processing on subject (in)dependent evaluations. On…

Computer Vision and Pattern Recognition · Computer Science 2018-05-04 Andreas Triantafyllopoulos , Hesam Sagha , Florian Eyben , Björn Schuller

The paper describes our proposed methodology for the seven basic expression classification track of Affective Behavior Analysis in-the-wild (ABAW) Competition 2021. In this task, facial expression recognition (FER) methods aim to classify…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Shuyi Mao , Xinqi Fan , Xiaojiang Peng

In this paper we propose a fusion approach to continuous emotion recognition that combines visual and auditory modalities in their representation spaces to predict the arousal and valence levels. The proposed approach employs a pre-trained…

Machine Learning · Computer Science 2019-06-26 Juan D. S. Ortega , Patrick Cardinal , Alessandro L. Koerich

This paper describes LogSigma, our system for SemEval-2026 Task 3: Dimensional Aspect-Based Sentiment Analysis (DimABSA). Unlike traditional Aspect-Based Sentiment Analysis (ABSA), which predicts discrete sentiment labels, DimABSA requires…

Computation and Language · Computer Science 2026-03-27 Baraa Hikal , Jonas Becker , Bela Gipp

Though multimodal emotion recognition has achieved significant progress over recent years, the potential of rich synergic relationships across the modalities is not fully exploited. In this paper, we introduce Recursive Joint Cross-Modal…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 R. Gnana Praveen , Jahangir Alam

Facial action unit detection has emerged as an important task within facial expression analysis, aimed at detecting specific pre-defined, objective facial expressions, such as lip tightening and cheek raising. This paper presents our…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Yufeng Yin , Minh Tran , Di Chang , Xinrui Wang , Mohammad Soleymani

We address the Ambivalence/Hesitancy (A/H) Video Recognition Challenge at the 10th ABAW Competition (CVPR 2026). We propose a divergence-based multimodal fusion that explicitly measures cross-modal conflict between visual, audio, and…

VAST, the Valence-Assessing Semantics Test, is a novel intrinsic evaluation task for contextualized word embeddings (CWEs). VAST uses valence, the association of a word with pleasantness, to measure the correspondence of word-level LM…

Computation and Language · Computer Science 2022-03-16 Robert Wolfe , Aylin Caliskan

As a common way of emotion signaling via non-linguistic vocalizations, vocal burst (VB) plays an important role in daily social interaction. Understanding and modeling human vocal bursts are indispensable for developing robust and general…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-15 Jinchao Li , Xixin Wu , Kaitao Song , Dongsheng Li , Xunying Liu , Helen Meng

Automatically recognising apparent emotions from face and voice is hard, in part because of various sources of uncertainty, including in the input data and the labels used in a machine learning framework. This paper introduces an…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Mani Kumar Tellamekala , Shahin Amiriparian , Björn W. Schuller , Elisabeth André , Timo Giesbrecht , Michel Valstar

Any decision, such as one about who to hire, involves two components. First, a rational component, i.e., they have a good education, they speak clearly. Second, an affective component, based on observables such as visual features of race…

Computers and Society · Computer Science 2022-05-03 Jesse Hoey , Gabrielle Chan