English
Related papers

Related papers: Fine-tuning Wav2vec for Vocal-burst Emotion Recogn…

200 papers

In this paper, we propose Emo2Vec which encodes emotional semantics into vectors. We train Emo2Vec by multi-task learning six different emotion-related tasks, including emotion/sentiment analysis, sarcasm classification, stress detection,…

Computation and Language · Computer Science 2018-09-13 Peng Xu , Andrea Madotto , Chien-Sheng Wu , Ji Ho Park , Pascale Fung

Speech emotion recognition (SER) is vital for obtaining emotional intelligence and understanding the contextual meaning of speech. Variations of consonant-vowel (CV) phonemic boundaries can enrich acoustic context with linguistic cues,…

Sound · Computer Science 2023-07-03 Anna Ollerenshaw , Md Asif Jalal , Rosanna Milner , Thomas Hain

In this paper we propose an easiest approach for facial expression recognition. Here we are using concept of SVM for Expression Classification. Main problem is sub divided in three main modules. First one is Face detection in which we are…

Computer Vision and Pattern Recognition · Computer Science 2013-05-14 Preeti Badar , Urmila Shrawankar

Speech has been a widely used modality in the field of affective computing. Recently however, there has been a growing interest in the use of multi-modal affective computing systems. These multi-modal systems incorporate both verbal and…

Human-Computer Interaction · Computer Science 2018-05-18 Jonny O'Dwyer , Niall Murray , Ronan Flynn

"How does the person in the bounding box feel?" Achieving human-level recognition of the apparent emotion of a person in real world situations remains an unsolved task in computer vision. Facial expressions are not enough: body pose,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Yasaman Etesam , Özge Nilay Yalçın , Chuxuan Zhang , Angelica Lim

Word vector representations enable machines to encode human language for spoken language understanding and processing. Confusion2vec, motivated from human speech production and perception, is a word vector representation which encodes…

Computation and Language · Computer Science 2022-05-04 Prashanth Gurunath Shivakumar , Panayiotis Georgiou , Shrikanth Narayanan

The 10th Affective & Behavior Analysis in-the-Wild (ABAW) Workshop and Competition, held at CVPR 2026, continues to advance research on modelling, analysis, understanding of human affect and behavior in real-world, unconstrained…

Research on Speech Emotion Recognition (SER) often faces challenges such as the lack of large-scale public datasets and limited generalization capability when dealing with data from different distributions. To solve this problem, this paper…

Sound · Computer Science 2024-12-02 Xiang minjie

The ability to modulate vocal sounds and generate speech is one of the features which set humans apart from other living beings. The human voice can be characterized by several attributes such as pitch, timbre, loudness, and vocal tone. It…

Computer Vision and Pattern Recognition · Computer Science 2017-10-30 Poorna Banerjee Dasgupta

Recognizing human non-speech vocalizations is an important task and has broad applications such as automatic sound transcription and health condition monitoring. However, existing datasets have a relatively small number of vocal sound…

Sound · Computer Science 2022-06-22 Yuan Gong , Jin Yu , James Glass

Valence-arousal (VA) estimation is crucial for capturing the nuanced nature of human emotions in naturalistic environments. While pre-trained Vision-Language models like CLIP have shown remarkable semantic alignment capabilities, their…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Byeongjin Jung , Chanyeong Park , Sejoon Lim

We develop an emotion recognition software for the use with a video conference software for autistic individuals which are unable to recognize emotions properly. It can get an image out of the video stream, detect the emotion in it with the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Marc Franzen , Michael Stephan Gresser , Tobias Müller , Sebastian Mauser

Multimodal emotion recognition is a task of great concern. However, traditional data sets are based on fixed labels, resulting in models that often focus on main emotions and ignore detailed emotional changes in complex scenes. This report…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Mengying Ge , Dongkai Tang , Mingyang Li

Speech emotion recognition (SER) systems are constrained by existing datasets that typically cover only 6-10 basic emotions, lack scale and diversity, and face ethical challenges when collecting sensitive emotional states. We introduce…

This paper presents a widespread analysis of affective vocal expression classification systems. In this study, state-of-the-art acoustic features are compared to two novel affective vocal prints for the detection of emotional states: the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-07 V. Vieira , R. Coelho , F. Assis

Facial action unit detection has emerged as an important task within facial expression analysis, aimed at detecting specific pre-defined, objective facial expressions, such as lip tightening and cheek raising. This paper presents our…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Yufeng Yin , Minh Tran , Di Chang , Xinrui Wang , Mohammad Soleymani

Recognising emotions in context involves identifying an individual's apparent emotions while considering contextual cues from the surrounding scene. Previous approaches to this task have typically designed explicit scene-encoding…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Alexandros Xenos , Niki Maria Foteinopoulou , Ioanna Ntinou , Ioannis Patras , Georgios Tzimiropoulos

We present a series of two studies conducted to understand user's affective states during voice-based human-machine interactions. Emphasis is placed on the cases of communication errors or failures. In particular, we are interested in…

Human-Computer Interaction · Computer Science 2022-07-19 Sujeong Kim , Abhinav Garlapati , Jonah Lubin , Amir Tamrakar , Ajay Divakaran

In this article, we introduce a novel problem of audio-visual autism behavior recognition, which includes social behavior recognition, an essential aspect previously omitted in AI-assisted autism screening research. We define the task at…

As the name suggests, affective computing aims to recognize human emotions, sentiments, and feelings. There is a wide range of fields that study affective computing, including languages, sociology, psychology, computer science, and…

Artificial Intelligence · Computer Science 2023-05-16 Sitara Afzal , Haseeb Ali Khan , Imran Ullah Khan , Md. Jalil Piran , Jong Weon Lee