English
Related papers

Related papers: Emotion Recognition Using Transformers with Masked…

200 papers

The COVID-19 pandemic has undoubtedly changed the standards and affected all aspects of our lives, especially social communication. It has forced people to extensively wear medical face masks, in order to prevent transmission. This face…

Computer Vision and Pattern Recognition · Computer Science 2023-05-29 Nikolaos Kegkeroglou , Panagiotis P. Filntisis , Petros Maragos

Studies have proven that domain bias and label bias exist in different Facial Expression Recognition (FER) datasets, making it hard to improve the performance of a specific dataset by adding other datasets. For the FER bias issue, recent…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Shuyi Mao , Xinpeng Li , Qingyang Wu , Xiaojiang Peng

In this paper, we propose a new methodology for emotional speech recognition using visual deep neural network models. We employ the transfer learning capabilities of the pre-trained computer vision deep models to have a mandate for the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Waleed Ragheb , Mehdi Mirzapour , Ali Delfardi , Hélène Jacquenet , Lawrence Carbon

Emotion detection presents challenges to intelligent human-robot interaction (HRI). Foundational deep learning techniques used in emotion detection are limited by information-constrained datasets or models that lack the necessary complexity…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 David C. Jeong , Tianma Shen , Hongji Liu , Raghav Kapoor , Casey Nguyen , Song Liu , Christopher A. Kitts

Emotion recognition and sentiment analysis are pivotal tasks in speech and language processing, particularly in real-world scenarios involving multi-party, conversational data. This paper presents a multimodal approach to tackle these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Aref Farhadipour , Hossein Ranjbar , Masoumeh Chapariniya , Teodora Vukovic , Sarah Ebling , Volker Dellwo

Emotion recognition from EEG signals is essential for affective computing and has been widely explored using deep learning. While recent deep learning approaches have achieved strong performance on single EEG emotion datasets, their…

Machine Learning · Computer Science 2025-11-17 Yuning Chen , Sha Zhao , Shijian Li , Gang Pan

For computers to recognize human emotions, expression classification is an equally important problem in the human-computer interaction area. In the 3rd Affective Behavior Analysis In-The-Wild competition, the task of expression…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Kim Ngan Phan , Hong-Hai Nguyen , Van-Thong Huynh , Soo-Hyung Kim

Analyzing human affect is vital for human-computer interaction systems. Most methods are developed in restricted scenarios which are not practical for in-the-wild settings. The Affective Behavior Analysis in-the-wild (ABAW) 2021 Contest…

Computer Vision and Pattern Recognition · Computer Science 2021-07-16 Yue Jin , Tianqing Zheng , Chao Gao , Guoqiang Xu

Emotion recognition is a topic of significant interest in assistive robotics due to the need to equip robots with the ability to comprehend human behavior, facilitating their effective interaction in our society. Consequently, efficient and…

Human-Computer Interaction · Computer Science 2023-12-05 Rutherford Agbeshi Patamia , Paulo E. Santos , Kingsley Nketia Acheampong , Favour Ekong , Kwabena Sarpong , She Kun

Similarly to humans, facial expressions in animals are closely linked with emotional states. However, in contrast to the human domain, automated recognition of emotional states from facial expressions in animals is underexplored, mainly due…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Tali Boneh-Shitrit , Shir Amir , Annika Bremhorst , Daniel S. Mills , Stefanie Riemer , Dror Fried , Anna Zamansky

This paper presents our approach for the VA (Valence-Arousal) estimation task in the ABAW6 competition. We devised a comprehensive model by preprocessing video frames and audio segments to extract visual and audio features. Through the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Jun Yu , Gongpeng Zhao , Yongqi Wang , Zhihong Wei , Yang Zheng , Zerui Zhang , Zhongpeng Cai , Guochen Xie , Jichao Zhu , Wangyuan Zhu

Emotion plays an essential role in human-to-human communication, enabling us to convey feelings such as happiness, frustration, and sincerity. While modern speech technologies rely heavily on speech recognition and natural language…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-05 Vasudha Kowtha , Vikramjit Mitra , Chris Bartels , Erik Marchi , Sue Booker , William Caruso , Sachin Kajarekar , Devang Naik

Learning the latent representation of data in unsupervised fashion is a very interesting process that provides relevant features for enhancing the performance of a classifier. For speech emotion recognition tasks, generating effective…

Sound · Computer Science 2020-07-29 Siddique Latif , Rajib Rana , Junaid Qadir , Julien Epps

Facial Expression Recognition (FER) in the wild is extremely challenging due to occlusions, variant head poses, face deformation and motion blur under unconstrained conditions. Although substantial progresses have been made in automatic FER…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Fuyan Ma , Bin Sun , Shutao Li

Our experiment adapts several popular deep learning methods as well as some traditional methods on the problem of video emotion recognition. In our experiment, we use the CNN-LSTM architecture for visual information extraction and…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Lijie Fan , Yunjie Ke

In this work we tackle the task of video-based audio-visual emotion recognition, within the premises of the 2nd Workshop and Competition on Affective Behavior Analysis in-the-wild (ABAW2). Poor illumination conditions, head/body orientation…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Panagiotis Antoniadis , Ioannis Pikoulis , Panagiotis P. Filntisis , Petros Maragos

Traditional psychological evaluations rely heavily on human observation and interpretation, which are prone to subjectivity, bias, fatigue, and inconsistency. To address these limitations, this work presents a multimodal emotion recognition…

Human-Computer Interaction · Computer Science 2024-12-25 Kris Kraack

Human affect recognition is an essential part of natural human-computer interaction. However, current methods are still in their infancy, especially for in-the-wild data. In this work, we introduce our submission to the Affective Behavior…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Felix Kuhnke , Lars Rumberg , Jörn Ostermann

In this paper, we present a process to investigate the effects of transfer learning for automatic facial expression recognition from emotions to pain. To this end, we first train a VGG16 convolutional neural network to automatically discern…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Pooja Prajod , Dominik Schiller , Tobias Huber , Elisabeth André

Classifying group-level emotions is a challenging task due to complexity of video, in which not only visual, but also audio information should be taken into consideration. Existing works on multimodal emotion recognition are using bulky…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Lev Evtodienko