English
Related papers

Related papers: Group Affect Prediction Using Multimodal Distribut…

200 papers

This project explores emoji prediction from short text sequences using four deep learning architectures: a feed-forward network, CNN, transformer, and BERT. Using the TweetEval dataset, we address class imbalance through focal loss and…

Computation and Language · Computer Science 2025-08-15 Ethan Gordon , Nishank Kuppa , Rigved Tummala , Sriram Anasuri

Instead of using current deep-learning segmentation models (like the UNet and variants), we approach the segmentation problem using trained Convolutional Neural Network (CNN) classifiers, which automatically extract important features from…

Image and Video Processing · Electrical Eng. & Systems 2022-01-31 Shuyue Guan , Murray Loew

Convolutional neural networks (CNNs) are widely used to recognize the user's state through electroencephalography (EEG) signals. In the previous studies, the EEG signals are usually fed into the CNNs in the form of high-dimensional raw…

Machine Learning · Computer Science 2021-01-19 Seong-Eun Moon , Chun-Jui Chen , Cho-Jui Hsieh , Jane-Ling Wang , Jong-Seok Lee

Emotions are an inherent part of human interactions, and consequently, it is imperative to develop AI systems that understand and recognize human emotions. During a conversation involving various people, a person's emotions are influenced…

Computation and Language · Computer Science 2022-05-06 Abhinav Joshi , Ashwani Bhat , Ayush Jain , Atin Vikram Singh , Ashutosh Modi

Speech Emotion Recognition is a crucial area of research in human-computer interaction. While significant work has been done in this field, many state-of-the-art networks struggle to accurately recognize emotions in speech when the data is…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-23 Rashedul Hasan , Meher Nigar , Nursadul Mamun , Sayan Paul

Despite the fact that notable improvements have been made recently in the field of feature extraction and classification, human action recognition is still challenging, especially in images, in which, unlike videos, there is no motion.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Sina Mohammadi , Sina Ghofrani Majelan , Shahriar B. Shokouhi

Recent models of emotion recognition strongly rely on supervised deep learning solutions for the distinction of general emotion expressions. However, they are not reliable when recognizing online and personalized facial expressions, e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Pablo Barros , German I. Parisi , Stefan Wermter

This paper proposes a joint multi-task learning algorithm to better predict attributes in images using deep convolutional neural networks (CNN). We consider learning binary semantic attributes through a multi-task CNN model, where each CNN…

Computer Vision and Pattern Recognition · Computer Science 2016-01-05 Abrar H. Abdulnabi , Gang Wang , Jiwen Lu , Kui Jia

With the popularity of social networks, and e-commerce websites, sentiment analysis has become a more active area of research in the past few years. On a high level, sentiment analysis tries to understand the public opinion about a specific…

Computation and Language · Computer Science 2019-04-14 Shervin Minaee , Elham Azimi , AmirAli Abdolrashidi

Emotion detection is an important task that can be applied to social media data to discover new knowledge. While the use of deep learning methods for this task has been prevalent, they are black-box models, making their decisions hard to…

Computation and Language · Computer Science 2021-07-13 Olha Kaminska , Chris Cornelis , Veronique Hoste

Apparent personality and emotion analysis are both central to affective computing. Existing works solve them individually. In this paper we investigate if such high-level affect traits and their relationship can be jointly learned from face…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Le Zhang , Songyou Peng , Stefan Winkler

We propose an end-to-end affect recognition approach using a Convolutional Neural Network (CNN) that handles multiple languages, with applications to emotion and personality recognition from speech. We lay the foundation of a universal…

Computation and Language · Computer Science 2019-01-28 Dario Bertero , Onno Kampman , Pascale Fung

We propose a framework for multimodal sentiment analysis and emotion recognition using convolutional neural network-based feature extraction from text and visual modalities. We obtain a performance improvement of 10% over the state of the…

Multimedia · Computer Science 2017-08-01 Erik Cambria , Devamanyu Hazarika , Soujanya Poria , Amir Hussain , R. B. V. Subramaanyam

Automatic prediction of continuous-level emotional state requires selection of suitable affective features to develop a regression system based on supervised machine learning. This paper investigates the performance of features…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Ramesh Basnet , Mohammad Tariqul Islam , Tamanna Howlader , S. M. Mahbubur Rahman , Dimitrios Hatzinakos

Human computer interaction has become integral to modern life, driven by advancements in machine learning technologies. Affective computing, in particular, has focused on systems that recognize, interpret, and respond to human emotions,…

Signal Processing · Electrical Eng. & Systems 2025-07-23 Karim Alghoul , Hussein Al Osman , Abdulmotaleb El Saddik

This paper presents our submission to the Expression Classification Challenge of the fifth Affective Behavior Analysis in-the-wild (ABAW) Competition. In our method, multimodal feature combinations extracted by several different pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Chuanhe Liu , Xinjie Zhang , Xiaolong Liu , Tenggan Zhang , Liyu Meng , Yuchen Liu , Yuanyuan Deng , Wenqiang Jiang

This paper presents a light-weight and accurate deep neural model for audiovisual emotion recognition. To design this model, the authors followed a philosophy of simplicity, drastically limiting the number of parameters to learn from the…

Artificial Intelligence · Computer Science 2018-08-09 Valentin Vielzeuf , Corentin Kervadec , Stéphane Pateux , Alexis Lechervy , Frédéric Jurie

We propose a novel crowd counting model that maps a given crowd scene to its density. Crowd analysis is compounded by myriad of factors like inter-occlusion between people due to extreme crowding, high similarity of appearance between…

Computer Vision and Pattern Recognition · Computer Science 2017-08-04 Deepak Babu Sam , Shiv Surya , R. Venkatesh Babu

Automatic emotion recognition has recently gained significant attention due to the growing popularity of deep learning algorithms. One of the primary challenges in emotion recognition is effectively utilizing the various cues (modalities)…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Mijanur Palash , Bharat Bhargava

Human emotion recognition is an active research area in artificial intelligence and has made substantial progress over the past few years. Many recent works mainly focus on facial regions to infer human affection, while the surrounding…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Nhat Le , Khanh Nguyen , Anh Nguyen , Bac Le