English
Related papers

Related papers: A Multi-Modal Approach to Infer Image Affect

200 papers

Human emotion recognition is an active research area in artificial intelligence and has made substantial progress over the past few years. Many recent works mainly focus on facial regions to infer human affection, while the surrounding…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Nhat Le , Khanh Nguyen , Anh Nguyen , Bac Le

This paper presents a deep learning-based approach to emotion detection using Conditional Generative Adversarial Networks (cGANs). Unlike traditional unimodal techniques that rely on a single data type, we explore a multimodal framework…

Machine Learning · Computer Science 2025-08-07 Anushka Srivastava

Synthesizing realistic data samples is of great value for both academic and industrial communities. Deep generative models have become an emerging topic in various research areas like computer vision and signal processing. Affective…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Noushin Hajarolasvadi , Miguel Arjona Ramírez , Hasan Demirel

In response to the COVID-19 pandemic, traditional physical classrooms have transitioned to online environments, necessitating effective strategies to ensure sustained student engagement. A significant challenge in online teaching is the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Rekha R Nair , Tina Babu , Pavithra K

Several computer algorithms for recognition of visible human emotions are compared at the web camera scenario using CNN/MMOD face detector. The recognition refers to four face expressions: smile, surprise, anger, and neutral. At the feature…

Computer Vision and Pattern Recognition · Computer Science 2019-02-01 Rafal Pilarczyk , Xin Chang , Wladyslaw Skarbek

The integration of information across multiple modalities and across time is a promising way to enhance the emotion recognition performance of affective systems. Much previous work has focused on instantaneous emotion recognition. The 2018…

Image and Video Processing · Electrical Eng. & Systems 2018-05-07 Didan Deng , Yuqian Zhou , Jimin Pi , Bertram E. Shi

We propose an end-to-end affect recognition approach using a Convolutional Neural Network (CNN) that handles multiple languages, with applications to emotion and personality recognition from speech. We lay the foundation of a universal…

Computation and Language · Computer Science 2019-01-28 Dario Bertero , Onno Kampman , Pascale Fung

We introduce an approach for analyzing the variation of features generated by convolutional neural networks (CNNs) with respect to scene factors that occur in natural images. Such factors may include object style, 3D viewpoint, color, and…

Computer Vision and Pattern Recognition · Computer Science 2015-06-04 Mathieu Aubry , Bryan Russell

Human categorization is one of the most important and successful targets of cognitive modeling in psychology, yet decades of development and assessment of competing models have been contingent on small sets of simple, artificial…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Ruairidh M. Battleday , Joshua C. Peterson , Thomas L. Griffiths

Human affect recognition is a well-established research area with numerous applications, e.g., in psychological care, but existing methods assume that all emotions-of-interest are given a priori as annotated training examples. However, the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Kunyu Peng , Alina Roitberg , David Schneider , Marios Koulakis , Kailun Yang , Rainer Stiefelhagen

Advertisements (ads) often include strongly emotional content to leave a lasting impression on the viewer. This work (i) compiles an affective ad dataset capable of evoking coherent emotions across users, as determined from the affective…

Human-Computer Interaction · Computer Science 2017-09-07 Abhinav Shukla , Shruti Shriya Gullapuram , Harish Katti , Karthik Yadati , Mohan Kankanhalli , Ramanathan Subramanian

The existing image feature extraction methods are primarily based on the content and structure information of images, and rarely consider the contextual semantic information. Regarding some types of images such as scenes and objects, the…

Computer Vision and Pattern Recognition · Computer Science 2020-01-23 Chiranjibi Sitaula , Yong Xiang , Anish Basnet , Sunil Aryal , Xuequan Lu

Human communication is the vocal and non verbal signal to communicate with others. Human expression is a significant biometric object in picture and record databases of surveillance systems. Face appreciation has a serious role in biometric…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 P. Deivendran , P. Suresh Babu , G. Malathi , K. Anbazhagan , R. Senthil Kumar

Collaborating in a group, whether face-to-face or virtually, involves continuously expressing emotions and interpreting those of other group members. Therefore, understanding group affect is essential to comprehending how groups interact…

Human-Computer Interaction · Computer Science 2024-10-22 Navin Raj Prabhu , Maria Tsfasman , Catharine Oertel , Timo Gerkmann , Nale Lehmann-Willenbrock

Social media, as a major platform for communication and information exchange, is a rich repository of the opinions and sentiments of 2.3 billion users about a vast spectrum of topics. To sense the whys of certain social user's demands and…

Computers and Society · Computer Science 2018-02-20 Guillem Cucurull , Pau Rodríguez , V. Oguz Yazici , Josep M. Gonfaus , F. Xavier Roca , Jordi Gonzàlez

Sentiment analysis is attracting more and more attentions and has become a very hot research topic due to its potential applications in personalized recommendation, opinion mining, etc. Most of the existing methods are based on either…

Computation and Language · Computer Science 2017-11-22 Xingyue Chen , Yunhong Wang , Qingjie Liu

Emotion recognition and generation have emerged as crucial topics in Artificial Intelligence research, playing a significant role in enhancing human-computer interaction within healthcare, customer service, and other fields. Although…

Machine Learning · Computer Science 2025-02-12 Rebecca Mobbs , Dimitrios Makris , Vasileios Argyriou

Despite of the recent success of neural networks for human pose estimation, current approaches are limited to pose estimation of a single person and cannot handle humans in groups or crowds. In this work, we propose a method that estimates…

Computer Vision and Pattern Recognition · Computer Science 2016-09-01 Umar Iqbal , Juergen Gall

The continuous improvement of human-computer interaction technology makes it possible to compute emotions. In this paper, we introduce our submission to the CVPR 2023 Competition on Affective Behavior Analysis in-the-wild (ABAW). Sentiment…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Tao Shu , Xinke Wang , Ruotong Wang , Chuang Chen , Yixin Zhang , Xiao Sun

In this paper, we propose a new deep network that learns multi-level deep representations for image emotion classification (MldrNet). Image emotion can be recognized through image semantics, image aesthetics and low-level visual features…

Computer Vision and Pattern Recognition · Computer Science 2018-09-26 Tianrong Rao , Min Xu , Dong Xu