English
Related papers

Related papers: A Multi-Modal Approach to Infer Image Affect

200 papers

Images become an important and prevalent way to express users' activities, opinions and emotions. In a social network, individual emotions may be influenced by others, in particular by close friends. We focus on understanding how users…

Social and Information Networks · Computer Science 2014-01-20 Xiaohui Wang , Jia Jia , Lianhong Cai , Jie Tang

Due to the complex nature of human emotions and the diversity of emotion representation methods in humans, emotion recognition is a challenging field. In this research, three input modalities, namely text, audio (speech), and video, are…

Artificial Intelligence · Computer Science 2024-02-13 Minoo Shayaninasab , Bagher Babaali

Visual multimedia have become an inseparable part of our digital social lives, and they often capture moments tied with deep affections. Automated visual sentiment analysis tools can provide a means of extracting the rich feelings and…

Computer Vision and Pattern Recognition · Computer Science 2017-01-30 Victor Campos , Brendan Jou , Xavier Giro-i-Nieto

One of the challenges in affect recognition is accurate estimation of the emotion intensity level. This research proposes development of an affect intensity estimation model based on a weighted sum of classification confidence levels,…

Human-Computer Interaction · Computer Science 2016-07-06 Amol Patwardhan , Gerald Knapp

Sentiment analysis of online user generated content is important for many social media analytics tasks. Researchers have largely relied on textual sentiment analysis to develop systems to predict political elections, measure economic…

Computer Vision and Pattern Recognition · Computer Science 2015-09-22 Quanzeng You , Jiebo Luo , Hailin Jin , Jianchao Yang

This paper focuses on the problem of explaining predictions of psychological attributes such as attractiveness, happiness, confidence and intelligence from face photographs using deep neural networks. Since psychological attribute datasets…

Computer Vision and Pattern Recognition · Computer Science 2016-06-28 Farhad Arbabzadah , Grégoire Montavon , Klaus-Robert Müller , Wojciech Samek

A multi-modal emotion recognition method was established by combining two-channel convolutional neural network with ring network. This method can extract emotional information effectively and improve learning efficiency. The words were…

Artificial Intelligence · Computer Science 2023-11-21 Jiazhen Wang

Images have become one of the most popular types of media through which users convey their emotions within online social networks. Although vast amount of research is devoted to sentiment analysis of textual data, there has been very…

Computer Vision and Pattern Recognition · Computer Science 2014-11-24 Can Xu , Suleyman Cetintas , Kuang-Chih Lee , Li-Jia Li

This paper presents a novel approach for synthesizing facial affect; either in terms of the six basic expressions (i.e., anger, disgust, fear, joy, sadness and surprise), or in terms of valence (i.e., how positive or negative is an emotion)…

Computer Vision and Pattern Recognition · Computer Science 2019-07-18 Dimitrios Kollias , Shiyang Cheng , Evangelos Ververas , Irene Kotsia , Stefanos Zafeiriou

Visual Sentiment Analysis aims to understand how images affect people, in terms of evoked emotions. Although this field is rather new, a broad range of techniques have been developed for various data sources and problems, resulting in a…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Alessandro Ortis , Giovanni Maria Farinella , Sebastiano Battiato

Emotion recognition is the task of classifying perceived emotions in people. Previous works have utilized various nonverbal cues to extract features from images and correlate them to emotions. Of these cues, situational context is…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Willams de Lima Costa , Estefania Talavera Martinez , Lucas Silva Figueiredo , Veronica Teichrieb

Deep convolutional neural networks have recently achieved great success on image aesthetics assessment task. In this paper, we propose an efficient method which takes the global, local and scene-aware information of images into…

Computer Vision and Pattern Recognition · Computer Science 2019-02-25 Xin Fu , Jia Yan , Cien Fan

Research on human face processing using eye movements has provided evidence that we recognize face images successfully focusing our visual attention on a few inner facial regions, mainly on the eyes, nose and mouth. To understand how we…

Computer Vision and Pattern Recognition · Computer Science 2017-09-06 Carlos E. Thomaz , Vagner Amaral , Gilson A. Giraldi , Duncan F. Gillies , Daniel Rueckert

Expressing and identifying emotions through facial and physical expressions is a significant part of social interaction. Emotion recognition is an essential task in computer vision due to its various applications and mainly for allowing a…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Willams Costa , David Macêdo , Cleber Zanchettin , Lucas S. Figueiredo , Veronica Teichrieb

Emotion recognition has become an important field of research in the human-computer interactions domain. The latest advancements in the field show that combining visual with audio information lead to better results if compared to the case…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Nicolae-Catalin Ristea , Liviu Cristian Dutu , Anamaria Radoi

Emotions are usually evoked in humans by images. Recently, extensive research efforts have been dedicated to understanding the emotions of images. In this chapter, we aim to introduce image emotion analysis (IEA) from a computational…

Artificial Intelligence · Computer Science 2021-03-22 Sicheng Zhao , Quanwei Huang , Youbao Tang , Xingxu Yao , Jufeng Yang , Guiguang Ding , Björn W. Schuller

We present a method that automatically evaluates emotional response from spontaneous facial activity recorded by a depth camera. The automatic evaluation of emotional response, or affect, is a fascinating challenge with many applications,…

Human-Computer Interaction · Computer Science 2017-01-20 Daniel Hadar

Multimodal sentiment analysis is an important area for understanding the user's internal states. Deep learning methods were effective, but the problem of poor interpretability has gradually gained attention. Previous works have attempted to…

Computation and Language · Computer Science 2023-05-15 Sixia Li , Shogo Okada

This paper introduces a novel method for generating artistic images that express particular affective states. Leveraging state-of-the-art deep learning methods for visual generation (through generative adversarial networks), semantic models…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Theodoros Galanos , Antonios Liapis , Georgios N. Yannakakis

The study proposes and tests a technique for automated emotion recognition through mouth detection via Convolutional Neural Networks (CNN), meant to be applied for supporting people with health disorders with communication skills issues…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Giulio Biondi , Valentina Franzoni , Osvaldo Gervasi , Damiano Perri