English
Related papers

Related papers: Global-Local Attention for Emotion Recognition

200 papers

Humans express their emotions via facial expressions, voice intonation and word choices. To infer the nature of the underlying emotion, recognition models may use a single modality, such as vision, audio, and text, or a combination of…

Machine Learning · Computer Science 2022-02-21 Vandana Rajan , Alessio Brutti , Andrea Cavallaro

Emotion recognition in social situations is a complex task that requires integrating information from both facial expressions and the situational context. While traditional approaches to automatic emotion recognition have focused on…

Human-Computer Interaction · Computer Science 2025-07-18 Bin Han , Cleo Yau , Su Lei , Jonathan Gratch

Human motion characteristics are used to monitor the progression of neurological diseases and mood disorders. Since perceptions of emotions are also interleaved with body posture and movements, emotion recognition from human gait can be…

Computer Vision and Pattern Recognition · Computer Science 2021-08-30 Matthew Malek-Podjaski , Fani Deligianni

Technological advancement and its omnipresent connection have pushed humans past the boundaries and limitations of a computer screen, physical state, or geographical location. It has provided a depth of avenues that facilitate…

Multimedia · Computer Science 2023-11-21 Dayo Samuel Banjo , Connice Trimmingham , Niloofar Yousefi , Nitin Agarwal

Speech emotion recognition is a challenging problem because human convey emotions in subtle and complex ways. For emotion recognition on human speech, one can either extract emotion related features from audio signals or employ speech…

Computation and Language · Computer Science 2020-04-06 Haiyang Xu , Hui Zhang , Kun Han , Yun Wang , Yiping Peng , Xiangang Li

We present a glasses type wearable device to detect emotions from a human face in an unobtrusive manner. The device is designed to gather multi channel responses from the user face naturally and continuously while the user is wearing it.…

Human-Computer Interaction · Computer Science 2024-10-30 Jangho Kwon , Laehyun Kim

Multimodal sentiment analysis has attracted increasing attention with broad application prospects. The existing methods focuses on single modality, which fails to capture the social media content for multiple modalities. Moreover, in…

Multimedia · Computer Science 2022-05-11 Ashima Yadav , Dinesh Kumar Vishwakarma

In our everyday lives and social interactions we often try to perceive the emotional states of people. There has been a lot of research in providing machines with a similar capacity of recognizing emotions. From a computer vision…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Ronak Kosti , Jose M. Alvarez , Adria Recasens , Agata Lapedriza

Emotion recognition from speech signal based on deep learning is an active research area. Convolutional neural networks (CNNs) may be the dominant method in this area. In this paper, we implement two neural architectures to address this…

Computation and Language · Computer Science 2020-11-03 Ahmed Ali , Yasser Hifny

In this paper, a deep learning framework is proposed for automatic facial emotion based on deep convolutional networks. In order to increase the generalization ability and the robustness of the method, the dataset size is increased by…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Serap Kırbız

In recent years, deep learning has achieved remarkable success in the field of image restoration. However, most convolutional neural network-based methods typically focus on a single scale, neglecting the incorporation of multi-scale…

Image and Video Processing · Electrical Eng. & Systems 2025-02-27 Jiatao Jiang , Zhen Cui , Chunyan Xu , Jian Yang

Multimodal emotion recognition from physiological signals is receiving an increasing amount of attention due to the impossibility to control them at will unlike behavioral reactions, thus providing more reliable information. Existing deep…

Human-Computer Interaction · Computer Science 2023-10-12 Eleonora Lopez , Eleonora Chiarantano , Eleonora Grassucci , Danilo Comminiello

In this work, we explore the emotional reactions that real-world images tend to induce by using natural language as the medium to express the rationale behind an affective response to a given visual stimulus. To embark on this journey, we…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Panos Achlioptas , Maks Ovsjanikov , Leonidas Guibas , Sergey Tulyakov

Emotion recognition is relevant in various domains, ranging from healthcare to human-computer interaction. Physiological signals, being beyond voluntary control, offer reliable information for this purpose, unlike speech and facial…

Machine Learning · Computer Science 2024-10-11 Eleonora Lopez , Aurelio Uncini , Danilo Comminiello

Visual Emotion Analysis (VEA) is attracting increasing attention. One of the biggest challenges of VEA is to bridge the affective gap between visual clues in a picture and the emotion expressed by the picture. As the granularity of emotions…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Liwen Xu , Zhengtao Wang , Bin Wu , Simon Lui

In the realm of emotion synthesis, the ability to create authentic and nuanced facial expressions continues to gain importance. The GANmut study discusses a recently introduced advanced GAN framework that, instead of relying on predefined…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Maria Surani

The human face constantly conveys information, both consciously and subconsciously. However, as basic as it is for humans to visually interpret this information, it is quite a big challenge for machines. Conventional semantic facial feature…

Machine Learning · Computer Science 2016-10-21 Amogh Gudi

Sentiment analysis and emotion recognition in videos are challenging tasks, given the diversity and complexity of the information conveyed in different modalities. Developing a highly competent framework that effectively addresses the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Prasad Chaudhari , Aman Kumar , Chandravardhan Singh Raghaw , Mohammad Zia Ur Rehman , Nagendra Kumar

Facial emotion recognition is the task to classify human emotions in face images. It is a difficult task due to high aleatoric uncertainty and visual ambiguity. A large part of the literature aims to show progress by increasing accuracy on…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Maryam Matin , Matias Valdenegro-Toro

Incremental learning is a complex process due to potential catastrophic forgetting of old tasks when learning new ones. This is mainly due to transient features that do not fit from task to task. In this paper, we focus on complex emotion…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Thibault Geoffroy , Gauthier Gerspacher , Lionel Prevost