English
Related papers

Related papers: Stimuli-Aware Visual Emotion Analysis

200 papers

In this work, we explore the emotional reactions that real-world images tend to induce by using natural language as the medium to express the rationale behind an affective response to a given visual stimulus. To embark on this journey, we…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Panos Achlioptas , Maks Ovsjanikov , Leonidas Guibas , Sergey Tulyakov

Multimodal emotion recognition (MER) aims to infer human affect by jointly modeling audio and visual cues; however, existing approaches often struggle with temporal misalignment, weakly discriminative feature representations, and suboptimal…

Multimedia · Computer Science 2026-01-21 Joe Dhanith P R , Shravan Venkatraman , Vigya Sharma , Santhosh Malarvannan

Multimodal emotion recognition (MER) is crucial for enabling emotionally intelligent systems that perceive and respond to human emotions. However, existing methods suffer from limited cross-modal interaction and imbalanced contributions…

Multimedia · Computer Science 2025-07-30 Zeyu Deng , Yanhui Lu , Jiashu Liao , Shuang Wu , Chongfeng Wei

As AI technology is increasingly applied to high-impact, high-risk domains, there have been a number of new methods aimed at making AI models more human interpretable. Despite the recent growth of interpretability work, there is a lack of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Sunnie S. Y. Kim , Nicole Meister , Vikram V. Ramaswamy , Ruth Fong , Olga Russakovsky

Multimodal emotion recognition has recently gained much attention since it can leverage diverse and complementary relationships over multiple modalities (e.g., audio, visual, biosignals, etc.), and can provide some robustness to noisy…

Neuronal network models and corresponding computer simulations are invaluable tools to aid the interpretation of the relationship between neuron properties, connectivity and measured activity in cortical tissue. Spatiotemporal patterns of…

Neurons and Cognition · Quantitative Biology 2022-09-16 Johanna Senk , Corto Carde , Espen Hagen , Torsten W. Kuhlen , Markus Diesmann , Benjamin Weyers

The stance detection task aims to categorise the stance regarding specified targets. Current methods face challenges in effectively integrating sentiment information for stance detection. Moreover, the role of highly granular sentiment…

Computation and Language · Computer Science 2025-02-27 Beiyu Xu , Zhiwei Liu , Sophia Ananiadou

Prior studies on Visual Sentiment Understanding (VSU) primarily rely on the explicit scene information (e.g., facial expression) to judge visual sentiments, which largely ignore implicit scene information (e.g., human action, objection…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Jiamin Luo , Jingjing Wang , Junxiao Ma , Yujie Jin , Shoushan Li , Guodong Zhou

This paper proposes a process for a classification model for the facial expressions. The proposed process would aid in specific categorisation of children's emotions from 2 emotions namely 'Happy' and 'Sad'. Since the existing emotion…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Sanchayan Vivekananthan

Emotions are a fundamental aspect of artistic expression. Due to their abstract nature, there is a broad spectrum of emotion realization in artworks. These are subject to historical change and their analysis requires expertise in art…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Sebastian Padó , Kerstin Thomas

Facial Emotion Analysis (FEA) plays a crucial role in visual affective computing, aiming to infer a person's emotional state based on facial data. Scientifically, facial expressions (FEs) result from the coordinated movement of facial…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Zhuozhao Hu , Kaishen Yuan , Xin Liu , Zitong Yu , Yuan Zong , Jingang Shi , Huanjing Yue , Jingyu Yang

Human emotion recognition is an active research area in artificial intelligence and has made substantial progress over the past few years. Many recent works mainly focus on facial regions to infer human affection, while the surrounding…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Nhat Le , Khanh Nguyen , Anh Nguyen , Bac Le

Classification of human emotions remains an important and challenging task for many computer vision algorithms, especially in the era of humanoid robots which coexist with humans in their everyday life. Currently proposed methods for…

Computer Vision and Pattern Recognition · Computer Science 2018-10-26 Ivona Tautkute , Tomasz Trzcinski

Visually-aware recommender systems use visual signals present in the underlying data to model the visual characteristics of items and users' preferences towards them. In the domain of clothing recommendation, incorporating items' visual…

Computer Vision and Pattern Recognition · Computer Science 2018-08-23 Charles Packer , Julian McAuley , Arnau Ramisa

Emotions are multifaceted phenomena that affect our behaviour, perception, and cognition. Increasing evidence indicates that induction mechanisms play a crucial role in triggering emotions by simulating the sensations required for an…

Human-Computer Interaction · Computer Science 2022-06-17 Rukshani Somarathna , Tomasz Bednarz , Gelareh Mohammadi

Current self-supervised approaches for skeleton action representation learning often focus on constrained scenarios, where videos and skeleton data are recorded in laboratory settings. When dealing with estimated skeleton data in real-world…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Di Yang , Yaohui Wang , Antitza Dantcheva , Lorenzo Garattoni , Gianpiero Francesca , Francois Bremond

Multimodal Emotion Recognition refers to the classification of input video sequences into emotion labels based on multiple input modalities (usually video, audio and text). In recent years, Deep Neural networks have shown remarkable…

Machine Learning · Computer Science 2024-10-28 Ashish Ramayee Asokan , Nidarshan Kumar , Anirudh Venkata Ragam , Shylaja S Sharath

Webpage information extraction (WIE) is an important step to create knowledge bases. For this, classical WIE methods leverage the Document Object Model (DOM) tree of a website. However, use of the DOM tree poses significant challenges as…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Anurendra Kumar , Keval Morabia , Jingjin Wang , Kevin Chen-Chuan Chang , Alexander Schwing

Our perceptions are guided both by the bottom-up information entering our eyes, as well as our top-down expectations of what we will see. Although bottom-up visual processing has been extensively studied, comparatively little is known about…

Computer Vision and Pattern Recognition · Computer Science 2014-11-20 Michelle R. Greene , Abraham P. Botros , Diane M. Beck , Li Fei-Fei

Many attempts have been made at estimating discrete emotions (calmness, anxiety, boredom, surprise, anger) and continuous emotional measures commonly used in psychology, namely `valence' (The pleasantness of the emotion being displayed) and…

Human-Computer Interaction · Computer Science 2023-10-20 Karthik Subramanian , Saurav Singh , Justin Namba , Jamison Heard , Christopher Kanan , Ferat Sahin