English
Related papers

Related papers: Affection: Learning Affective Explanations for Rea…

200 papers

Emotional Video Captioning (EVC) is an emerging task, which aims to describe factual content with the intrinsic emotions expressed in videos. Existing works perceive global emotional cues and then combine with video content to generate…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Weidong Chen , Cheng Ye , Zhendong Mao , Peipei Song , Xinyan Liu , Lei Zhang , Xiaojun Chang , Yongdong Zhang

Large language models (LLMs) show promising capabilities in predicting human emotions from text. However, the mechanisms through which these models process emotional stimuli remain largely unexplored. Our study addresses this gap by…

Computation and Language · Computer Science 2025-07-01 Ala N. Tak , Amin Banayeeanzade , Anahita Bolourani , Mina Kian , Robin Jia , Jonathan Gratch

Multimodal sentiment analysis aims to recognize people's attitudes from multiple communication channels such as verbal content (i.e., text), voice, and facial expressions. It has become a vibrant and important research topic in natural…

Machine Learning · Computer Science 2022-02-23 Xingbo Wang , Jianben He , Zhihua Jin , Muqiao Yang , Yong Wang , Huamin Qu

Affective Image Manipulation (AIM) seeks to modify user-provided images to evoke specific emotional responses. This task is inherently complex due to its twofold objective: significantly evoking the intended emotion, while preserving the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Jingyuan Yang , Jiawei Feng , Weibin Luo , Dani Lischinski , Daniel Cohen-Or , Hui Huang

Emotions are very important for human intelligence. For example, emotions are closely related to the appraisal of the internal bodily state and external stimuli. This helps us to respond quickly to the environment. Another important…

Artificial Intelligence · Computer Science 2018-08-28 Chie Hieida , Takato Horii , Takayuki Nagai

Emotion detection is an established NLP task of demonstrated utility for text understanding. However, basic emotion detection leaves out key information, namely, who is experiencing the emotion in question. For example, it may be the…

Computation and Language · Computer Science 2022-02-17 Samira Zad , Joshuan Jimenez , Mark A. Finlayson

Empathetic dialogue is a human-like behavior that requires the perception of both affective factors (e.g., emotion status) and cognitive factors (e.g., cause of the emotion). Besides concerning emotion status in early work, the latest…

Computation and Language · Computer Science 2023-02-24 Yushan Qian , Bo Wang , Ting-En Lin , Yinhe Zheng , Ying Zhu , Dongming Zhao , Yuexian Hou , Yuchuan Wu , Yongbin Li

For speech emotion datasets, it has been difficult to acquire large quantities of reliable data and acted emotions may be over the top compared to less expressive emotions displayed in everyday life. Lately, larger datasets with natural…

Computation and Language · Computer Science 2022-07-06 Rosanna Milner , Md Asif Jalal , Raymond W. M. Ng , Thomas Hain

Availability of naturalistic affective stimuli is needed for creating the affective technological solution as well as making progress in affective science. Although a lot of progress in the collection of affective multimedia stimuli has…

Image and Video Processing · Electrical Eng. & Systems 2022-10-19 Sudhakar Mishra , Narayanan Srinivasan , Uma Shanker Tiwary

Technological advancement and its omnipresent connection have pushed humans past the boundaries and limitations of a computer screen, physical state, or geographical location. It has provided a depth of avenues that facilitate…

Multimedia · Computer Science 2023-11-21 Dayo Samuel Banjo , Connice Trimmingham , Niloofar Yousefi , Nitin Agarwal

Understanding the multi-dimensional attributes and intensity nuances of image-evoked emotions is pivotal for advancing machine empathy and empowering diverse human-computer interaction applications. However, existing models are still…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Lancheng Gao , Ziheng Jia , Zixuan Xing , Wei Sun , Huiyu Duan , Guangtao Zhai , Xiongkuo Min

Emotion can be expressed in many ways that can be seen such as facial expression and gestures, speech and by written text. Emotion Detection in text documents is essentially a content - based classification problem involving concepts from…

Human-Computer Interaction · Computer Science 2012-05-23 Shiv Naresh Shivhare , Saritha Khethawat

This work defines a procedure for collecting naturally induced emotional facial expressions through the vision of movie excerpts with high emotional contents and reports experimental data ascertaining the effects of emotions on memory word…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Anna Esposito , Vincenzo Capuano , Jiri Mekyska , Marcos Faundez-Zanuy

This research investigates how people engage with data visualizations when commenting on the social platform Reddit. There has been considerable research on collaborative sensemaking with visualizations and the personal relation of people…

Human-Computer Interaction · Computer Science 2021-03-18 Tobias Kauer , Arran Ridley , Marian Dörk , Benjamin Bach

In this work, user's emotion using its facial expressions will be detected. These expressions can be derived from the live feed via system's camera or any pre-exisiting image available in the memory. Emotions possessed by humans can be…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Raghav Puri , Archit Gupta , Manas Sikri , Mohit Tiwari , Nitish Pathak , Shivendra Goel

The portrayal of negative emotions such as anger can vary widely between cultures and contexts, depending on the acceptability of expressing full-blown emotions rather than suppression to maintain harmony. The majority of emotional datasets…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Roya Javadi , Angelica Lim

Authors of posts in social media communicate their emotions and what causes them with text and images. While there is work on emotion and stimulus detection for each modality separately, it is yet unknown if the modalities contain…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Anna Khlyzova , Carina Silberer , Roman Klinger

Images can convey rich semantics and induce various emotions in viewers. Recently, with the rapid advancement of emotional intelligence and the explosive growth of visual data, extensive research efforts have been dedicated to affective…

Computer Vision and Pattern Recognition · Computer Science 2021-07-01 Sicheng Zhao , Xingxu Yao , Jufeng Yang , Guoli Jia , Guiguang Ding , Tat-Seng Chua , Björn W. Schuller , Kurt Keutzer

Sentiment analysis aims to extract and express a person's perception, opinions and emotions towards an entity, object, product and a service, enabling businesses to obtain feedback from the consumers. The increasing popularity of the social…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Kashif Ahmad , Syed Zohaib , Nicola Conci , Ala Al-Fuqaha

Ambiguity in emotion analysis stems both from potentially missing information and the subjectivity of interpreting a text. The latter did receive substantial attention, but can we fill missing information to resolve ambiguity? We address…

Computation and Language · Computer Science 2026-03-23 Johannes Schäfer , Roman Klinger