English
Related papers

Related papers: Affection: Learning Affective Explanations for Rea…

200 papers

Large Vision-Language Models (VLMs) have achieved unprecedented success in several objective multimodal reasoning tasks. However, to further enhance their capabilities of empathetic and effective communication with humans, improving how…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Sree Bhattacharyya , James Z. Wang

Emotion cause analysis has received considerable attention in recent years. Previous studies primarily focused on emotion cause extraction from texts in news articles or microblogs. It is also interesting to discover emotions and their…

Computation and Language · Computer Science 2021-10-18 Fanfan Wang , Zixiang Ding , Rui Xia , Zhaoyu Li , Jianfei Yu

Recognizing emotions during social interactions has many potential applications with the popularization of low-cost mobile sensors, but a challenge remains with the lack of naturalistic affective interaction data. Most existing emotion…

Human-Computer Interaction · Computer Science 2020-09-15 Cheul Young Park , Narae Cha , Soowon Kang , Auk Kim , Ahsan Habib Khandoker , Leontios Hadjileontiadis , Alice Oh , Yong Jeong , Uichin Lee

In a world where technology is increasingly embedded in our everyday experiences, systems that sense and respond to human emotions are elevating digital interaction. At the intersection of artificial intelligence and human-computer…

Human-Computer Interaction · Computer Science 2025-05-06 Karishma Hegde , Hemadri Jayalath

Affective computing is an emerging interdisciplinary field where computational systems are developed to analyze, recognize, and influence the affective states of a human. It can generally be divided into two subproblems: affective…

Machine Learning · Computer Science 2022-02-23 Guangtao Nie , Yibing Zhan

Computational modeling of the emotions evoked by art in humans is a challenging problem because of the subjective and nuanced nature of art and affective signals. In this paper, we consider the above-mentioned problem of understanding…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Digbalay Bose , Krishna Somandepalli , Souvik Kundu , Rimita Lahiri , Jonathan Gratch , Shrikanth Narayanan

The recent progress on image recognition and language modeling is making automatic description of image content a reality. However, stylized, non-factual aspects of the written description are missing from the current systems. One such…

Computer Vision and Pattern Recognition · Computer Science 2015-12-15 Alexander Mathews , Lexing Xie , Xuming He

Recent models of emotion recognition strongly rely on supervised deep learning solutions for the distinction of general emotion expressions. However, they are not reliable when recognizing online and personalized facial expressions, e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Pablo Barros , German I. Parisi , Stefan Wermter

We address the problem of recognizing emotion cause in conversations, define two novel sub-tasks of this problem, and provide a corresponding dialogue-level dataset, along with strong Transformer-based baselines. The dataset is available at…

There is a mismatch between psychological and computational studies on emotions. Psychological research aims at explaining and documenting internal mechanisms of these phenomena, while computational work often simplifies them into labels.…

Computation and Language · Computer Science 2026-02-03 Enrica Troiano , Sofie Labat , Marco Antonio Stranisci , Viviana Patti , Rossana Damiano , Roman Klinger

Experiments in affective computing are based on stimulus datasets that, in the process of standardization, receive metadata describing which emotions each stimulus evokes. In this paper, we explore an approach to creating stimulus datasets…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Jan Ignatowicz , Krzysztof Kutt , Grzegorz J. Nalepa

In recent years, extensive research has emerged in affective computing on topics like automatic emotion recognition and determining the signals that characterize individual emotions. Much less studied, however, is expressiveness, or the…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Victoria Lin , Jeffrey M. Girard , Louis-Philippe Morency

In this paper we propose a new approach for classifying the global emotion of images containing groups of people. To achieve this task, we consider two different and complementary sources of information: i) a global representation of the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-11 Aarush Gupta , Dakshit Agrawal , Hardik Chauhan , Jose Dolz , Marco Pedersoli

Facial expressions play a fundamental role in human communication. Indeed, they typically reveal the real emotional status of people beyond the spoken language. Moreover, the comprehension of human affect based on visual patterns is a key…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Fabio Valerio Massoli , Donato Cafarelli , Giuseppe Amato , Fabrizio Falchi

Multimodal conversation, a crucial form of human communication, carries rich emotional content, making the exploration of the causes of emotions within it a research endeavor of significant importance. However, existing research on the…

Computation and Language · Computer Science 2025-06-05 Lin Wang , Xiaocui Yang , Shi Feng , Daling Wang , Yifei Zhang , Zhitao Zhang

As data visualizations have been increasingly applied in mass communication, designers often seek to grasp viewers immediately and motivate them to read more. Such goals, as suggested by previous research, are closely associated with the…

Human-Computer Interaction · Computer Science 2022-11-08 Xingyu Lan , Yanqiu Wu , Qing Chen , Nan Cao

Computational inference of aesthetics is an ill-defined task due to its subjective nature. Many datasets have been proposed to tackle the problem by providing pairs of images and aesthetic scores based on human ratings. However, humans are…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Daniel Vera Nieto , Luigi Celona , Clara Fernandez-Labrador

Emotions play a critical role in our everyday lives by altering how we perceive, process and respond to our environment. Affective computing aims to instill in computers the ability to detect and act on the emotions of human actors. A core…

Computation and Language · Computer Science 2020-08-31 Connor T. Heaton , David M. Schwartz

Emotions are reactions that can be expressed through a variety of social signals. For example, anger can be expressed through a scowl, narrowed eyes, a long stare, or many other expressions. This complexity is problematic when attempting to…

Robotics · Computer Science 2021-03-09 Ghazal Saheb Jam , Jimin Rhim , Angelica Lim

Human affective recognition is an important factor in human-computer interaction. However, the method development with in-the-wild data is not yet accurate enough for practical usage. In this paper, we introduce the affective recognition…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Sachihiro Youoku , Yuushi Toyoda , Takahisa Yamamoto , Junya Saito , Ryosuke Kawamura , Xiaoyu Mi , Kentaro Murase