English
Related papers

Related papers: Contextual Emotion Recognition using Large Vision …

200 papers

Understanding emotions in natural language is inherently a multi-dimensional reasoning problem, where multiple affective signals interact through context, interpersonal relations, and situational cues. However, most existing emotion…

Computation and Language · Computer Science 2026-04-02 Hemanth Kotaprolu , Kishan Maharaj , Raey Zhao , Abhijit Mishra , Pushpak Bhattacharyya

Emotion recognition in dynamic social contexts requires an understanding of the complex interaction between facial expressions and situational cues. This paper presents a salience-adjusted framework for context-aware emotion recognition…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Bin Han , Jonathan Gratch

After the inception of emotion recognition or affective computing, it has increasingly become an active research topic due to its broad applications. Over the past couple of decades, emotion recognition models have gradually migrated from…

Computation and Language · Computer Science 2023-08-23 Zixing Zhang , Liyizhe Peng , Tao Pang , Jing Han , Huan Zhao , Bjorn W. Schuller

Evaluating Large Language Models' (LLMs) anthropomorphic capabilities has become increasingly important in contemporary discourse. Utilizing the emotion appraisal theory from psychology, we propose to evaluate the empathy ability of LLMs,…

Computation and Language · Computer Science 2024-10-08 Jen-tse Huang , Man Ho Lam , Eric John Li , Shujie Ren , Wenxuan Wang , Wenxiang Jiao , Zhaopeng Tu , Michael R. Lyu

Understanding emotions is a fundamental ability for intelligent systems to be able to interact with humans. Vision-language models (VLMs) have made tremendous progress in the last few years for many visual tasks, potentially offering a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Madhav Agarwal , Sotirios A. Tsaftaris , Laura Sevilla-Lara , Steven McDonagh

Human affect recognition is a well-established research area with numerous applications, e.g., in psychological care, but existing methods assume that all emotions-of-interest are given a priori as annotated training examples. However, the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Kunyu Peng , Alina Roitberg , David Schneider , Marios Koulakis , Kailun Yang , Rainer Stiefelhagen

Emotion recognition is a core research area at the intersection of artificial intelligence and human communication analysis. It is a significant technical challenge since humans display their emotions through complex idiosyncratic…

Human-Computer Interaction · Computer Science 2018-09-14 Paul Pu Liang , Amir Zadeh , Louis-Philippe Morency

Applications of an efficient emotion recognition system can be found in several domains such as medicine, driver fatigue surveillance, social robotics, and human-computer interaction. Appraising human emotional states, behaviors, and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Savinay Nagendra , Prapti Panigrahi

Large language models (LLMs) and their variants have shown extraordinary efficacy across numerous downstream natural language processing (NLP) tasks, which has presented a new vision for the development of NLP. Despite their remarkable…

Computation and Language · Computer Science 2024-01-18 Yazhou Zhang , Mengyao Wang , Youxi Wu , Prayag Tiwari , Qiuchi Li , Benyou Wang , Jing Qin

Psychological research results have confirmed that people can have different emotional reactions to different visual stimuli. Several papers have been published on the problem of visual emotion analysis. In particular, attempts have been…

Artificial Intelligence · Computer Science 2016-05-10 Quanzeng You , Jiebo Luo , Hailin Jin , Jianchao Yang

People have the ability to make sensible assumptions about other people's emotional states by being sympathetic, and because of our common sense of knowledge and the ability to think visually. Over the years, much research has been done on…

Human-Computer Interaction · Computer Science 2021-06-30 Stuti Sehgal , Harsh Sharma , Akshat Anand

Automatic emotion recognition has become a trending research topic in the past decade. While works based on facial expressions or speech abound, recognizing affect from body gestures remains a less explored topic. We present a new…

Computer Vision and Pattern Recognition · Computer Science 2018-01-24 Fatemeh Noroozi , Ciprian Adrian Corneanu , Dorota Kamińska , Tomasz Sapiński , Sergio Escalera , Gholamreza Anbarjafari

Recently, Multimodal Large Language Models (MLLMs) have achieved exceptional performance across diverse tasks, continually surpassing previous expectations regarding their capabilities. Nevertheless, their proficiency in perceiving emotions…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Daiqing Wu , Dongbao Yang , Sicheng Zhao , Can Ma , Yu Zhou

An image is a very effective tool for conveying emotions. Many researchers have investigated in computing the image emotions by using various features extracted from images. In this paper, we focus on two high level features, the object and…

Computer Vision and Pattern Recognition · Computer Science 2017-07-04 Hye-Rin Kim , Yeong-Seok Kim , Seon Joo Kim , In-Kwon Lee

The performance of ChatGPT\copyright{} and other LLMs has improved tremendously, and in online environments, they are increasingly likely to be used in a wide variety of situations, such as ChatBot on web pages, call center operations using…

Human-Computer Interaction · Computer Science 2025-02-19 Hiroki Tanioka , Tetsushi Ueta , Masahiko Sano

Emotions conveyed through voice and face shape engagement and context in human AI interaction. Despite rapid progress in omni modal large language models, the holistic evaluation of emotional reasoning with audiovisual cues remains limited.…

Vision-language models (VLMs) show promise as tools for inferring affect from visual stimuli at scale; it is not yet clear how closely their outputs align with human affective ratings. We benchmarked nine VLMs, ranging from state-of-the-art…

Vision Large Language Models (VLLMs) are transforming the intersection of computer vision and natural language processing. Nonetheless, the potential of using visual prompts for emotion recognition in these models remains largely unexplored…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Qixuan Zhang , Zhifeng Wang , Dylan Zhang , Wenjia Niu , Sabrina Caldwell , Tom Gedeon , Yang Liu , Zhenyue Qin

Classification of human emotions remains an important and challenging task for many computer vision algorithms, especially in the era of humanoid robots which coexist with humans in their everyday life. Currently proposed methods for…

Computer Vision and Pattern Recognition · Computer Science 2018-10-25 Ivona Tautkute , Tomasz Trzcinski , Adam Bielski

Emotion recognition plays a crucial role in various domains of human-robot interaction. In long-term interactions with humans, robots need to respond continuously and accurately, however, the mainstream emotion recognition methods mostly…

Human-Computer Interaction · Computer Science 2024-01-23 Zihan Lin , Francisco Cruz , Eduardo Benitez Sandoval