English
Related papers

Related papers: Contextual Emotion Estimation from Image Captions

200 papers

This paper explores the potential of large language models (LLMs) as reliable analytical tools in linguistic research, focusing on the emergence of affective meanings in temporal expressions involving manner-of-motion verbs. While LLMs like…

Computation and Language · Computer Science 2025-07-15 Rosa Illan Castillo , Javier Valenzuela

Emotional support is a core capability in human-AI interaction, with applications including psychological counseling, role play, and companionship. However, existing evaluations of large language models (LLMs) often rely on short, static…

Computation and Language · Computer Science 2025-11-13 Zhouxing Tan , Ruochong Xiong , Yulong Wan , Jinlong Ma , Hanlin Xue , Qichun Deng , Haifeng Jing , Zhengtong Zhang , Depei Liu , Shiyuan Luo , Junfei Liu

It is important for machines to interpret human emotions properly for better human-machine communications, as emotion is an essential part of human-to-human communications. One aspect of emotion is reflected in the language we use. How to…

Computation and Language · Computer Science 2018-08-23 Ji Ho Park

Automatically captioning visualizations is not new, but recent advances in large language models(LLMs) open exciting new possibilities. In this tutorial, after providing a brief review of Information Visualization (InfoVis) principles and…

Computation and Language · Computer Science 2024-07-01 Giuseppe Carenini , Jordon Johnson , Ali Salamatian

Large Language Models (LLMs) have demonstrated a number of human-like abilities, however the empathic understanding and emotional state of LLMs is yet to be aligned to that of humans. In this work, we investigate how the emotional state of…

Artificial Intelligence · Computer Science 2024-02-08 Ciaran Regan , Nanami Iwahashi , Shogo Tanaka , Mizuki Oka

Understanding how emotional expression in language relates to brain function is a challenge in computational neuroscience and affective computing. Traditional neuroimaging is costly and lab-bound, but abundant digital text offers new…

Computation and Language · Computer Science 2025-12-23 Gideon Vos , Maryam Ebrahimpour , Liza van Eijk , Zoltan Sarnyai , Mostafa Rahimi Azghadi

Large language models (LLMs) have enabled a wide variety of real-world applications in various domains. However, creating a high-performing application with high accuracy remains challenging, particularly for subjective tasks like emotion…

Computation and Language · Computer Science 2025-07-01 Mengqi Wang , Tiantian Feng , Shrikanth Narayanan

In this work, we conduct an analysis to examine the consistency of Large Language Models (LLMs) with respect to their own generated responses in an emotionally-driven conversational context. Specifically, the text generated by LLM is framed…

Computation and Language · Computer Science 2026-05-08 Sneha Oram , Ojaswita Bhushan , Pushpak Bhattacharyya

Understanding the property of neural populations (or voxels) in the human brain can advance our comprehension of human perceptual and cognitive processing capabilities and contribute to developing brain-inspired computer models. Recent…

Neurons and Cognition · Quantitative Biology 2026-03-10 Takuya Matsuyama , Shinji Nishimoto , Yu Takagi

Knowledge-based visual question answering (VQA) involves questions that require world knowledge beyond the image to yield the correct answer. Large language models (LMs) like GPT-3 are particularly helpful for this task because of their…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Yushi Hu , Hang Hua , Zhengyuan Yang , Weijia Shi , Noah A Smith , Jiebo Luo

Emotion detection is a central problem in NLP, with recent progress driven by transformer-based models trained on established datasets. However, little is known about the linguistic regularities that characterize how emotions are expressed…

Computation and Language · Computer Science 2026-03-24 Florian Lecourt , Madalina Croitoru , Konstantin Todorov

In daily life, images as common affective stimuli have widespread applications. Despite significant progress in text-driven image editing, there is limited work focusing on understanding users' emotional requests. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Peixuan Zhang , Shuchen Weng , Chengxuan Zhu , Binghao Tang , Zijian Jia , Si Li , Boxin Shi

The analysis of students' emotions and behaviors is crucial for enhancing learning outcomes and personalizing educational experiences. Traditional methods often rely on intrusive visual and physiological data collection, posing privacy…

Computation and Language · Computer Science 2024-08-14 Kaito Tanaka , Benjamin Tan , Brian Wong

World Models serve as tools for understanding the current state of the world and predicting its future dynamics, with broad application potential across numerous fields. As a key component of world knowledge, emotion significantly…

Computation and Language · Computer Science 2026-01-01 Changhao Song , Yazhou Zhang , Hui Gao , Chang Yang , Peng Zhang

Generating stylized captions for an image is an emerging topic in image captioning. Given an image as input, it requires the system to generate a caption that has a specific style (e.g., humorous, romantic, positive, and negative) while…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Tianlang Chen , Zhongping Zhang , Quanzeng You , Chen Fang , Zhaowen Wang , Hailin Jin , Jiebo Luo

Large language models generate judgments that resemble those of humans. Yet the extent to which these models align with human judgments in interpreting figurative and socially grounded language remains uncertain. To investigate this, human…

Computation and Language · Computer Science 2026-01-15 Samhita Bollepally , Aurora Sloman-Moll , Takashi Yamauchi

Modern astronomical surveys deliver immense volumes of transient detections, yet distinguishing real astrophysical signals (for example, explosive events) from bogus imaging artefacts remains a challenge. Convolutional neural networks are…

Instrumentation and Methods for Astrophysics · Physics 2025-10-09 Fiorenzo Stoppa , Turan Bulmus , Steven Bloemen , Stephen J. Smartt , Paul J. Groot , Paul Vreeswijk , Ken W. Smith

Large Language Models (LLMs) have shown significant limitations in understanding creative content, as demonstrated by Hessel et al. (2023)'s influential work on the New Yorker Cartoon Caption Contest (NYCCC). Their study exposed a…

Computation and Language · Computer Science 2025-02-28 Kuan Lok Zhou , Jiayi Chen , Siddharth Suresh , Reuben Narad , Timothy T. Rogers , Lalit K Jain , Robert D Nowak , Bob Mankoff , Jifan Zhang

Image emotion classification (IEC) is a longstanding research field that has received increasing attention with the rapid progress of deep learning. Although recent advances have leveraged the knowledge encoded in pre-trained visual models,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zibo Zhou , Zhengjun Zhai , Huimin Chen , Wei Dai , Hansen Yang

Emotion is a crucial phenomenon in the functioning of human beings in society. However, it remains a widely open subject, particularly in its textual manifestations. This paper examines an industrial corpus manually annotated following an…

Computation and Language · Computer Science 2025-09-03 Jonas Noblet