English
Related papers

Related papers: Valence-Arousal Subspace in LLMs: Circular Emotion…

200 papers

This paper addresses the problem of automatic emotion recognition in the scope of the One-Minute Gradual-Emotional Behavior challenge (OMG-Emotion challenge). The underlying objective of the challenge is the automatic estimation of emotion…

Artificial Intelligence · Computer Science 2018-05-04 Pedro M. Ferreira , Diogo Pernes , Kelwin Fernandes , Ana Rebelo , Jaime S. Cardoso

Visual Emotion Analysis (VEA), which aims to predict people's emotions towards different visual stimuli, has become an attractive research topic recently. Rather than a single label classification task, it is more rational to regard VEA as…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Jingyuan Yang , Jie Li , Leida Li , Xiumei Wang , Yuxuan Ding , Xinbo Gao

Evaluating Large Language Models' (LLMs) anthropomorphic capabilities has become increasingly important in contemporary discourse. Utilizing the emotion appraisal theory from psychology, we propose to evaluate the empathy ability of LLMs,…

Computation and Language · Computer Science 2024-10-08 Jen-tse Huang , Man Ho Lam , Eric John Li , Shujie Ren , Wenxuan Wang , Wenxiang Jiao , Zhaopeng Tu , Michael R. Lyu

Facial Emotion Analysis (FEA) extends traditional facial emotion recognition by incorporating explainable, fine-grained reasoning. The task integrates three subtasks: emotion recognition, facial Action Unit (AU) recognition, and AU-based…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Jiulong Wu , Yucheng Shen , Lingyong Yan , Haixin Sun , Deguo Xia , Jizhou Huang , Min Cao

Recent advances in mechanistic interpretability have revealed that large language models (LLMs) develop internal representations corresponding not only to concrete entities but also distinct, human-understandable abstract concepts and…

Machine Learning · Computer Science 2025-12-01 Rio Alexa Fear , Payel Mukhopadhyay , Michael McCabe , Alberto Bietti , Miles Cranmer

Large language models can generate responses that resemble emotional distress, and this raises concerns around model reliability and safety. We introduce a set of evaluations to investigate expressions of distress in LLMs, and find that…

Computation and Language · Computer Science 2026-03-12 Anna Soligo , Vladimir Mikulik , William Saunders

A variational autoencoder (VAE) is a probabilistic machine learning framework for posterior inference that projects an input set of high-dimensional data to a lower-dimensional, latent space. The latent space learned with a VAE offers…

Machine Learning · Computer Science 2022-11-16 Rafael Pastrana

As robotics become increasingly integrated into construction workflows, their ability to interpret and respond to human behavior will be essential for enabling safe and effective collaboration. Vision-Language Models (VLMs) have emerged as…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Hieu Bui , Nathaniel E. Chodosh , Arash Tavakoli

Variational autoencoders (VAEs) have been widely applied for text modeling. In practice, however, they are troubled by two challenges: information underrepresentation and posterior collapse. The former arises as only the last hidden state…

Machine Learning · Computer Science 2021-06-17 Xianghong Fang , Haoli Bai , Jian Li , Zenglin Xu , Michael Lyu , Irwin King

Large language models (LLMs) have been widely applied to emotional support conversation (ESC). However, complex multi-turn support remains challenging.This is because existing alignment schemes rely on sparse outcome-level signals, thus…

Computation and Language · Computer Science 2026-04-30 Chenghui Zou , Ning Wang , Tiesunlong Shen , Luwei Xiao , Chuan Ma , Xiangpeng Li , Rui Mao , Erik Cambria

While affective expressions on social media have been extensively studied, most research has focused on the Western context. This paper explores cultural differences in affective expressions by comparing valence and arousal on Twitter/X…

Computers and Society · Computer Science 2025-02-11 Young-Min Cho , Dandan Pang , Stuti Thapa , Garrick Sherman , Lyle Ungar , Louis Tay , Sharath Chandra Guntuku

A hallmark of variational autoencoders (VAEs) for text processing is their combination of powerful encoder-decoder models, such as LSTMs, with simple latent distributions, typically multivariate Gaussians. These models pose a difficult…

Computation and Language · Computer Science 2018-10-15 Jiacheng Xu , Greg Durrett

Multimodal Emotion Recognition (MER) focuses on identifying and interpreting emotions from modality-compound inputs. Closely mirroring human cognitive processes in real-world environments, MER has drawn substantial attention from both…

Multimedia · Computer Science 2026-05-21 Hongrui Zhang , Daiqing Wu , Yangyang Li , Kuien Liu , Yuhui Wang , Yu Zhou , Sicheng Zhao

Open-Vocabulary Multimodal Emotion Recognition (OV-MER) aims to predict emotions without being constrained by predefined label spaces, thereby enabling fine-grained emotion understanding. Unlike traditional discriminative methods, OV-MER…

Human-Computer Interaction · Computer Science 2026-05-08 Zheng Lian , Fan Zhang , Lan Chen , Yazhou Zhang , Rui Liu , Jinyang Wu , Haoyu Chen , Xiaobai Li , Xiaojiang Peng , Bin He , Jianhua Tao

Controlling specific behaviors in large language models while preserving their general capabilities is a central challenge for safe and reliable artificial intelligence deployment. Current steering methods, such as vector addition and…

Machine Learning · Computer Science 2025-10-31 Hieu M. Vu , Tan M. Nguyen

In order to develop more precise and functional affective applications, it is necessary to achieve a balance between the psychology and the engineering applied to emotions. Signals from the central and peripheral nervous systems have been…

Human-Computer Interaction · Computer Science 2019-05-02 Jennifer Sorinas , Jose Manuel Ferrández , Eduardo Fernandez

The valence analysis of speakers' utterances or written posts helps to understand the activation and variations of the emotional state throughout the conversation. More recently, the concept of Emotion Carriers (EC) has been introduced to…

Computation and Language · Computer Science 2023-11-01 Gabriel Roccabruna , Seyed Mahed Mousavi , Giuseppe Riccardi

Spatial relations are a basic part of human cognition. However, they are expressed in natural language in a variety of ways, and previous work has suggested that current vision-and-language models (VLMs) struggle to capture relational…

Computation and Language · Computer Science 2023-03-23 Fangyu Liu , Guy Emerson , Nigel Collier

Emotion recognition has become a major problem in computer vision in recent years that made a lot of effort by researchers to overcome the difficulties in this task. In the field of affective computing, emotion recognition has a wide range…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Hoang Manh Hung , Hyung-Jeong Yang , Soo-Hyung Kim , Guee-Sang Lee

Vision-Language-Action Models (VLAs) have shown remarkable progress towards embodied intelligence. While their architecture partially resembles that of Large Language Models (LLMs), VLAs exhibit higher complexity due to their multi-modal…

Robotics · Computer Science 2026-03-06 Hugo Buurmeijer , Carmen Amo Alonso , Aiden Swann , Marco Pavone