English
Related papers

Related papers: Emosaic: Visualizing Affective Content of Text at …

200 papers

Images can convey rich semantics and induce various emotions in viewers. Recently, with the rapid advancement of emotional intelligence and the explosive growth of visual data, extensive research efforts have been dedicated to affective…

Computer Vision and Pattern Recognition · Computer Science 2021-07-01 Sicheng Zhao , Xingxu Yao , Jufeng Yang , Guoli Jia , Guiguang Ding , Tat-Seng Chua , Björn W. Schuller , Kurt Keutzer

We present a model to predict fine-grained emotions along the continuous dimensions of valence, arousal, and dominance (VAD) with a corpus with categorical emotion annotations. Our model is trained by minimizing the EMD (Earth Mover's…

Computation and Language · Computer Science 2021-09-13 Sungjoon Park , Jiseon Kim , Seonghyeon Ye , Jaeyeol Jeon , Hee Young Park , Alice Oh

Emotional information is essential for enhancing human-computer interaction and deepening image understanding. However, while deep learning has advanced image recognition, the intuitive understanding and precise control of emotional…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Junjie Xu , Xingjiao Wu , Tanren Yao , Zihao Zhang , Jiayang Bei , Wu Wen , Liang He

The EMPATHIC project aimed to design an emotionally expressive virtual coach capable of engaging healthy seniors to improve well-being and promote independent aging. One of the core aspects of the system is its human sensing capabilities,…

Emotion is important for creating compelling virtual reality (VR) content. Although some generative methods have been applied to lower the barrier to creating emotionally rich content, they fail to capture the nuanced emotional semantics…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Bingyuan Wang , Xingbei Chen , Zongyang Qiu , Linping Yuan , Zeyu Wang

Visual Emotion Analysis (VEA) aims at predicting people's emotional responses to visual stimuli. This is a promising, yet challenging, task in affective computing, which has drawn increasing attention in recent years. Most of the existing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Jingyuan Yang , Qirui Huang , Tingting Ding , Dani Lischinski , Daniel Cohen-Or , Hui Huang

Text data are being used as a lens through which human cognition can be studied at a large scale. Methods like emotion analysis are now in the standard toolkit of computational social scientists but typically rely on third-person annotation…

Computation and Language · Computer Science 2020-06-17 Bennett Kleinberg

Researchers since at least Darwin have debated whether and to what extent emotions are universal or culture-dependent. However, previous studies have primarily focused on facial expressions and on a limited set of emotions. Given that…

Computation and Language · Computer Science 2013-04-30 Eugene Yuta Bann , Joanna J. Bryson

Recent years have witnessed remarkable progress in image generation task, where users can create visually astonishing images with high-quality. However, existing text-to-image diffusion models are proficient in generating concrete concepts…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Jingyuan Yang , Jiawei Feng , Hui Huang

The emergence of artificial emotional intelligence technology is revolutionizing the fields of computers and robotics, allowing for a new level of communication and understanding of human behavior that was once thought impossible. While…

Computer Vision and Pattern Recognition · Computer Science 2023-07-26 James Z. Wang , Sicheng Zhao , Chenyan Wu , Reginald B. Adams , Michelle G. Newman , Tal Shafir , Rachelle Tsachor

Sentiment analysis predicts the presence of positive or negative emotions in a text document. In this paper, we consider higher dimensional extensions of the sentiment concept, which represent a richer set of human emotions. Our approach…

Computation and Language · Computer Science 2013-01-16 Seungyeon Kim , Fuxin Li , Guy Lebanon , Irfan Essa

Human emotional expression emerges through coordinated vocal, facial, and gestural signals. While speech face alignment is well established, the broader dynamics linking emotionally expressive speech to regional facial and hand motion…

Multimedia · Computer Science 2025-06-13 Von Ralph Dane Marquez Herbuela , Yukie Nagai

"How does the person in the bounding box feel?" Achieving human-level recognition of the apparent emotion of a person in real world situations remains an unsolved task in computer vision. Facial expressions are not enough: body pose,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Yasaman Etesam , Özge Nilay Yalçın , Chuxuan Zhang , Angelica Lim

Visual-textual sentiment analysis aims to predict sentiment with the input of a pair of image and text, which poses a challenge in learning effective features for diverse input images. To address this, we propose a holistic method that…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Junyu Chen , Jie An , Hanjia Lyu , Christopher Kanan , Jiebo Luo

Emotion can be expressed in many ways that can be seen such as facial expression and gestures, speech and by written text. Emotion Detection in text documents is essentially a content - based classification problem involving concepts from…

Human-Computer Interaction · Computer Science 2012-05-23 Shiv Naresh Shivhare , Saritha Khethawat

The emoticons are symbolic representations that generally accompany the textual content to visually enhance or summarize the true intention of a written message. Although widely utilized in the realm of social media, the core semantics of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Ananya Pandey , Dinesh Kumar Vishwakarma

We present EmBolic - a novel fully hyperbolic deep learning architecture for fine-grained emotion analysis from textual messages. The underlying idea is that hyperbolic geometry efficiently captures hierarchies between both words and…

Machine Learning · Computer Science 2026-04-09 Zinaid Kapić , Vladimir Jaćimović

In order to develop more precise and functional affective applications, it is necessary to achieve a balance between the psychology and the engineering applied to emotions. Signals from the central and peripheral nervous systems have been…

Human-Computer Interaction · Computer Science 2019-05-02 Jennifer Sorinas , Jose Manuel Ferrández , Eduardo Fernandez

Due to the complex nature of human emotions and the diversity of emotion representation methods in humans, emotion recognition is a challenging field. In this research, three input modalities, namely text, audio (speech), and video, are…

Artificial Intelligence · Computer Science 2024-02-13 Minoo Shayaninasab , Bagher Babaali

Estimating dimensional emotions, such as activation, valence and dominance, from acoustic speech signals has been widely explored over the past few years. While accurate estimation of activation and dominance from speech seem to be…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-08 Vikramjit Mitra , Hsiang-Yun Sherry Chien , Vasudha Kowtha , Joseph Yitan Cheng , Erdrin Azemi