English
Related papers

Related papers: VAEER: Visual Attention-Inspired Emotion Elicitati…

200 papers

Emotion recognition is a complex task due to the inherent subjectivity in both the perception and production of emotions. The subjectivity of emotions poses significant challenges in developing accurate and robust computational models. This…

Machine Learning · Computer Science 2023-09-08 Mimansa Jaiswal

The continuous improvement of human-computer interaction technology makes it possible to compute emotions. In this paper, we introduce our submission to the CVPR 2023 Competition on Affective Behavior Analysis in-the-wild (ABAW). Sentiment…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Tao Shu , Xinke Wang , Ruotong Wang , Chuang Chen , Yixin Zhang , Xiao Sun

Evidence accumulation models (EAMs) are the dominant framework for modeling response time (RT) data from speeded decision-making tasks. While providing a good quantitative description of RT data in terms of abstract perceptual…

Neurons and Cognition · Quantitative Biology 2024-12-10 Paul I. Jaffe , Gustavo X. Santiago-Reyes , Robert J. Schafer , Patrick G. Bissett , Russell A. Poldrack

In this paper, we introduce EmoGist, a training-free, in-context learning method for performing visual emotion classification with LVLMs. The key intuition of our approach is that context-dependent definition of emotion labels could allow…

Computation and Language · Computer Science 2025-09-23 Ronald Seoh , Dan Goldwasser

Automatic live video commenting is with increasing attention due to its significance in narration generation, topic explanation, etc. However, the diverse sentiment consideration of the generated comments is missing from the current…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Fengyi Fu , Shancheng Fang , Weidong Chen , Zhendong Mao

The wealth of text data generated by social media has enabled new kinds of analysis of emotions with language models. These models are often trained on small and costly datasets of text annotations produced by readers who guess the emotions…

Computation and Language · Computer Science 2023-04-24 Segun Taofeek Aroyehun , Lukas Malik , Hannah Metzler , Nikolas Haimerl , Anna Di Natale , David Garcia

As tons of photos are being uploaded to public websites (e.g., Flickr, Bing, and Google) every day, learning from web data has become an increasingly popular research direction because of freely available web resources, which is also…

Computer Vision and Pattern Recognition · Computer Science 2018-05-25 Li Niu , Qingtao Tang , Ashok Veeraraghavan , Ashu Sabharwal

Detecting emotions expressed in text has become critical to a range of fields. In this work, we investigate ways to exploit label correlations in multi-label emotion recognition models to improve emotion detection. First, we develop two…

Computation and Language · Computer Science 2023-03-14 Georgios Chochlakis , Gireesh Mahajan , Sabyasachee Baruah , Keith Burghardt , Kristina Lerman , Shrikanth Narayanan

Recently unpaired multi-domain image-to-image translation has attracted great interests and obtained remarkable progress, where a label vector is utilized to indicate multi-domain information. In this paper, we propose SAT (Show, Attend and…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Honglun Zhang , Wenqing Chen , Jidong Tian , Yongkun Wang , Yaohui Jin

The emergence of artificial emotional intelligence technology is revolutionizing the fields of computers and robotics, allowing for a new level of communication and understanding of human behavior that was once thought impossible. While…

Computer Vision and Pattern Recognition · Computer Science 2023-07-26 James Z. Wang , Sicheng Zhao , Chenyan Wu , Reginald B. Adams , Michelle G. Newman , Tal Shafir , Rachelle Tsachor

Emotion Recognition (ER) is the process of identifying human emotions from given data. Currently, the field heavily relies on facial expression recognition (FER) because facial expressions contain rich emotional cues. However, it is…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Yuanyuan Liu , Lin Wei , Kejun Liu , Yibing Zhan , Zijing Chen , Zhe Chen , Shiguang Shan

The valence analysis of speakers' utterances or written posts helps to understand the activation and variations of the emotional state throughout the conversation. More recently, the concept of Emotion Carriers (EC) has been introduced to…

Computation and Language · Computer Science 2023-11-01 Gabriel Roccabruna , Seyed Mahed Mousavi , Giuseppe Riccardi

Visual-semantic embedding models have been recently proposed and shown to be effective for image classification and zero-shot learning, by mapping images into a continuous semantic label space. Although several approaches have been proposed…

Computer Vision and Pattern Recognition · Computer Science 2015-12-23 Zhou Ren , Hailin Jin , Zhe Lin , Chen Fang , Alan Yuille

In psychoanalysis, generating interpretations to one's psychological state through visual creations is facing significant demands. The two main tasks of existing studies in the field of computer vision, sentiment/emotion classification and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Likun Yang , Xiaokun Feng , Xiaotang Chen , Shiyu Zhang , Kaiqi Huang

Human affective recognition is an important factor in human-computer interaction. However, the method development with in-the-wild data is not yet accurate enough for practical usage. In this paper, we introduce the affective recognition…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Sachihiro Youoku , Yuushi Toyoda , Takahisa Yamamoto , Junya Saito , Ryosuke Kawamura , Xiaoyu Mi , Kentaro Murase

This paper proposes a multimodal emotion recognition system based on hybrid fusion that classifies the emotions depicted by speech utterances and corresponding images into discrete classes. A new interpretability technique has been…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Puneet Kumar , Sarthak Malik , Balasubramanian Raman

Facial Expression Recognition (FER) plays a crucial role in human affective analysis and has been widely applied in computer vision tasks such as human-computer interaction and psychological assessment. The 8th Affective Behavior Analysis…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 JunGyu Lee , Kunyoung Lee , Haesol Park , Ig-Jae Kim , Gi Pyo Nam

Emotions play a key role in human communication and public presentations. Human emotions are usually expressed through multiple modalities. Therefore, exploring multimodal emotions and their coherence is of great value for understanding…

Computer Vision and Pattern Recognition · Computer Science 2019-10-10 Haipeng Zeng , Xingbo Wang , Aoyu Wu , Yong Wang , Quan Li , Alex Endert , Huamin Qu

The Visual Object Information Retrieval (VOIR) system described in this paper implements an image retrieval approach that combines two layers, the conceptual and the visual layer. It uses terms from a textual thesaurus to represent the…

Information Retrieval · Computer Science 2008-09-30 Jose Torres , Luis Paulo Reis

The natural language processing and multimedia field has seen a notable surge in interest in multimodal sentiment recognition. Hence, this study aims to employ Target-Dependent Multimodal Sentiment Analysis (TDMSA) to identify the level of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Ananya Pandey , Dinesh Kumar Vishwakarma