English
Related papers

Related papers: GPT-4V with Emotion: A Zero-shot Benchmark for Gen…

200 papers

In human-computer interaction, Speech Emotion Recognition (SER) plays an essential role in understanding the user's intent and improving the interactive experience. While similar sentimental speeches own diverse speaker characteristics but…

Sound · Computer Science 2022-11-08 Jia-Xin Ye , Xin-Cheng Wen , Xuan-Ze Wang , Yong Xu , Yan Luo , Chang-Li Wu , Li-Yan Chen , Kun-Hong Liu

While machine learning approaches to visual emotion recognition offer great promise, current methods consider training and testing models on small scale datasets covering limited visual emotion concepts. Our analysis identifies an important…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Rameswar Panda , Jianming Zhang , Haoxiang Li , Joon-Young Lee , Xin Lu , Amit K. Roy-Chowdhury

In this work, user's emotion using its facial expressions will be detected. These expressions can be derived from the live feed via system's camera or any pre-exisiting image available in the memory. Emotions possessed by humans can be…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Raghav Puri , Archit Gupta , Manas Sikri , Mohit Tiwari , Nitish Pathak , Shivendra Goel

Human emotions are complex and can be conveyed through nuanced touch gestures. Previous research has primarily focused on how humans recognize emotions through touch or on identifying key features of emotional expression for robots.…

Robotics · Computer Science 2025-08-13 Qiaoqiao Ren , Remko Proesmans , Yuanbo Hou , Francis wyffels , Tony Belpaeme

Animal ethology is an crucial aspect of animal research, and animal behavior labeling is the foundation for studying animal behavior. This process typically involves labeling video clips with behavioral semantic tags, a task that is…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Yiqi Wu , Xiaodan Hu , Ziming Fu , Siling Zhou , Jiangong Li

In this paper, we describe our algorithmic approach, which was used for submissions in the fifth Emotion Recognition in the Wild (EmotiW 2017) group-level emotion recognition sub-challenge. We extracted feature vectors of detected faces…

Computer Vision and Pattern Recognition · Computer Science 2017-11-07 Alexandr G. Rassadin , Alexey S. Gruzdev , Andrey V. Savchenko

The Complex Emotion Recognition System (CERS) deciphers complex emotional states by examining combinations of basic emotions expressed, their interconnections, and the dynamic variations. Through the utilization of advanced algorithms, CERS…

Signal Processing · Electrical Eng. & Systems 2024-09-13 Javad Hassannataj Joloudari , Mohammad Maftoun , Bahareh Nakisa , Roohallah Alizadehsani , Meisam Yadollahzadeh-Tabari

Speech emotion recognition (SER) is a pivotal technology for human-computer interaction systems. However, 80.77% of SER papers yield results that cannot be reproduced. We develop EMO-SUPERB, short for EMOtion Speech Universal PERformance…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-13 Haibin Wu , Huang-Cheng Chou , Kai-Wei Chang , Lucas Goncalves , Jiawei Du , Jyh-Shing Roger Jang , Chi-Chun Lee , Hung-Yi Lee

In this paper, we present our solution for the Second Multimodal Emotion Recognition Challenge Track 1(MER2024-SEMI). To enhance the accuracy and generalization performance of emotion recognition, we propose several methods for Multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Anbin QI , Zhongliang Liu , Xinyong Zhou , Jinba Xiao , Fengrun Zhang , Qi Gan , Ming Tao , Gaozheng Zhang , Lu Zhang

We present MM-Navigator, a GPT-4V-based agent for the smartphone graphical user interface (GUI) navigation task. MM-Navigator can interact with a smartphone screen as human users, and determine subsequent actions to fulfill given…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 An Yan , Zhengyuan Yang , Wanrong Zhu , Kevin Lin , Linjie Li , Jianfeng Wang , Jianwei Yang , Yiwu Zhong , Julian McAuley , Jianfeng Gao , Zicheng Liu , Lijuan Wang

Generative AI, such as OpenAI's GPT-4V large-language model, has rapidly entered mainstream discourse. Novel capabilities in image processing and natural-language communication may augment existing forecasting methods. Large language models…

Applications of an efficient emotion recognition system can be found in several domains such as medicine, driver fatigue surveillance, social robotics, and human-computer interaction. Appraising human emotional states, behaviors, and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Savinay Nagendra , Prapti Panigrahi

With the rapid advancement of Multimodal Large Language Models (MLLMs), they have demonstrated exceptional capabilities across a variety of vision-language tasks. However, current evaluation benchmarks predominantly focus on objective…

Computation and Language · Computer Science 2025-09-24 Haokun Li , Yazhou Zhang , Jizhi Ding , Qiuchi Li , Peng Zhang

In the following paper the authors present a GAN-type model and the most important stages of its development for the task of emotion recognition in text. In particular, we propose an approach for generating a synthetic dataset of all…

Computation and Language · Computer Science 2021-02-02 A. Artemov , A. Veselovskiy , I. Khasenevich , I. Bolokhov

Emotion is an intricate physiological response that plays a crucial role in how we respond and cooperate with others in our daily affairs. Numerous experiments have been evolved to recognize emotion, however still require exploration to…

Human-Computer Interaction · Computer Science 2023-11-20 Danastan Tasaouf Mridula , Abu Ahmed Ferdaus , Tanmoy Sarkar Pias

Humans are emotional creatures. Multiple modalities are often involved when we express emotions, whether we do so explicitly (e.g., facial expression, speech) or implicitly (e.g., text, image). Enabling machines to have emotional…

Signal Processing · Electrical Eng. & Systems 2021-11-10 Sicheng Zhao , Guoli Jia , Jufeng Yang , Guiguang Ding , Kurt Keutzer

Representation learning and feature disentanglement have garnered significant research interest in the field of facial expression recognition (FER). The inherent ambiguity of emotion labels poses challenges for conventional supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Jia Li , Jiantao Nie , Dan Guo , Richang Hong , Meng Wang

This paper investigates the empathetic responding capabilities of ChatGPT, particularly its latest iteration, GPT-4, in comparison to human-generated responses to a wide range of emotional scenarios, both positive and negative. We employ a…

Human-Computer Interaction · Computer Science 2024-03-12 Anuradha Welivita , Pearl Pu

Previous electroencephalogram (EEG) emotion recognition relies on single-task learning, which may lead to overfitting and learned emotion features lacking generalization. In this paper, a graph-based multi-task self-supervised learning…

Signal Processing · Electrical Eng. & Systems 2022-05-03 Yang Li , Ji Chen , Fu Li , Boxun Fu , Hao Wu , Youshuo Ji , Yijin Zhou , Yi Niu , Guangming Shi , Wenming Zheng

Technology has become an essential part in every aspect of our lives. However the key to a successful implementation of a technology depends on the acceptance by the general public. In order to increase the acceptance various approaches can…

Human-Computer Interaction · Computer Science 2016-12-22 Johannes Feldmaier , Tamara Marmat , Johannes Kuhn , Klaus Diepold