English
Related papers

Related papers: EmoCLIP: A Vision-Language Method for Zero-Shot Vi…

200 papers

Facial Emotion Analysis (FEA) extends traditional facial emotion recognition by incorporating explainable, fine-grained reasoning. The task integrates three subtasks: emotion recognition, facial Action Unit (AU) recognition, and AU-based…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Jiulong Wu , Yucheng Shen , Lingyong Yan , Haixin Sun , Deguo Xia , Jizhou Huang , Min Cao

Deep convolutional neural networks have been shown to successfully recognize facial emotions for the past years in the realm of computer vision. However, the existing detection approaches are not always reliable or explainable, we here…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Jiawen Wang , Leah Kawka

Emotion recognition aims to interpret the emotional states of a person based on various inputs including audio, visual, and textual cues. This paper focuses on emotion recognition using visual features. To leverage the correlation between…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Akshita Mittel , Shashank Tripathi

Given a query from one modality, few-shot cross-modal retrieval (CMR) retrieves semantically similar instances in another modality with the target domain including classes that are disjoint from the source domain. Compared with classical…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Jingyou Xie , Jiayi Kuang , Zhenzhou Lin , Jiarui Ouyang , Zishuo Zhao , Ying Shen

In this paper, we present SAFER, a novel system for emotion recognition from facial expressions. It employs state-of-the-art deep learning techniques to extract various features from facial images and incorporates contextual information,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Mijanur Palash , Bharat Bhargava

Measuring the perception of visual content is a long-standing problem in computer vision. Many mathematical models have been developed to evaluate the look or quality of an image. Despite the effectiveness of such tools in quantifying…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Jianyi Wang , Kelvin C. K. Chan , Chen Change Loy

This work describes different strategies to generate unsupervised representations obtained through the concept of self-taught learning for facial emotion recognition (FER). The idea is to create complementary representations promoting…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Bruna Delazeri , Leonardo L. Veras , Alceu de S. Britto , Jean Paul Barddal , Alessandro L. Koerich

Surgical phase recognition is a critical component for context-aware decision support in intelligent operating rooms, yet training robust models is hindered by limited annotated clinical videos and large domain gaps between synthetic and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Yuxin He , An Li , Cheng Xue

Emotion recognition has the potential to play a pivotal role in enhancing human-computer interaction by enabling systems to accurately interpret and respond to human affect. Yet, capturing emotions in face-to-face contexts remains…

We introduce the SEER (Span-based Emotion Evidence Retrieval) Benchmark to test Large Language Models' (LLMs) ability to identify the specific spans of text that express emotion. Unlike traditional emotion recognition tasks that assign a…

Computation and Language · Computer Science 2025-10-29 Aneesha Sampath , Oya Aran , Emily Mower Provost

Dynamic Facial Expression Recognition (DFER) aims to identify human emotions from temporally evolving facial movements and plays a critical role in affective computing. While recent vision-language approaches have introduced semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Yu Liu , Leyuan Qu , Hanlei Shi , Di Gao , Yuhua Zheng , Taihao Li

Supervised visual captioning models typically require a large scale of images or videos paired with descriptions in a specific language (i.e., the vision-caption pairs) for training. However, collecting and labeling large-scale datasets is…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Bang Yang , Fenglin Liu , Xian Wu , Yaowei Wang , Xu Sun , Yuexian Zou

Facial expression recognition (FER) algorithms classify facial expressions into emotions such as happy, sad, or angry. An evaluative challenge facing FER algorithms is the fall in performance when detecting spontaneous expressions compared…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Rina Khan , Catherine Stinson

Emotion recognition from physiological signals has substantial potential for applications in mental health and emotion-aware systems. However, the lack of standardized, large-scale evaluations across heterogeneous datasets limits progress…

Human-Computer Interaction · Computer Science 2026-04-08 Pragya Singh , Ankush Gupta , Somay Jalan , Mohan Kumar , Pushpendra Singh

When a person attempts to conceal an emotion, the genuine emotion is manifest as a micro-expression. Exploration of automatic facial micro-expression recognition systems is relatively new in the computer vision domain. This is due to the…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Sze-Teng Liong , Y. S. Gan , Wei-Chuen Yau , Yen-Chang Huang , Tan Lit Ken

The human face conveys a significant amount of information. Through facial expressions, the face is able to communicate numerous sentiments without the need for verbalisation. Visual emotion recognition has been extensively studied.…

Computer Vision and Pattern Recognition · Computer Science 2022-01-20 Liam Schoneveld , Alice Othmani

Medical image classification plays a crucial role in clinical decision-making, yet most models are constrained to a fixed set of predefined classes, limiting their adaptability to new conditions. Contrastive Language-Image Pretraining…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Stefan Denner , Markus Bujotzek , Dimitrios Bounias , David Zimmerer , Raphael Stock , Klaus Maier-Hein

Facial expressions convey nonverbal cues which play an important role in interpersonal relations, and are widely used in behavior interpretation of emotions, cognitive science, and social interactions. In this paper we analyze different…

Computer Vision and Pattern Recognition · Computer Science 2016-04-18 Deepak Ghimire , Joonwhoan Lee , Ze-Nian Li , Sunghwan Jeong

In this study, we explored the potential of utilizing Facial Expression Activations (FEAs) captured via the Meta Quest Pro Virtual Reality (VR) headset for Facial Expression Recognition (FER) in VR settings. Leveraging the EmojiHeroVR…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Thorben Ortmann , Qi Wang , Larissa Putzar

Facial expression recognition (FER) models are typically trained on datasets with a fixed number of seven basic classes. However, recent research works point out that there are far more expressions than the basic ones. Thus, when these…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Yuhang Zhang , Yue Yao , Xuannan Liu , Lixiong Qin , Wenjing Wang , Weihong Deng