English
Related papers

Related papers: MELDAE: A Framework for Micro-Expression Spotting,…

200 papers

Speech-based machine learning (ML) has been heralded as a promising solution for tracking prosodic and spectrotemporal patterns in real-life that are indicative of emotional changes, providing a valuable window into one's cognitive and…

Machine Learning · Computer Science 2021-09-08 Kexin Feng , Theodora Chaspari

Micro-expressions (MEs) are regarded as important indicators of an individual's intrinsic emotions, preferences, and tendencies. ME analysis requires spotting of ME intervals within long video sequences and recognition of their…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Zizheng Guo , Bochao Zou , Junbao Zhuo , Huimin Ma

Micro-expressions (MEs) are involuntary facial movements revealing people's hidden feelings in high-stake situations and have practical importance in medical treatment, national security, interrogations and many human-computer interaction…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yante Li , Jinsheng Wei , Yang Liu , Janne Kauttonen , Guoying Zhao

This paper discusses the benefits of incorporating multimodal data for improving latent emotion recognition accuracy, focusing on micro-expression (ME) and physiological signals (PS). The proposed approach presents a novel multimodal…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Liangfei Zhang , Yifei Qian , Ognjen Arandjelovic , Anthony Zhu

Bipolar Disorder is a chronic psychiatric illness characterized by pathological mood swings associated with severe disruptions in emotion regulation. Clinical monitoring of mood is key to the care of these dynamic and incapacitating mood…

Human-Computer Interaction · Computer Science 2018-06-29 Soheil Khorram , Mimansa Jaiswal , John Gideon , Melvin McInnis , Emily Mower Provost

Recognizing speaking in humans is a central task towards understanding social interactions. Ideally, speaking would be detected from individual voice recordings, as done previously for meeting scenarios. However, individual voice recordings…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Jose Vargas Quiros , Chirag Raman , Stephanie Tan , Ekin Gedik , Laura Cabrera-Quiros , Hayley Hung

Cross-database micro-expression recognition (CDMER) is one of recently emerging and interesting problem in micro-expression analysis. CDMER is more challenging than the conventional micro-expression recognition (MER), because the training…

Computer Vision and Pattern Recognition · Computer Science 2019-11-12 Yuan Zong , Tong Zhang , Wenming Zheng , Xiaopeng Hong , Chuangao Tang , Zhen Cui , Guoying Zhao

Micro-expressions are brief and subtle facial movements that convey nuanced affective information but often remain imperceptible during natural social interaction. Although prior research has primarily focused on computational recognition…

Human-Computer Interaction · Computer Science 2026-04-29 Feiyang Yin , Isidro Butaslac , Patrick Gebhard , Monica Perusquia-Hernandez , Zhaofeng Niu , Taishi Sawabe , Hirokazu Kato

The versatility of Large Language Models (LLMs) in natural language understanding has made them increasingly popular in mental health research. While many studies explore LLMs' capabilities in emotion recognition, a critical gap remains in…

Computation and Language · Computer Science 2025-09-12 Bangzhao Shu , Isha Joshi , Melissa Karnaze , Anh C. Pham , Ishita Kakkar , Sindhu Kothe , Arpine Hovasapian , Mai ElSherief

Procedural mistake detection (PMD) is a challenging problem of classifying whether a human user (observed through egocentric video) has successfully executed a task (specified by a procedural text). Despite significant recent efforts,…

Artificial Intelligence · Computer Science 2025-12-11 Shane Storks , Itamar Bar-Yossef , Yayuan Li , Zheyuan Zhang , Jason J. Corso , Joyce Chai

Accurate emotion recognition is pivotal for nuanced and engaging human-computer interactions, yet remains difficult to achieve, especially in dynamic, conversation-like settings. In this study, we showcase how integrating eye-tracking data,…

Human-Computer Interaction · Computer Science 2025-11-03 Meisam Jamshidi Seikavandi , Jostein Fimland , Maria Barrett , Paolo Burelli

Facial expressions are important cues to observe human emotions. Facial expression recognition has attracted many researchers for years, but it is still a challenging topic since expression features vary greatly with the head poses,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 S. D. Lalitha , K. K. Thyagharajan

In this study, we investigate how environmental factors, specifically the scenes and objects involved, can affect the expression of emotions through body language. To this end, we introduce a novel multi-stream deep convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Mohammad Mahdi Dehshibi , David Masip

Humans are arguably innately prepared to comprehend others' emotional expressions from subtle body movements. If robots or computers can be empowered with this capability, a number of robotic applications become possible. Automatically…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Yu Luo , Jianbo Ye , Reginald B. Adams, , Jia Li , Michelle G. Newman , James Z. Wang

Facial Expression Recognition is an active area of research in computer vision with a wide range of applications. Several approaches have been developed to solve this problem for different benchmark datasets. However, Facial Expression…

Computer Vision and Pattern Recognition · Computer Science 2016-01-12 Abubakrelsedik Karali , Ahmad Bassiouny , Motaz El-Saban

Emotion recognition in real-world environments is hindered by partial occlusions, missing modalities, and severe class imbalance. To address these issues, particularly for the Affective Behavior Analysis in-the-wild (ABAW) Expression…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Jun Yu , Naixiang Zheng , Guoyuan Wang , Yunxiang Zhang , Lingsi Zhu , Jiaen Liang , Wei Huang , Shengping Liu

Being spontaneous, micro-expressions are useful in the inference of a person's true emotions even if an attempt is made to conceal them. Due to their short duration and low intensity, the recognition of micro-expressions is a difficult task…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Liangfei Zhang , Xiaopeng Hong , Ognjen Arandjelovic , Guoying Zhao

When emotions are repressed, an individual's true feelings may be revealed through micro-expressions. Consequently, micro-expressions are regarded as a genuine source of insight into an individual's authentic emotions. However, the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Feng Liu , Bingyu Nan , Xuezhong Qian , Xiaolan Fu

There are a variety of features of the human voice that can be classified as pitch, timbre, loudness, and vocal tone. It is observed in numerous incidents that human expresses their feelings using different vocal qualities when they are…

The task of emotion recognition in conversations (ERC) benefits from the availability of multiple modalities, as provided, for example, in the video-based Multimodal EmotionLines Dataset (MELD). However, only a few research approaches use…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-16 Hugo Carneiro , Cornelius Weber , Stefan Wermter