English
Related papers

Related papers: MMME: A Spontaneous Multi-Modal Micro-Expression D…

200 papers

In this paper, we introduce a new dataset, the driver emotion facial expression (DEFE) dataset, for driver spontaneous emotions analysis. The dataset includes facial expression recordings from 60 participants during driving. After watching…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Wenbo Li , Yaodong Cui , Yintao Ma , Xingxin Chen , Guofa Li , Gang Guo , Dongpu Cao

Multimodal sentiment analysis is a key technology in the fields of human-computer interaction and affective computing. Accurately recognizing human emotional states is crucial for facilitating smooth communication between humans and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Wangyuan Zhu , Jun Yu

Facial micro-expression recognition (MER) is a challenging task, due to the transience, subtlety, and dynamics of micro-expressions (MEs). Most existing methods resort to hand-crafted features or deep networks, in which the former often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Zhiwen Shao , Yifan Cheng , Fan Zhang , Xuehuai Shi , Canlin Li , Lizhuang Ma , Dit-yan Yeung

Multimodal Sentiment Analysis (MSA) stands as a critical research frontier, seeking to comprehensively unravel human emotions by amalgamating text, audio, and visual data. Yet, discerning subtle emotional nuances within audio and video…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Sheng Wu , Xiaobao Wang , Longbiao Wang , Dongxiao He , Jianwu Dang

In the field of affective computing, fully leveraging information from a variety of sensory modalities is essential for the comprehensive understanding and processing of human emotions. Inspired by the process through which the human brain…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Xinji Mai , Junxiong Lin , Haoran Wang , Zeng Tao , Yan Wang , Shaoqi Yan , Xuan Tong , Jiawen Yu , Boyang Wang , Ziheng Zhou , Qing Zhao , Shuyong Gao , Wenqiang Zhang

Alignment between human brain networks and artificial models has become an active research area in vision science and machine learning. A widely adopted approach is identifying "metamers," stimuli physically different yet perceptually…

Machine Learning · Computer Science 2025-09-25 Mina Kamao , Hayato Ono , Ayumu Yamashita , Kaoru Amano , Masataka Sawayama

Micro-expressions are hard to spot due to fleeting and involuntary moments of facial muscles. Interpretation of micro emotions from video clips is a challenging task. In this paper we propose an affective-motion imaging that cumulates rapid…

Multimedia · Computer Science 2021-04-16 Monu Verma , Santosh Kumar Vipparthi , Girdhari Singh

Emotional expressiveness captures the extent to which a person tends to outwardly display their emotions through behavior. Due to the close relationship between emotional expressiveness and behavioral health, as well as the crucial role…

Human-Computer Interaction · Computer Science 2020-09-02 Victoria Lin , Jeffrey M. Girard , Michael A. Sayette , Louis-Philippe Morency

Multimodal Sentiment Analysis is an active area of research that leverages multimodal signals for affective understanding of user-generated videos. The predominant approach, addressing this task, has been to develop sophisticated fusion…

Computation and Language · Computer Science 2020-10-20 Devamanyu Hazarika , Roger Zimmermann , Soujanya Poria

Depression is a common mental health disorder that can cause consequential symptoms with continuously depressed mood that leads to emotional distress. One category of depression is Concealed Depression, where patients intentionally or…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Xiaohui Chen , Tie Luo

Facial micro-expressions recognition has attracted much attention recently. Micro-expressions have the characteristics of short duration and low intensity, and it is difficult to train a high-performance classifier with the limited number…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Yanxin Song , Jianzong Wang , Tianbo Wu , Zhangcheng Huang , Jing Xiao

Multimodal Emotion Recognition (MER) aims to perceive human emotions through three modes: language, vision, and audio. Previous methods primarily focused on modal fusion without adequately addressing significant distributional differences…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Jichao Zhu , Jun Yu

Multimodal sentiment analysis, a pivotal task in affective computing, seeks to understand human emotions by integrating cues from language, audio, and visual signals. While many recent approaches leverage complex attention mechanisms and…

Computation and Language · Computer Science 2025-05-09 Nischal Mandal , Yang Li

Emotion recognition based on Electroencephalography (EEG) has gained significant attention and diversified development in fields such as neural signal processing and affective computing. However, the unique brain anatomy of individuals…

Signal Processing · Electrical Eng. & Systems 2024-05-31 Yihang Dong , Xuhang Chen , Yanyan Shen , Michael Kwok-Po Ng , Tao Qian , Shuqiang Wang

Multimodal emotion recognition from physiological signals is receiving an increasing amount of attention due to the impossibility to control them at will unlike behavioral reactions, thus providing more reliable information. Existing deep…

Human-Computer Interaction · Computer Science 2023-10-12 Eleonora Lopez , Eleonora Chiarantano , Eleonora Grassucci , Danilo Comminiello

Unlike prevalent facial expressions, micro expressions have subtle, involuntary muscle movements which are short-lived in nature. These minute muscle movements reflect true emotions of a person. Due to the short duration and low intensity,…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 Monu Verma , Santosh Kumar Vipparthi , Girdhari Singh , Subrahmanyam Murala

Multimodal affective computing has gained increasing attention due to its broad applications in understanding human behavior and intentions, particularly in text-centric multimodal scenarios. Existing research spans diverse tasks,…

Computation and Language · Computer Science 2026-04-08 Guimin Hu , Weimin Lyu , Chang Sun , Zhihong Zhu , Lin Gui , Ruichu Cai , Erik Cambria , Hasti Seifi

Micro-expressions are spontaneous, unconscious facial movements that show people's true inner emotions and have great potential in related fields of psychological testing. Since the face is a 3D deformation object, the occurrence of an…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Fengping Wang , Jie Li , Siqi Zhang , Chun Qi , Yun Zhang , Danmin Miao

Emotion recognition is a topic of significant interest in assistive robotics due to the need to equip robots with the ability to comprehend human behavior, facilitating their effective interaction in our society. Consequently, efficient and…

Human-Computer Interaction · Computer Science 2023-12-05 Rutherford Agbeshi Patamia , Paulo E. Santos , Kingsley Nketia Acheampong , Favour Ekong , Kwabena Sarpong , She Kun

Micro-expression has emerged as a promising modality in affective computing due to its high objectivity in emotion detection. Despite the higher recognition accuracy provided by the deep learning models, there are still significant scope…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Viswanatha Reddy Gajjala , Sai Prasanna Teja Reddy , Snehasis Mukherjee , Shiv Ram Dubey