English
Related papers

Related papers: MMME: A Spontaneous Multi-Modal Micro-Expression D…

200 papers

Facial micro-expressions are very brief, spontaneous facial expressions that appear on the face of humans when they either deliberately or unconsciously conceal an emotion. Micro-expression has shorter duration than macro-expression, which…

Computer Vision and Pattern Recognition · Computer Science 2018-05-08 Walied Merghani , Adrian K. Davison , Moi Hoon Yap

As a critical psychological stress response, micro-expressions (MEs) are fleeting and subtle facial movements revealing genuine emotions. Automatic ME recognition (MER) holds valuable applications in fields such as criminal investigation…

Human-Computer Interaction · Computer Science 2025-05-12 Shifeng Liu , Xinglong Mao , Sirui Zhao , Peiming Li , Tong Xu , Enhong Chen

Micro-expressions are nonverbal facial expressions that reveal the covert emotions of individuals, making the micro-expression recognition task receive widespread attention. However, the micro-expression recognition task is challenging due…

Image and Video Processing · Electrical Eng. & Systems 2024-06-13 Ren Zhang , Jianqin Yin , Chao Qi , Zehao Wang , Zhicheng Zhang , Yonghao Dang

Facial micro-expressions, characterized by their subtle and brief nature, are valuable indicators of genuine emotions. Despite their significance in psychology, security, and behavioral analysis, micro-expression recognition remains…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Luu Tu Nguyen , Vu Tram Anh Khuong , Thi Bich Phuong Man , Thi Duyen Ngo , Thanh Ha Le

Multimodal sentiment analysis (MSA) and emotion recognition in conversation (ERC) are key research topics for computers to understand human behaviors. From a psychological perspective, emotions are the expression of affect or feelings…

Computation and Language · Computer Science 2022-11-22 Guimin Hu , Ting-En Lin , Yi Zhao , Guangming Lu , Yuchuan Wu , Yongbin Li

Micro-expressions (MEs), brief and low-intensity facial movements revealing concealed emotions, are crucial for affective computing. Despite notable progress in ME recognition, existing methods are largely confined to discrete emotion…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Sirui Zhao , Zhengye Zhang , Shifeng Liu , Xinglong Mao , Shukang Yin , Chaoyou Fu , Tong Xu , Enhong Chen

Facial micro-expressions (MEs) are involuntary movements of the face that occur spontaneously when a person experiences an emotion but attempts to suppress or repress the facial expression, typically found in a high-stakes environment. In…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Xinqi Fan , Jingting Li , John See , Moi Hoon Yap , Su-Jing Wang , Adrian K. Davison

Accurately analyzing spontaneous, unconscious micro-expressions is crucial for revealing true human emotions, but this task remains challenging in wild scenarios, such as natural conversation. Existing research largely relies on datasets…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Yigui Feng , Qinglin Wang , Yang Liu , Ke Liu , Haotian Mo , Enhao Huang , Gencheng Liu , Mingzhe Liu , Jie Liu

The ever-evolving social media discourse has witnessed an overwhelming use of memes to express opinions or dissent. Besides being misused for spreading malcontent, they are mined by corporations and political parties to glean the public's…

Computers and Society · Computer Science 2024-03-18 Shivam Sharma , Ramaneswaran S , Md. Shad Akhtar , Tanmoy Chakraborty

Micro-expression recognition (MER) is crucial in the affective computing field due to its wide application in medical diagnosis, lie detection, and criminal investigation. Despite its significance, obtaining micro-expression (ME)…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Jiateng Liu , Hengcan Shi , Feng Chen , Zhiwen Shao , Yaonan Wang , Jianfei Cai , Wenming Zheng

This work presents MAD (Multimodal Affection Dataset), a multimodal emotion dataset designed for affective computing and neurophysiological modeling. MAD is built upon synchronous collection of diverse physiological signals (EEG, ECG, EOG,…

Signal Processing · Electrical Eng. & Systems 2026-03-09 Shengwei Guo , Yunqing Qiao , Wenzhan Zhang , Bo Liu , Yong Wang , Guobing Sun

Multimodal VAEs seek to model the joint distribution over heterogeneous data (e.g.\ vision, language), whilst also capturing a shared representation across such modalities. Prior work has typically combined information from the modalities…

Machine Learning · Computer Science 2022-12-19 Tom Joy , Yuge Shi , Philip H. S. Torr , Tom Rainforth , Sebastian M. Schmon , N. Siddharth

Facial micro-expressions are sudden involuntary minute muscle movements which reveal true emotions that people try to conceal. Spotting a micro-expression and recognizing it is a major challenge owing to its short duration and intensity.…

Computer Vision and Pattern Recognition · Computer Science 2019-04-22 Sauradip Nag , Ayan Kumar Bhunia , Aishik Konwer , Partha Pratim Roy

Understanding human emotions from multimodal signals poses a significant challenge in affective computing and human-robot interaction. While multimodal large language models (MLLMs) have excelled in general vision-language tasks, their…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Xiaojiang Peng , Jingyi Chen , Zebang Cheng , Bao Peng , Fengyi Wu , Yifei Dong , Shuyuan Tu , Qiyu Hu , Huiting Huang , Yuxiang Lin , Jun-Yan He , Kai Wang , Zheng Lian , Zhi-Qi Cheng

Emotion Recognition (ER) is the process of analyzing and identifying human emotions from sensing data. Currently, the field heavily relies on facial expression recognition (FER) because visual channel conveys rich emotional cues. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Kejun Liu , Yuanyuan Liu , Lin Wei , Chang Tang , Yibing Zhan , Zijing Chen , Zhe Chen

Recent advances in multimodal large language models (MLLMs) have catalyzed transformative progress in affective computing, enabling models to exhibit emergent emotional intelligence. Despite substantial methodological progress, current…

While affective computing has advanced considerably, multimodal emotion prediction in aging populations remains underexplored, largely due to the scarcity of dedicated datasets. Existing multimodal benchmarks predominantly target young,…

Human-Computer Interaction · Computer Science 2026-04-06 Hongbin Chen , Jie Li , Wei Wang , Siyang Song , Xiao Gu , Jianqing Li , Wentao Xiang

Micro-action is an imperceptible non-verbal behaviour characterised by low-intensity movement. It offers insights into the feelings and intentions of individuals and is important for human-oriented applications such as emotion recognition…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Dan Guo , Kun Li , Bin Hu , Yan Zhang , Meng Wang

Micro-expressions (MEs) are involuntary movements revealing people's hidden feelings, which has attracted numerous interests for its objectivity in emotion detection. However, despite its wide applications in various scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Jingyao Wang , Yunhan Tian , Yuxuan Yang , Xiaoxin Chen , Changwen Zheng , Wenwen Qiang

Humans modify their facial expressions in order to communicate their internal states and sometimes to mislead observers regarding their true emotional states. Evidence in experimental psychology shows that discriminative facial responses…

Computer Vision and Pattern Recognition · Computer Science 2018-01-10 Kaustubh Kulkarni , Ciprian Adrian Corneanu , Ikechukwu Ofodile , Sergio Escalera , Xavier Baro , Sylwia Hyniewska , Juri Allik , Gholamreza Anbarjafari