English
Related papers

Related papers: Multi-scale multi-modal micro-expression recogniti…

200 papers

Algorithmic detection of facial palsy offers the potential to improve current practices, which usually involve labor-intensive and subjective assessment by clinicians. In this paper, we present a multimodal fusion-based deep learning model…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Heng Yim Nicole Oo , Min Hun Lee , Jeong Hoon Lim

Facial expression recognition (FER) is a subset of computer vision with important applications for human-computer-interaction, healthcare, and customer service. FER represents a challenging problem-space because accurate classification…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Ezra Engel , Lishan Li , Chris Hudy , Robert Schleusner

Micro-expressions (MEs) are rapid, involuntary facial expressions which reveal emotions that people do not intend to show. Studying MEs is valuable as recognizing them has many important applications, particularly in forensic science and…

Computer Vision and Pattern Recognition · Computer Science 2017-03-14 Xiaobai Li , Xiaopeng Hong , Antti Moilanen , Xiaohua Huang , Tomas Pfister , Guoying Zhao , Matti Pietikäinen

Multi-task learning is an effective learning strategy for deep-learning-based facial expression recognition tasks. However, most existing methods take into limited consideration the feature selection, when transferring information between…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Rui Zhao , Tianshan Liu , Jun Xiao , Daniel P. K. Lun , Kin-Man Lam

Micro-expressions are brief and subtle facial expressions that go on and off the face in a fraction of a second. This kind of facial expressions usually occurs in high stake situations and is considered to reflect a human's real intent.…

Computer Vision and Pattern Recognition · Computer Science 2020-05-14 Carlos Arango Duque , Olivier Alata , Rémi Emonet , Hubert Konik , Anne-Claire Legrand

Over the last few years, automatic facial micro-expression analysis has garnered increasing attention from experts across different disciplines because of its potential applications in various fields such as clinical diagnosis, forensic…

Computer Vision and Pattern Recognition · Computer Science 2018-06-18 Yee-Hui Oh , John See , Anh Cat Le Ngo , Raphael Chung-Wei Phan , Vishnu Monn Baskaran

Human communication is multi-modal; e.g., face-to-face interaction involves auditory signals (speech) and visual signals (face movements and hand gestures). Hence, it is essential to exploit multiple modalities when designing machine…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Marah Halawa , Florian Blume , Pia Bideau , Martin Maier , Rasha Abdel Rahman , Olaf Hellwich

Deep neural networks enriched with structural information have been widely employed for facial expression recognition tasks. However, these methods often depend on hierarchical information rather than face property to finish expression…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Chunwei Tian , Jingyuan Xie , Qi Zhang , Chao Li , Wangmeng Zuo , Shichao Zhang

Facial micro-expressions (MEs) are involuntary facial motions revealing peoples real feelings and play an important role in the early intervention of mental illness, the national security, and many human-computer interaction systems.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Hanting Li , Mingzhe Sui , Zhaoqing Zhu , Feng Zhao

Micro-expressions are hard to spot due to fleeting and involuntary moments of facial muscles. Interpretation of micro emotions from video clips is a challenging task. In this paper we propose an affective-motion imaging that cumulates rapid…

Multimedia · Computer Science 2021-04-16 Monu Verma , Santosh Kumar Vipparthi , Girdhari Singh

Micro-expressions (MEs) are involuntary facial movements revealing people's hidden feelings in high-stake situations and have practical importance in medical treatment, national security, interrogations and many human-computer interaction…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yante Li , Jinsheng Wei , Yang Liu , Janne Kauttonen , Guoying Zhao

Concern regarding the wide-spread use of fraudulent images/videos in social media necessitates precise detection of such fraud. The importance of facial expressions in communication is widely known, and adversarial attacks often focus on…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Ghazal Mazaheri , Amit K. Roy-Chowdhury

Facial expressions play an important role in conveying the emotional states of human beings. Recently, deep learning approaches have been applied to image recognition field due to the discriminative power of Convolutional Neural Network…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Yingruo Fan , Jacqueline C. K. Lam , Victor O. K. Li

Recent studies have focused on utilizing multi-modal data to develop robust models for facial Action Unit (AU) detection. However, the heterogeneity of multi-modal data poses challenges in learning effective representations. One such…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Xiang Zhang , Huiyuan Yang , Taoyue Wang , Xiaotian Li , Lijun Yin

Micro-Expression Recognition has become challenging, as it is extremely difficult to extract the subtle facial changes of micro-expressions. Recently, several approaches proposed several expression-shared features algorithms for…

Computer Vision and Pattern Recognition · Computer Science 2021-01-14 Ling Zhou , Qirong Mao , Xiaohua Huang , Feifei Zhang , Zhihong Zhang

Micro-expression recognition plays a pivotal role in understanding hidden emotions and has applications across various fields. Traditional recognition methods assume access to all training data at once, but real-world scenarios involve…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Zhengqin Lai , Xiaopeng Hong , Yabin Wang , Xiaobai Li

Facial expression spotting, identifying periods where facial expressions occur in a video, is a significant yet challenging task in facial expression analysis. The issues of irrelevant facial movements and the challenge of detecting subtle…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yicheng Deng , Hideaki Hayashi , Hajime Nagahara

Developing machine learning algorithms to understand person-to-person engagement can result in natural user experiences for communal devices such as Amazon Alexa. Among other cues such as voice activity and gaze, a person's audio-visual…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-02 Srinivas Parthasarathy , Shiva Sundaram

Recent advances in 3D facial expression reconstruction have demonstrated remarkable performance in capturing macro-expressions, yet the reconstruction of micro-expressions remains unexplored. This novel task is particularly challenging due…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Che Sun , Xinjie Zhang , Rui Gao , Xu Chen , Yuwei Wu , Yunde Jia

Emotion recognition is a topic of significant interest in assistive robotics due to the need to equip robots with the ability to comprehend human behavior, facilitating their effective interaction in our society. Consequently, efficient and…

Human-Computer Interaction · Computer Science 2023-12-05 Rutherford Agbeshi Patamia , Paulo E. Santos , Kingsley Nketia Acheampong , Favour Ekong , Kwabena Sarpong , She Kun