English
Related papers

Related papers: Meta-Auxiliary Learning for Micro-Expression Recog…

200 papers

EEG-based multimodal emotion recognition(EMER) has gained significant attention and witnessed notable advancements, the inherent complexity of human neural systems has motivated substantial efforts toward multimodal approaches. However,…

Signal Processing · Electrical Eng. & Systems 2025-10-16 Zejun Liu , Yunshan Chen , Chengxi Xie , Yugui Xie , Huan Liu

Multimodal emotion recognition utilizes complete multimodal information and robust multimodal joint representation to gain high performance. However, the ideal condition of full modality integrity is often not applicable in reality and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Qi Fan , Hongyu Yuan , Haolin Zuo , Rui Liu , Guanglai Gao

Micro-expressions are brief spontaneous facial expressions that appear on a face when a person conceals an emotion, making them different to normal facial expressions in subtlety and duration. Currently, emotion classes within the CASME II…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Adrian K. Davison , Walied Merghani , Moi Hoon Yap

Understanding human emotions from multimodal signals poses a significant challenge in affective computing and human-robot interaction. While multimodal large language models (MLLMs) have excelled in general vision-language tasks, their…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Xiaojiang Peng , Jingyi Chen , Zebang Cheng , Bao Peng , Fengyi Wu , Yifei Dong , Shuyuan Tu , Qiyu Hu , Huiting Huang , Yuxiang Lin , Jun-Yan He , Kai Wang , Zheng Lian , Zhi-Qi Cheng

Deep neural networks often rely on spurious features to make predictions, which makes them brittle under distribution shift and on samples where the spurious correlation does not hold (e.g., minority-group examples). Recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Aryan Yazdan Parast , Khawar Islam , Soyoun Won , Basim Azam , Naveed Akhtar

Correctly perceiving micro-expression is difficult since micro-expression is an involuntary, repressed, and subtle facial expression, and efficiently revealing the subtle movement changes and capturing the significant segments in a…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Jiateng Liu , Wenming Zheng , Yuan Zong

Multimodal emotion recognition (MER) aims to identify human emotions by combining data from various modalities such as language, audio, and vision. Despite the recent advances of MER approaches, the limitations in obtaining extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yehun Song , Sunyoung Cho

Deep neural networks are highly effective when a large number of labeled samples are available but fail with few-shot classification tasks. Recently, meta-learning methods have received much attention, which train a meta-learner on massive…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Yucan Zhou , Yu Wang , Jianfei Cai , Yu Zhou , Qinghua Hu , Weiping Wang

Gradient-based meta-learning methods leverage gradient descent to learn the commonalities among various tasks. While previous such methods have been successful in meta-learning tasks, they resort to simple gradient descent during…

Machine Learning · Statistics 2018-06-15 Yoonho Lee , Seungjin Choi

Multimodal few-shot learning is challenging due to the large domain gap between vision and language modalities. Existing methods are trying to communicate visual concepts as prompts to frozen language models, but rely on hand-engineered…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Ivona Najdenkoska , Xiantong Zhen , Marcel Worring

Despite the recent progress in speech emotion recognition (SER), state-of-the-art systems are unable to achieve improved performance in cross-language settings. In this paper, we propose a Multimodal Dual Attention Transformer (MDAT) model…

Computation and Language · Computer Science 2023-07-17 Syed Aun Muhammad Zaidi , Siddique Latif , Junaid Qadir

Facial expression recognition (FER) has emerged as an important component of human-computer interaction systems. Despite recent advancements in FER, performance often drops significantly for non-frontal facial images. We propose Contrastive…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Shuvendu Roy , Ali Etemad

Micro-expressions are subtle facial movements that occur spontaneously when people try to conceal real emotions. Micro-expression recognition is crucial in many fields, including criminal analysis and psychotherapy. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Guanghao Zhu , Lin Liu , Yuhao Hu , Haixin Sun , Fang Liu , Xiaohui Du , Ruqian Hao , Juanxiu Liu , Yong Liu , Hao Deng , Jing Zhang

Emotion recognition is a core research area at the intersection of artificial intelligence and human communication analysis. It is a significant technical challenge since humans display their emotions through complex idiosyncratic…

Human-Computer Interaction · Computer Science 2018-09-14 Paul Pu Liang , Amir Zadeh , Louis-Philippe Morency

With the advancement of artificial intelligence and computer vision technologies, multimodal emotion recognition has become a prominent research topic. However, existing methods face challenges such as heterogeneous data fusion and the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Wei Dai , Dequan Zheng , Feng Yu , Yanrong Zhang , Yaohui Hou

Few-shot learning aims to learn representations that can tackle novel tasks given a small number of examples. Recent studies show that cross-modal learning can improve representations for few-shot classification. More specifically, language…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Jordi Armengol-Estapé , Vincent Michalski , Ramnath Kumar , Pierre-Luc St-Charles , Doina Precup , Samira Ebrahimi Kahou

Open-Vocabulary Multimodal Emotion Recognition (OV-MER) aims to predict emotions without being constrained by predefined label spaces, thereby enabling fine-grained emotion understanding. Unlike traditional discriminative methods, OV-MER…

Human-Computer Interaction · Computer Science 2026-05-08 Zheng Lian , Fan Zhang , Lan Chen , Yazhou Zhang , Rui Liu , Jinyang Wu , Haoyu Chen , Xiaobai Li , Xiaojiang Peng , Bin He , Jianhua Tao

Cross-Database Micro-Expression Recognition (CDMER) aims to develop the Micro-Expression Recognition (MER) methods with strong domain adaptability, i.e., the ability to recognize the Micro-Expressions (MEs) of different subjects captured by…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Xingxun Jiang , Yuan Zong , Wenming Zheng , Jiateng Liu , Mengting Wei

Representations derived from models such as BERT (Bidirectional Encoder Representations from Transformers) and HuBERT (Hidden units BERT), have helped to achieve state-of-the-art performance in dimensional speech emotion recognition.…

Sound · Computer Science 2023-12-29 Vikramjit Mitra , Jingping Nie , Erdrin Azemi

In this paper, we present our solution for the semi-supervised learning track (MER-SEMI) in MER2025. We propose a comprehensive framework, grounded in the principle that "more is better," to construct a robust Mixture of Experts (MoE)…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Jun Xie , Yingjian Zhu , Feng Chen , Zhenghao Zhang , Xiaohui Fan , Hongzhu Yi , Xinming Wang , Chen Yu , Yue Bi , Zhaoran Zhao , Xiongjun Guan , Zhepeng Wang