中文
相关论文

相关论文: MER-CLIP: AU-Guided Vision-Language Alignment for …

200 篇论文

Multimodal Emotion Recognition (MER) aims to perceive human emotions through three modes: language, vision, and audio. Previous methods primarily focused on modal fusion without adequately addressing significant distributional differences…

计算机视觉与模式识别 · 计算机科学 2026-01-07 Jichao Zhu , Jun Yu

Automatic Micro-Expression (ME) spotting in long videos is a crucial step in ME analysis but also a challenging task due to the short duration and low intensity of MEs. When solving this problem, previous works generally lack in considering…

计算机视觉与模式识别 · 计算机科学 2023-03-17 Shukang Yin , Shiwei Wu , Tong Xu , Shifeng Liu , Sirui Zhao , Enhong Chen

Dynamic Facial Expression Recognition (DFER) aims to identify human emotions from temporally evolving facial movements and plays a critical role in affective computing. While recent vision-language approaches have introduced semantic…

计算机视觉与模式识别 · 计算机科学 2025-07-17 Yu Liu , Leyuan Qu , Hanlei Shi , Di Gao , Yuhua Zheng , Taihao Li

The objective of stylized speech-driven facial animation is to create animations that encapsulate specific emotional expressions. Existing methods often depend on pre-established emotional labels or facial expression templates, which may…

计算机视觉与模式识别 · 计算机科学 2023-09-12 Yicheng Zhong , Huawei Wei , Peiji Yang , Zhisheng Wang

Micro-expressions are rapid and involuntary facial expressions, which indicate the suppressed or concealed emotions. Recently, the research on automatic micro-expression (ME) spotting obtains increasing attention. ME spotting is a crucial…

计算机视觉与模式识别 · 计算机科学 2017-10-10 Xiaopeng Hong , Thuong-Khanh Tran , Guoying Zhao

Emotion recognition is an important research direction in artificial intelligence, helping machines understand and adapt to human emotional states. Multimodal electrophysiological(ME) signals, such as EEG, GSR, respiration(Resp), and…

多媒体 · 计算机科学 2023-08-07 Yunfei Guo , Tao Zhang , Wu Huang

Action Unit (AU) detection plays an important role for facial expression recognition. To the best of our knowledge, there is little research about AU analysis for micro-expressions. In this paper, we focus on AU detection in…

计算机视觉与模式识别 · 计算机科学 2020-04-13 Yante Li , Xiaohua Huang , Guoying Zhao

Facial Emotion Analysis (FEA) plays a crucial role in visual affective computing, aiming to infer a person's emotional state based on facial data. Scientifically, facial expressions (FEs) result from the coordinated movement of facial…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Zhuozhao Hu , Kaishen Yuan , Xin Liu , Zitong Yu , Yuan Zong , Jingang Shi , Huanjing Yue , Jingyu Yang

The Facial Action Coding System (FACS) encodes the action units (AUs) in facial images, which has attracted extensive research attention due to its wide use in facial expression analysis. Many methods that perform well on automatic facial…

计算机视觉与模式识别 · 计算机科学 2024-05-24 Xuri Ge , Joemon M. Jose , Songpei Xu , Xiao Liu , Hu Han

Facial expression recognition (FER) has emerged as a promising approach to the development of emotion-aware intelligent agents and systems. However, key challenges remain in utilizing FER in real-world contexts, including ensuring user…

人机交互 · 计算机科学 2025-07-31 Sanjeev Nahulanthran , Leimin Tian , Dana Kulić , Mor Vered

Micro-expressions (MEs) are involuntary and subtle facial expressions that are thought to reveal feelings people are trying to hide. ME spotting detects the temporal intervals containing MEs in videos. Detecting such quick and subtle…

计算机视觉与模式识别 · 计算机科学 2023-05-10 Yini Fang , Didan Deng , Liang Wu , Frederic Jumelle , Bertram Shi

Although state-of-the-art classifiers for facial expression recognition (FER) can achieve a high level of accuracy, they lack interpretability, an important feature for end-users. Experts typically associate spatial action units (AUs) from…

计算机视觉与模式识别 · 计算机科学 2024-10-04 Soufiane Belharbi , Marco Pedersoli , Alessandro Lameiras Koerich , Simon Bacon , Eric Granger

Micro-expressions (MEs) are brief, subtle facial expressions that reveal concealed emotions, offering key behavioral cues for social interaction. Characterized by short duration, low intensity, and spontaneity, MEs have been mostly studied…

人机交互 · 计算机科学 2024-09-04 Jingting Li , Shaoyuan Lu , Yan Wang , Zizhao Dong , Su-Jing Wang , Xiaolan Fu

Multimodal Emotion Recognition in Conversation (MERC) aims to enhance emotion understanding by integrating complementary cues from text, audio, and visual modalities. Existing MERC approaches predominantly focus on cross-modal shared…

多媒体 · 计算机科学 2025-12-16 Xinyi Che , Wenbo Wang , Yuanbo Hou , Mingjie Xie , Qijun Zhao , Jian Guan

Multimodal emotion recognition (MER) extracts emotions from multimodal data, including visual, speech, and text inputs, playing a key role in human-computer interaction. Attention-based fusion methods dominate MER research, achieving strong…

人工智能 · 计算机科学 2025-06-03 Jiajun He , Jinyi Mi , Tomoki Toda

Emotion Recognition (ER) is the process of identifying human emotions from given data. Currently, the field heavily relies on facial expression recognition (FER) because facial expressions contain rich emotional cues. However, it is…

计算机视觉与模式识别 · 计算机科学 2024-11-20 Yuanyuan Liu , Lin Wei , Kejun Liu , Yibing Zhan , Zijing Chen , Zhe Chen , Shiguang Shan

Emotion recognition plays a vital role in enhancing human-computer interaction. In this study, we tackle the MER-SEMI challenge of the MER2025 competition by proposing a novel multimodal emotion recognition framework. To address the issue…

计算机视觉与模式识别 · 计算机科学 2025-08-11 Juewen Hu , Yexin Li , Jiulin Li , Shuo Chen , Pring Wong

To address the limitation in multimodal emotion recognition (MER) performance arising from inter-modal information fusion, we propose a novel MER framework based on multitask learning where fusion occurs after alignment, called Foal-Net.…

多媒体 · 计算机科学 2024-08-20 Qifei Li , Yingming Gao , Yuhua Wen , Cong Wang , Ya Li

People naturally understand emotions, thus permitting a machine to do the same could open new paths for human-computer interaction. Facial expressions can be very useful for emotion recognition techniques, as these are the biggest…

计算机视觉与模式识别 · 计算机科学 2023-11-21 Pietro B. S. Masur , Willams Costa , Lucas S. Figueredo , Veronica Teichrieb

Emotion Recognition (ER) is the process of analyzing and identifying human emotions from sensing data. Currently, the field heavily relies on facial expression recognition (FER) because visual channel conveys rich emotional cues. However,…

计算机视觉与模式识别 · 计算机科学 2025-12-19 Kejun Liu , Yuanyuan Liu , Lin Wei , Chang Tang , Yibing Zhan , Zijing Chen , Zhe Chen