English
Related papers

Related papers: ActFER: Agentic Facial Expression Recognition via …

200 papers

Facial pain expression is an important modality for assessing pain, especially when the patient's verbal ability to communicate is impaired. The facial muscle-based action units (AUs), which are defined by the Facial Action Coding System…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Zhanli Chen , Rashid Ansari , Diana Wilkie

Facial Expression Recognition (FER) is an important task in computer vision and has wide applications in human-computer interaction, intelligent security, emotion analysis, and other fields. However, the limited size of FER datasets limits…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Jun Yu , Zhongpeng Cai , Renda Li , Gongpeng Zhao , Guochen Xie , Jichao Zhu , Wangyuan Zhu

Facial expression recognition (FER) aims to analyze emotional states from static images and dynamic sequences, which is pivotal in enhancing anthropomorphic communication among humans, robots, and digital avatars by leveraging AI…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Yan Wang , Shaoqi Yan , Yang Liu , Wei Song , Jing Liu , Yang Chang , Xinji Mai , Xiping Hu , Wenqiang Zhang , Zhongxue Gan

Micro-Expression Recognition (MER) is a challenging task as the subtle changes occur over different action regions of a face. Changes in facial action regions are formed as Action Units (AUs), and AUs in micro-expressions can be seen as the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Ling Zhou , Qirong Mao , Ming Dong

Most research on facial expression recognition (FER) is conducted in highly controlled environments, but its performance is often unacceptable when applied to real-world situations. This is because when unexpected objects occlude the face,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Isack Lee , Eungi Lee , Seok Bong Yoo

The detection of micro-expression Action Units (AUs) is a formidable challenge in affective computing, pivotal for decoding subtle, involuntary human emotions. While Large Language Models (LLMs) demonstrate profound reasoning abilities,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Zhishu Liu , Kaishen Yuan , Bo Zhao , Yong Xu , Zitong Yu

Facial Emotion Analysis (FEA) plays a crucial role in visual affective computing, aiming to infer a person's emotional state based on facial data. Scientifically, facial expressions (FEs) result from the coordinated movement of facial…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Zhuozhao Hu , Kaishen Yuan , Xin Liu , Zitong Yu , Yuan Zong , Jingang Shi , Huanjing Yue , Jingyu Yang

The domain diversities including inconsistent annotation and varied image collection conditions inevitably exist among different facial expression recognition (FER) datasets, which pose an evident challenge for adapting the FER model…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Kai Wang , Yuxin Gu , Xiaojiang Peng , Panpan Zhang , Baigui Sun , Hao Li

Deep learning has played a significant role in the success of facial expression recognition (FER), thanks to large models and vast amounts of labelled data. However, obtaining labelled data requires a tremendous amount of human effort,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Shuvendu Roy , Ali Etemad

Facial Expression Recognition (FER) in the wild is still challenging due to uncontrolled variations in pose, occlusion, and illumination. Most existing attention-based methods primarily rely on visual appearance cues, suffering from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Jiaxin Wang , Muwei Jian , Hui Yu , Junyu Dong , Yifan Xia

Multimodal Large Language Models (MLLMs) have recently been applied to universal multimodal retrieval, where Chain-of-Thought (CoT) reasoning improves candidate reranking. However, existing approaches remain largely language-driven, relying…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Dongyang Chen , Chaoyang Wang , Dezhao Su , Xi Xiao , Zeyu Zhang , Jing Xiong , Qing Li , Yuzhang Shang , Shichao Kan

Large-scale reinforcement learning with verifiable rewards (RLVR) has demonstrated its effectiveness in harnessing the potential of large language models (LLMs) for single-turn reasoning tasks. In realistic reasoning scenarios, LLMs can…

While Large Language Models (LLMs) excel at reasoning on text and Vision-Language Models (VLMs) are highly effective for visual perception, applying those models for visual instruction-based planning remains a widely open problem. In this…

Machine Learning · Computer Science 2025-09-11 Mohamed Salim Aissi , Clemence Grislain , Mohamed Chetouani , Olivier Sigaud , Laure Soulier , Nicolas Thome

Reward models are critical for aligning vision-language systems with human preferences, yet current approaches suffer from hallucination, weak visual grounding, and an inability to use tools for verification, limiting their reliability on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Shengyuan Ding , Xinyu Fang , Ziyu Liu , Yuhang Zang , Yuhang Cao , Xiangyu Zhao , Haodong Duan , Xiaoyi Dong , Jianze Liang , Bin Wang , Conghui He , Dahua Lin , Jiaqi Wang

Dynamic facial expression recognition (DFER) aims to identify emotional states by modeling the temporal changes in facial movements across video sequences. A key challenge in DFER is the many-to-one labeling problem, where a video composed…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Gunho Jung , Heejo Kong , Seong-Whan Lee

Dynamic facial expression recognition (DFER) is essential to the development of intelligent and empathetic machines. Prior efforts in this field mainly fall into supervised learning paradigm, which is severely restricted by the limited…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Licai Sun , Zheng Lian , Bin Liu , Jianhua Tao

Understanding the facial expressions of our interlocutor is important to enrich the communication and to give it a depth that goes beyond the explicitly expressed. In fact, studying one's facial expression gives insight into their hidden…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Rim EL Cheikh , Hélène Tran , Issam Falih , Engelbert Mephu Nguifo

Deep learning based facial expression recognition (FER) has received a lot of attention in the past few years. Most of the existing deep learning based FER methods do not consider domain knowledge well, which thereby fail to extract…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Yuedong Chen , Jianfeng Wang , Shikai Chen , Zhongchao Shi , Jianfei Cai

Facial Action Units (AU) is a vital concept in the realm of affective computing, and AU detection has always been a hot research topic. Existing methods suffer from overfitting issues due to the utilization of a large number of learnable…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Kaishen Yuan , Zitong Yu , Xin Liu , Weicheng Xie , Huanjing Yue , Jingyu Yang

Dynamic facial expression recognition in the wild remains challenging due to data scarcity and long-tail distributions, which hinder models from effectively learning the temporal dynamics of scarce emotions. To address these limitations, we…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Huanzhen Wang , Ziheng Zhou , Jiaqi Song , Li He , Yunshi Lan , Yan Wang , Wenqiang Zhang