English
Related papers

Related papers: Towards Localized Fine-Grained Control for Facial …

200 papers

Much of the work on automatic facial expression recognition relies on databases containing a certain number of emotion classes and their exaggerated facial configurations (generally six prototypical facial expressions), based on Ekman's…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Wenjing Yan , Shan Li , Chengtao Que , JiQuan Pei , Weihong Deng

In this paper we introduce AFFDEX 2.0 - a toolkit for analyzing facial expressions in the wild, that is, it is intended for users aiming to; a) estimate the 3D head pose, b) detect facial Action Units (AUs), c) recognize basic emotions and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Mina Bishay , Kenneth Preston , Matthew Strafuss , Graham Page , Jay Turcot , Mohammad Mavadati

Editing facial expressions by only changing what we want is a long-standing research problem in Generative Adversarial Networks (GANs) for image manipulation. Most of the existing methods that rely only on a global generator usually suffer…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Rumeysa Bodur , Binod Bhattarai , Tae-Kyun Kim

Action Units (AUs) are geometrically-based atomic facial muscle movements known to produce appearance changes at specific facial locations. Motivated by this observation we propose a novel AU modelling problem that consists of jointly…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Ioanna Ntinou , Enrique Sanchez , Adrian Bulat , Michel Valstar , Georgios Tzimiropoulos

Dynamic facial expression generation from natural language is a crucial task in Computer Graphics, with applications in Animation, Virtual Avatars, and Human-Computer Interaction. However, current generative models suffer from datasets that…

Graphics · Computer Science 2025-08-19 Yaron Aloni , Rotem Shalev-Arkushin , Yonatan Shafir , Guy Tevet , Ohad Fried , Amit Haim Bermano

Customizable 3D avatar-based facial expression stimuli may improve user engagement in behavioral biomarker discovery and therapeutic intervention for autism, Alzheimer's disease, facial palsy, and more. However, there is a lack of…

Facial expression synthesis has achieved remarkable advances with the advent of Generative Adversarial Networks (GANs). However, GAN-based approaches mostly generate photo-realistic results as long as the testing data distribution is close…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Arbish Akram , Nazar Khan

Facial action unit detection has emerged as an important task within facial expression analysis, aimed at detecting specific pre-defined, objective facial expressions, such as lip tightening and cheek raising. This paper presents our…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Yufeng Yin , Minh Tran , Di Chang , Xinrui Wang , Mohammad Soleymani

Facial micro-expressions are very brief, spontaneous facial expressions that appear on the face of humans when they either deliberately or unconsciously conceal an emotion. Micro-expression has shorter duration than macro-expression, which…

Computer Vision and Pattern Recognition · Computer Science 2018-05-08 Walied Merghani , Adrian K. Davison , Moi Hoon Yap

Dynamic Facial Expression Recognition(DFER) is a rapidly evolving field of research that focuses on the recognition of time-series facial expressions. While previous research on DFER has concentrated on feature learning from a deep learning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Feng Liu , Lingna Gu , Chen Shi , Xiaolan Fu

Automatic detection of facial Action Units (AUs) allows for objective facial expression analysis. Due to the high cost of AU labeling and the limited size of existing benchmarks, previous AU detection methods tend to overfit the dataset,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Yufeng Yin , Di Chang , Guoxian Song , Shen Sang , Tiancheng Zhi , Jing Liu , Linjie Luo , Mohammad Soleymani

Facial expressions are one of the most powerful, natural and immediate means for human being to communicate their emotions and intensions. Recognition of facial expression has many applications including human-computer interaction,…

Computer Vision and Pattern Recognition · Computer Science 2016-04-18 Deepak Ghimire , Sunghwan Jeong , Joonwhoan Lee , Sang Hyun Park

We present a method for fine-grained face manipulation. Given a face image with an arbitrary expression, our method can synthesize another arbitrary expression by the same person. This is achieved by first fitting a 3D face model and then…

Computer Vision and Pattern Recognition · Computer Science 2019-02-26 Zhenglin Geng , Chen Cao , Sergey Tulyakov

Current video models fail as world model as they lack fine-graiend control. General-purpose household robots require real-time fine motor control to handle delicate tasks and urgent situations. In this work, we introduce fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Yichen Li , Antonio Torralba

The facial expression generation capability of humanoid social robots is critical for achieving natural and human-like interactions, playing a vital role in enhancing the fluidity of human-robot interactions and the accuracy of emotional…

Robotics · Computer Science 2025-10-28 Yongtong Zhu , Lei Li , Iggy Qian , WenBin Zhou , Ye Yuan , Qingdu Li , Na Liu , Jianwei Zhang

Facial Expression Recognition (FER) is a fine-grained visual understanding task where reliable predictions require reasoning over localized and meaningful facial cues. Recent vision--language models (VLMs) enable natural language…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Haobo Lin , Tianyi Bai , Jiajun Zhang , Xuanhao Chang , Sheng Lu , Fangming Gu , Zengjie Hu , Wentao Zhang

Although state-of-the-art classifiers for facial expression recognition (FER) can achieve a high level of accuracy, they lack interpretability, an important feature for end-users. Experts typically associate spatial action units (\aus) from…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Soufiane Belharbi , Marco Pedersoli , Alessandro Lameiras Koerich , Simon Bacon , Eric Granger

Although significant progress has been made to audio-driven talking face generation, existing methods either neglect facial emotion or cannot be applied to arbitrary subjects. In this paper, we propose the Emotion-Aware Motion Model (EAMM)…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Xinya Ji , Hang Zhou , Kaisiyuan Wang , Qianyi Wu , Wayne Wu , Feng Xu , Xun Cao

Human affective behavior analysis aims to delve into human expressions and behaviors to deepen our understanding of human emotions. Basic expression categories (EXPR) and Action Units (AUs) are two essential components in this analysis,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Li Lin , Sarah Papabathini , Xin Wang , Shu Hu

Facial expression recognition is vital for human behavior analysis, and deep learning has enabled models that can outperform humans. However, it is unclear how closely they mimic human processing. This study aims to explore the similarity…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 F. Xavier Gaya-Morey , Silvia Ramis-Guarinos , Cristina Manresa-Yee , Jose M. Buades-Rubio