English
Related papers

Related papers: Facial Expression Editing with Continuous Emotion …

200 papers

Talking face generation has gained significant attention as a core application of generative models. To enhance the expressiveness and realism of synthesized videos, emotion editing in talking face video plays a crucial role. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Chanhyuk Choi , Taesoo Kim , Donggyu Lee , Siyeol Jung , Taehwan Kim

The significance of emotion detection is increasing in education, entertainment, and various other domains. We are developing a system that can identify and transform facial expressions into emojis to provide immediate feedback.The project…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Abhilash Khuntia , Shubham Kale

Despite the rapid progress in image generation, emotional image editing remains under-explored. The semantics, context, and structure of an image can evoke emotional responses, making emotional image editing techniques valuable for various…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Qing Lin , Jingfeng Zhang , Yew-Soon Ong , Mengmi Zhang

Emotional expressions are the behaviors that communicate our emotional state or attitude to others. They are expressed through verbal and non-verbal communication. Complex human behavior can be understood by studying physical features from…

Computer Vision and Pattern Recognition · Computer Science 2021-09-15 Liam Schoneveld , Alice Othmani , Hazem Abdelkawy

Recent advances in deep generative models have demonstrated impressive results in photo-realistic facial image synthesis and editing. Facial expressions are inherently the result of muscle movement. However, existing neural network-based…

Computer Vision and Pattern Recognition · Computer Science 2019-11-07 ShahRukh Athar , Zhixin Shu , Dimitris Samaras

Dynamic facial expression generation from natural language is a crucial task in Computer Graphics, with applications in Animation, Virtual Avatars, and Human-Computer Interaction. However, current generative models suffer from datasets that…

Graphics · Computer Science 2025-08-19 Yaron Aloni , Rotem Shalev-Arkushin , Yonatan Shafir , Guy Tevet , Ohad Fried , Amit Haim Bermano

Recently, emotional talking face generation has received considerable attention. However, existing methods only adopt one-hot coding, image, or audio as emotion conditions, thus lacking flexible control in practical applications and failing…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Chao Xu , Junwei Zhu , Jiangning Zhang , Yue Han , Wenqing Chu , Ying Tai , Chengjie Wang , Zhifeng Xie , Yong Liu

By utilizing label distribution learning, a probability distribution is assigned for a facial image to express a compound emotion, which effectively improves the problem of label uncertainties and noises occurred in one-hot labels. In…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Shasha Mao , Guanghui Shi , Licheng Jiao , Shuiping Gou , Yangyang Li , Lin Xiong , Boxin Shi

High-level manipulation of facial expressions in images --- such as changing a smile to a neutral expression --- is challenging because facial expression changes are highly non-linear, and vary depending on the appearance of the face. We…

Computer Vision and Pattern Recognition · Computer Science 2016-12-01 Raymond Yeh , Ziwei Liu , Dan B Goldman , Aseem Agarwala

Mapping discrete and dimensional models of emotion remains a persistent challenge in affective science and computing. This incompatibility hinders the combination of valuable data sets, creating a significant bottleneck for training robust…

Human-Computer Interaction · Computer Science 2025-11-18 Michal R. Wrobel

Speech-driven 3D facial animation aims to generate realistic and expressive facial motions directly from audio. While recent methods achieve high-quality lip synchronization, they often rely on discrete emotion categories, limiting…

Multimedia · Computer Science 2026-01-16 Diqiong Jiang , Kai Zhu , Dan Song , Jian Chang , Chenglizhao Chen , Zhenyu Wu

Recent studies have used GAN to transfer expressions between human faces. However, existing models have many flaws: relying on emotion labels, lacking continuous expressions, and failing to capture the expression details. To address these…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Xiaohang Hu , Nuha Aldausari , Gelareh Mohammadi

3D facial modelling and animation in computer vision and graphics traditionally require either digital artist's skill or complex pipelines with objective-function-based solvers to fit models to motion capture. This inaccessibility of…

We introduce a new framework for manipulating and interacting with deep generative models that we call network bending. We present a comprehensive set of deterministic transformations that can be inserted as distinct layers into the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-15 Terence Broad , Frederic Fol Leymarie , Mick Grierson

Classification of human emotions remains an important and challenging task for many computer vision algorithms, especially in the era of humanoid robots which coexist with humans in their everyday life. Currently proposed methods for…

Computer Vision and Pattern Recognition · Computer Science 2018-10-26 Ivona Tautkute , Tomasz Trzcinski

In this paper, we introduce a novel deep learning method for photo-realistic manipulation of the emotional state of actors in "in-the-wild" videos. The proposed method is based on a parametric 3D face representation of the actor in the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Foivos Paraperas Papantoniou , Panagiotis P. Filntisis , Petros Maragos , Anastasios Roussos

Affective computing - combining sensor technology, machine learning, and psychology - have been studied for over three decades and is employed in AI-powered technologies to enhance emotional awareness in AI systems, and detect symptoms of…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-21 Anders Rolighed Larsen , Sneha Das , Nicole Nadine Lønfeldt , Paula Petcu , Line Clemmensen

In human-centric content generation, the pre-trained text-to-image models struggle to produce user-wanted portrait images, which retain the identity of individuals while exhibiting diverse expressions. This paper introduces our efforts…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Renshuai Liu , Bowen Ma , Wei Zhang , Zhipeng Hu , Changjie Fan , Tangjie Lv , Yu Ding , Xuan Cheng

Generative models have surged in popularity recently due to their ability to produce high-quality images and video. However, steering these models to produce images with specific attributes and precise control remains challenging. Humans,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Tuomas Varanka , Huai-Qian Khor , Yante Li , Mengting Wei , Hanwei Kung , Nicu Sebe , Guoying Zhao

We aim to construct a system that captures real-world facial images through the front camera on a laptop. The system is capable of processing/recognizing the captured image and predict a result in real-time. In this system, we exploit the…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Ching-Da Wu , Li-Heng Chen