English
Related papers

Related papers: Comprehensive Facial Expression Synthesis using Hu…

200 papers

Benefiting from advances in machine vision and natural language processing techniques, current image captioning systems are able to generate detailed visual descriptions. For the most part, these descriptions represent an objective…

Computer Vision and Pattern Recognition · Computer Science 2020-04-16 Omid Mohamad Nezami , Mark Dras , Stephen Wan , Cecile Paris

Recent advances in deep generative models have demonstrated impressive results in photo-realistic facial image synthesis and editing. Facial expressions are inherently the result of muscle movement. However, existing neural network-based…

Computer Vision and Pattern Recognition · Computer Science 2019-11-07 ShahRukh Athar , Zhixin Shu , Dimitris Samaras

We present a multimodal learning-based method to simultaneously synthesize co-speech facial expressions and upper-body gestures for digital characters using RGB video data captured using commodity cameras. Our approach learns from sparse…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Uttaran Bhattacharya , Aniket Bera , Dinesh Manocha

The automatic recognition of facial expressions has been an active research topic since the early nineties. There have been several advances in the past few years in terms of face detection and tracking, feature extraction mechanisms and…

Computer Vision and Pattern Recognition · Computer Science 2012-04-02 Vinay Bettadapura

Facial expression synthesis has achieved remarkable advances with the advent of Generative Adversarial Networks (GANs). However, GAN-based approaches mostly generate photo-realistic results as long as the testing data distribution is close…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Arbish Akram , Nazar Khan

Several works have developed end-to-end pipelines for generating lip-synced talking faces with various real-world applications, such as teaching and language translation in videos. However, these prior works fail to create realistic-looking…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Sahil Goyal , Shagun Uppal , Sarthak Bhagat , Yi Yu , Yifang Yin , Rajiv Ratn Shah

This paper presents a novel method to manipulate the visual appearance (pose and attribute) of a person image according to natural language descriptions. Our method can be boiled down to two stages: 1) text guided pose generation and 2)…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Xingran Zhou , Siyu Huang , Bin Li , Yingming Li , Jiachen Li , Zhongfei Zhang

Human communication is the vocal and non verbal signal to communicate with others. Human expression is a significant biometric object in picture and record databases of surveillance systems. Face appreciation has a serious role in biometric…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 P. Deivendran , P. Suresh Babu , G. Malathi , K. Anbazhagan , R. Senthil Kumar

Speech-driven three-dimensional (3D) facial animation synthesis aims to build a mapping from one-dimensional (1D) speech signals to time-varying 3D facial motion signals. Current methods still face challenges in maintaining lip-sync…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Bin Liu , Zhixiang Xiong , Zhifen He , Bo Li

Daily monitoring of intra-personal facial changes associated with health and emotional conditions has great potential to be useful for medical, healthcare, and emotion recognition fields. However, the approach for capturing intra-personal…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Yusuke Akamatsu , Terumi Umematsu , Hitoshi Imaoka , Shizuko Gomi , Hideo Tsurushima

Translating written sentences from oral languages to a sequence of manual and non-manual gestures plays a crucial role in building a more inclusive society for deaf and hard-of-hearing people. Facial expressions (non-manual), in particular,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Rafael Azevedo , Thiago Coutinho , João Ferreira , Thiago Gomes , Erickson Nascimento

A person's face discloses important information about their affective state. Although there has been extensive research on recognition of facial expressions, the performance of existing approaches is challenged by facial occlusions. Facial…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Behnaz Nojavanasghari , Charles. E. Hughes , Tadas Baltrusaitis , Louis-philippe Morency

In recent years, the role of image generative models in facial reenactment has been steadily increasing. Such models are usually subject-agnostic and trained on domain-wide datasets. The appearance of the reenacted individual is learned…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Ariel Elazary , Yotam Nitzan , Daniel Cohen-Or

High-level manipulation of facial expressions in images --- such as changing a smile to a neutral expression --- is challenging because facial expression changes are highly non-linear, and vary depending on the appearance of the face. We…

Computer Vision and Pattern Recognition · Computer Science 2016-12-01 Raymond Yeh , Ziwei Liu , Dan B Goldman , Aseem Agarwala

Humans can perceive speakers' characteristics (e.g., identity, gender, personality and emotion) by their appearance, which are generally aligned to their voice style. Recently, vision-driven Text-to-speech (TTS) scholars grounded their…

Sound · Computer Science 2025-04-17 Tian-Hao Zhang , Jiawei Zhang , Jun Wang , Xinyuan Qian , Xu-Cheng Yin

Learning from synthetic images plays an important role in facial expression recognition task due to the difficulties of labeling the real images, and it is challenging because of the gap between the synthetic images and real images. The…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Xiangyu Miao , Jiahe Wang , Yanan Chang , Yi Wu , Shangfei Wang

The facial expression recognition is an ocular task that can be performed without human discomfort, is really a speedily growing on the computer research field. There are many applications and programs uses facial expression to evaluate…

Computer Vision and Pattern Recognition · Computer Science 2015-06-08 Abdelmajid Hassan Mansour , Gafar Zen Alabdeen Salh , Ali Shaif Alhalemi

Automated facial identification and facial expression recognition have been topics of active research over the past few decades. Facial and expression recognition find applications in human-computer interfaces, subject tracking, real-time…

Computer Vision and Pattern Recognition · Computer Science 2016-10-25 Sohini Roychowdhury , Michelle Emmons

Facial expression is the most natural means for human beings to communicate their emotions. Most facial expression analysis studies consider the case of acted expressions. Spontaneous facial expression recognition is significantly more…

Computer Vision and Pattern Recognition · Computer Science 2018-10-02 Dawood Al Chanti , Alice Caplier

Facial expression transfer and reenactment has been an important research problem given its applications in face editing, image manipulation, and fabricated videos generation. We present a novel method for image-based facial expression…

Computer Vision and Pattern Recognition · Computer Science 2019-12-16 Chao Yang , Ser-Nam Lim