English
Related papers

Related papers: Comprehensive Facial Expression Synthesis using Hu…

200 papers

Language-guided human motion synthesis has been a challenging task due to the inherent complexity and diversity of human behaviors. Previous methods face limitations in generalization to novel actions, often resulting in unrealistic or…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Yuanhao Zhai , Mingzhen Huang , Tianyu Luan , Lu Dong , Ifeoma Nwogu , Siwei Lyu , David Doermann , Junsong Yuan

Face synthesis has been a fascinating yet challenging problem in computer vision and machine learning. Its main research effort is to design algorithms to generate photo-realistic face images via given semantic domain. It has been a crucial…

Computer Vision and Pattern Recognition · Computer Science 2017-06-16 Zhihe Lu , Zhihang Li , Jie Cao , Ran He , Zhenan Sun

Text-guided human body animation has advanced rapidly, yet facial animation lags due to the scarcity of well-annotated, text-paired facial corpora. To close this gap, we leverage foundation generative models to synthesize a large, balanced…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Luchuan Song , Pinxin Liu , Haiyang Liu , Zhenchao Jin , Yolo Yunlong Tang , Zichong Xu , Susan Liang , Jing Bi , Jason J Corso , Chenliang Xu

We present a method for fine-grained face manipulation. Given a face image with an arbitrary expression, our method can synthesize another arbitrary expression by the same person. This is achieved by first fitting a 3D face model and then…

Computer Vision and Pattern Recognition · Computer Science 2019-02-26 Zhenglin Geng , Chen Cao , Sergey Tulyakov

Image and video synthesis has become a blooming topic in computer vision and machine learning communities along with the developments of deep generative models, due to its great academic and application value. Many researchers have been…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Zhen Jia , Zhang Zhang , Liang Wang , Tieniu Tan

Facial composites are graphical representations of an eyewitness's memory of a face. Many digital systems are available for the creation of such composites but are either unable to reproduce features unless previously designed or do not…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Nicola Zaltron , Luisa Zurlo , Sebastian Risi

Automatic synthesis of faces from visual attributes is an important problem in computer vision and has wide applications in law enforcement and entertainment. With the advent of deep generative convolutional neural networks (CNNs), attempts…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Xing Di , Vishal M. Patel

In the application of face recognition, eyeglasses could significantly degrade the recognition accuracy. A feasible method is to collect large-scale face images with eyeglasses for training deep learning methods. However, it is difficult to…

Computer Vision and Pattern Recognition · Computer Science 2021-02-11 Jianzhu Guo , Xiangyu Zhu , Zhen Lei , Stan Z. Li

Generating multi-view human images from a single view is a complex and significant challenge. Although recent advancements in multi-view object generation have shown impressive results with diffusion models, novel view synthesis for humans…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Yu Feng , Shunsi Zhang , Jian Shu , Hanfeng Zhao , Guoliang Pang , Chi Zhang , Hao Wang

We present an interactive approach to synthesizing realistic variations in facial hair in images, ranging from subtle edits to existing hair to the addition of complex and challenging hair in images of clean-shaven subjects. To circumvent…

Computer Vision and Pattern Recognition · Computer Science 2020-04-16 Kyle Olszewski , Duygu Ceylan , Jun Xing , Jose Echevarria , Zhili Chen , Weikai Chen , Hao Li

In this paper, we propose a talking face generation method that takes an audio signal as input and a short target video clip as reference, and synthesizes a photo-realistic video of the target face with natural lip motions, head poses, and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Chenxu Zhang , Yifan Zhao , Yifei Huang , Ming Zeng , Saifeng Ni , Madhukar Budagavi , Xiaohu Guo

Speech-driven facial animation is the process that automatically synthesizes talking characters based on speech signals. The majority of work in this domain creates a mapping from audio features to visual features. This approach often…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Konstantinos Vougioukas , Stavros Petridis , Maja Pantic

In this paper, we propose a novel text-based talking-head video generation framework that synthesizes high-fidelity facial expressions and head motions in accordance with contextual sentiments as well as speech rhythm and pauses. To be…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Lincheng Li , Suzhen Wang , Zhimeng Zhang , Yu Ding , Yixing Zheng , Xin Yu , Changjie Fan

The human face constantly conveys information, both consciously and subconsciously. However, as basic as it is for humans to visually interpret this information, it is quite a big challenge for machines. Conventional semantic facial feature…

Machine Learning · Computer Science 2016-10-21 Amogh Gudi

While accurate lip synchronization has been achieved for arbitrary-subject audio-driven talking face generation, the problem of how to efficiently drive the head pose remains. Previous methods rely on pre-estimated structural information…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Hang Zhou , Yasheng Sun , Wayne Wu , Chen Change Loy , Xiaogang Wang , Ziwei Liu

Humans involuntarily tend to infer parts of the conversation from lip movements when the speech is absent or corrupted by external noise. In this work, we explore the task of lip to speech synthesis, i.e., learning to generate natural…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 K R Prajwal , Rudrabha Mukhopadhyay , Vinay Namboodiri , C V Jawahar

Generating good quality and geometrically plausible synthetic images of humans with the ability to control appearance, pose and shape parameters, has become increasingly important for a variety of tasks ranging from photo editing, fashion…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Mihai Zanfir , Elisabeta Oneata , Alin-Ionut Popa , Andrei Zanfir , Cristian Sminchisescu

Interest makes one hold her attention on the object of interest. Automatic recognition of interest has numerous applications in human-computer interaction. In this paper, we study the facial expressions associated with interest and its…

Human-Computer Interaction · Computer Science 2016-10-12 Mohammad Soleymani

Facial expression synthesis has drawn much attention in the field of computer graphics and pattern recognition. It has been widely used in face animation and recognition. However, it is still challenging due to the high-level semantic…

Computer Vision and Pattern Recognition · Computer Science 2017-12-12 Lingxiao Song , Zhihe Lu , Ran He , Zhenan Sun , Tieniu Tan

We propose a data-driven approach for context-aware person image generation. Specifically, we attempt to generate a person image such that the synthesized instance can blend into a complex scene. In our method, the position, scale, and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Prasun Roy , Saumik Bhattacharya , Subhankar Ghosh , Umapada Pal , Michael Blumenstein