English
Related papers

Related papers: Multimodal Face Synthesis from Visual Attributes

200 papers

Facial landmarks constitute the most compressed representation of faces and are known to preserve information such as pose, gender and facial structure present in the faces. Several works exist that attempt to perform high-level…

Computer Vision and Pattern Recognition · Computer Science 2019-01-07 Xing Di , Vishwanath A. Sindagi , Vishal M. Patel

Face recognition systems have significantly advanced in recent years, driven by the availability of large-scale datasets. However, several issues have recently came up, including privacy concerns that have led to the discontinuation of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Pietro Melzi , Christian Rathgeb , Ruben Tolosana , Ruben Vera-Rodriguez , Dominik Lawatsch , Florian Domin , Maxim Schaubert

Generative adversarial networks (GANs) are a class of unsupervised machine learning algorithms that can produce realistic images from randomly-sampled vectors in a multi-dimensional space. Until recently, it was not possible to generate…

Computer Vision and Pattern Recognition · Computer Science 2018-05-10 Andrew Beers , James Brown , Ken Chang , J. Peter Campbell , Susan Ostmo , Michael F. Chiang , Jayashree Kalpathy-Cramer

In recent years, Generative Adversarial Networks have achieved impressive results in photorealistic image synthesis. This progress nurtures hopes that one day the classical rendering pipeline can be replaced by efficient models that are…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Yiyi Liao , Katja Schwarz , Lars Mescheder , Andreas Geiger

The ability to generate synthetic medical images is useful for data augmentation, domain transfer, and out-of-distribution detection. However, generating realistic, high-resolution medical images is challenging, particularly for Full Field…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Dimitrios Korkinof , Tobias Rijken , Michael O'Neill , Joseph Yearsley , Hugh Harvey , Ben Glocker

Generative Adversarial Networks have been crucial in the developments made in unsupervised learning in recent times. Exemplars of image synthesis from text or other images, these networks have shown remarkable improvements over conventional…

Machine Learning · Computer Science 2019-09-02 Rohan Akut , Sumukh Marathe , Rucha Apte , Ishan Joshi , Siddhivinayak Kulkarni

We present a versatile model, FaceAnime, for various video generation tasks from still images. Video generation from a single face image is an interesting problem and usually tackled by utilizing Generative Adversarial Networks (GANs) to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Xiaoguang Tu , Yingtian Zou , Jian Zhao , Wenjie Ai , Jian Dong , Yuan Yao , Zhikang Wang , Guodong Guo , Zhifeng Li , Wei Liu , Jiashi Feng

Accurate 3D face reconstruction from 2D images is an enabling technology with applications in healthcare, security, and creative industries. However, current state-of-the-art methods either rely on supervised training with very limited 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Will Rowan , Patrik Huber , Nick Pears , Andrew Keeling

Recent developments in computer vision and machine learning have made it possible to create realistic manipulated videos of human faces, raising the issue of ensuring adequate protection against the malevolent effects unlocked by such…

Computer Vision and Pattern Recognition · Computer Science 2020-02-12 Michail Tarasiou , Stefanos Zafeiriou

Masked face recognition is important for social good but challenged by diverse occlusions that cause insufficient or inaccurate representations. In this work, we propose a unified deep network to learn generative-to-discriminative…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Shiming Ge , Weijia Guo , Chenyu Li , Junzheng Zhang , Yong Li , Dan Zeng

The task of face attribute manipulation has found increasing applications, but still remains challenging with the requirement of editing the attributes of a face image while preserving its unique details. In this paper, we choose to combine…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Ruoqi Sun , Chen Huang , Jianping Shi , Lizhuang Ma

We present a multimodal learning-based method to simultaneously synthesize co-speech facial expressions and upper-body gestures for digital characters using RGB video data captured using commodity cameras. Our approach learns from sparse…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Uttaran Bhattacharya , Aniket Bera , Dinesh Manocha

Previous methods have dealt with discrete manipulation of facial attributes such as smile, sad, angry, surprise etc, out of canonical expressions and they are not scalable, operating in single modality. In this paper, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Jiali Duan , Xiaoyuan Guo , Yuhang Song , Chao Yang , C. -C. Jay Kuo

We propose a generative framework based on generative adversarial network (GAN) to enhance facial attractiveness while preserving facial identity and high-fidelity. Given a portrait image as input, having applied gradient descent to recover…

Computer Vision and Pattern Recognition · Computer Science 2020-06-05 Yuhongze Zhou , Qinjie Xiao

Recent advances in generative adversarial networks (GANs) have led to remarkable achievements in face image synthesis. While methods that use style-based GANs can generate strikingly photorealistic face images, it is often difficult to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Safa C. Medin , Bernhard Egger , Anoop Cherian , Ye Wang , Joshua B. Tenenbaum , Xiaoming Liu , Tim K. Marks

Voice profiling aims at inferring various human parameters from their speech, e.g. gender, age, etc. In this paper, we address the challenge posed by a subtask of voice profiling - reconstructing someone's face from their voice. The task is…

Sound · Computer Science 2019-06-04 Yandong Wen , Rita Singh , Bhiksha Raj

Generative Adversarial Networks (GANs) have made a dramatic leap in high-fidelity image synthesis and stylized face generation. Recently, a layer-swapping mechanism has been developed to improve the stylization performance. However, this…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Mingcong Liu , Qiang Li , Zekui Qin , Guoxin Zhang , Pengfei Wan , Wen Zheng

Existing facial editing methods have achieved remarkable results, yet they often fall short in supporting multimodal conditional local facial editing. One of the significant evidences is that their output image quality degrades dramatically…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Wanglong Lu , Jikai Wang , Xiaogang Jin , Xianta Jiang , Hanli Zhao

Face photo synthesis from simple line drawing is a one-to-many task as simple line drawing merely contains the contour of human face. Previous exemplar-based methods are over-dependent on the datasets and are hard to generalize to…

Computer Vision and Pattern Recognition · Computer Science 2017-02-10 Qi Guo , Ce Zhu , Zhiqiang Xia , Zhengtao Wang , Yipeng Liu

Facial appearance editing is crucial for digital avatars, AR/VR, and personalized content creation, driving realistic user experiences. However, preserving identity with generative models is challenging, especially in scenarios with limited…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 MD Wahiduzzaman Khan , Mingshan Jia , Xiaolin Zhang , En Yu , Caifeng Shan , Kaska Musial-Gabrys