English
Related papers

Related papers: Cross-Domain and Disentangled Face Manipulation wi…

200 papers

Recently, advances in differential volumetric rendering enabled significant breakthroughs in the photo-realistic and fine-detailed reconstruction of complex 3D scenes, which is key for many virtual reality applications. However, in the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Sagie Benaim , Frederik Warburg , Peter Ebert Christensen , Serge Belongie

Recently, deep learning-based facial landmark detection for in-the-wild faces has achieved significant improvement. However, there are still challenges in face landmark detection in other domains (e.g. cartoon, caricature, etc). This is due…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Yuanming Li , Gwantae Kim , Jeong-gi Kwak , Bon-hwa Ku , Hanseok Ko

Recent methods for synthesizing 3D-aware face images have achieved rapid development thanks to neural radiance fields, allowing for high quality and fast inference speed. However, existing solutions for editing facial geometry and…

Graphics · Computer Science 2022-11-16 Kaiwen Jiang , Shu-Yu Chen , Feng-Lin Liu , Hongbo Fu , Lin Gao

While facial attribute manipulation of 2D images via Generative Adversarial Networks (GANs) has become common in computer vision and graphics due to its many practical uses, research on 3D attribute manipulation is relatively undeveloped.…

Computer Vision and Pattern Recognition · Computer Science 2020-12-14 Wonwoong Cho , Inyeop Lee , David Inouye

3D-aware portrait editing has a wide range of applications in multiple fields. However, current approaches are limited due that they can only perform mask-guided or text-based editing. Even by fusing the two procedures into a model, the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Kangneng Zhou , Daiheng Gao , Xuan Wang , Jie Zhang , Peng Zhang , Xusen Sun , Longhao Zhang , Shiqi Yang , Bang Zhang , Liefeng Bo , Yaxing Wang , Ming-Ming Cheng

Facial alignment involves finding a set of landmark points on an image with a known semantic meaning. However, this semantic meaning of landmark points is often lost in 2D approaches where landmarks are either moved to visible boundaries or…

Computer Vision and Pattern Recognition · Computer Science 2017-09-11 Chandrasekhar Bhagavatula , Chenchen Zhu , Khoa Luu , Marios Savvides

There is a growing demand for the accessible creation of high-quality 3D avatars that are animatable and customizable. Although 3D morphable models provide intuitive control for editing and animation, and robustness for single-view face…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Connor Z. Lin , Koki Nagano , Jan Kautz , Eric R. Chan , Umar Iqbal , Leonidas Guibas , Gordon Wetzstein , Sameh Khamis

Portrait stylization is a long-standing task enabling extensive applications. Although 2D-based methods have made great progress in recent years, real-world applications such as metaverse and games often demand 3D content. On the other…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Zhuo Chen , Xudong Xu , Yichao Yan , Ye Pan , Wenhan Zhu , Wayne Wu , Bo Dai , Xiaokang Yang

For visual manipulation tasks, we aim to represent image content with semantically meaningful features. However, learning implicit representations from images often lacks interpretability, especially when attributes are intertwined. We…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Xue Hu , Xinghui Li , Benjamin Busam , Yiren Zhou , Ales Leonardis , Shanxin Yuan

Scene image editing is crucial for entertainment, photography, and advertising design. Existing methods solely focus on either 2D individual object or 3D global scene editing. This results in a lack of a unified approach to effectively…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Qihang Zhang , Yinghao Xu , Chaoyang Wang , Hsin-Ying Lee , Gordon Wetzstein , Bolei Zhou , Ceyuan Yang

This paper presents a novel image inpainting framework for face mask removal. Although current methods have demonstrated their impressive ability in recovering damaged face images, they suffer from two main problems: the dependence on…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Xiangnan Yin , Liming Chen

Millions of images of human faces are captured every single day; but these photographs portray the likeness of an individual with a fixed pose, expression, and appearance. Portrait image animation enables the post-capture adjustment of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Connor Z. Lin , David B. Lindell , Eric R. Chan , Gordon Wetzstein

Facial editing is an important task with applications in entertainment, virtual reality, and digital avatars. Most existing approaches rely on generative models in the 2D image domain, while in 3D the task is typically performed through…

Image inpainting approaches have achieved significant progress with the help of deep neural networks. However, existing approaches mainly focus on leveraging the priori distribution learned by neural networks to produce a single inpainting…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Wangbo Yu , Jinhao Du , Ruixin Liu , Yixuan Li , Yuesheng zhu

Facial motion retargeting is an important problem in both computer graphics and vision, which involves capturing the performance of a human face and transferring it to another 3D character. Learning 3D morphable model (3DMM) parameters from…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Bindita Chaudhuri , Noranart Vesdapunt , Baoyuan Wang

Existing 3D-aware portrait synthesis methods can generate impressive high-quality images while preserving strong 3D consistency. However, most of them cannot support the fine-grained part-level control over synthesized images. Conversely,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Ruiqi Liu , Peng Zheng , Ye Wang , Rui Ma

3D face modeling has been an active area of research in computer vision and computer graphics, fueling applications ranging from facial expression transfer in virtual avatars to synthetic data generation. Existing 3D deep learning…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Fariborz Taherkhani , Aashish Rai , Quankai Gao , Shaunak Srivastava , Xuanbai Chen , Fernando de la Torre , Steven Song , Aayush Prakash , Daeil Kim

The existing auto-encoder based face pose editing methods primarily focus on modeling the identity preserving ability during pose synthesis, but are less able to preserve the image style properly, which refers to the color, brightness,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Xiangnan Yin , Di Huang , Hongyu Yang , Zehua Fu , Yunhong Wang , Liming Chen

Recent works have shown that a rich set of semantic directions exist in the latent space of Generative Adversarial Networks (GANs), which enables various facial attribute editing applications. However, existing methods may suffer poor…

Computer Vision and Pattern Recognition · Computer Science 2021-05-28 Yuxuan Han , Jiaolong Yang , Ying Fu

We propose a method to disentangle linear-encoded facial semantics from StyleGAN without external supervision. The method derives from linear regression and sparse representation learning concepts to make the disentangled latent…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Yutong Zheng , Yu-Kai Huang , Ran Tao , Zhiqiang Shen , Marios Savvides