English
Related papers

Related papers: VToonify: Controllable High-Resolution Portrait Vi…

200 papers

While recent research has progressively overcome the low-resolution constraint of one-shot face video re-enactment with the help of StyleGAN's high-fidelity portrait generation, these approaches rely on at least one of the following:…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Trevine Oorloff , Yaser Yacoob

One-shot talking face generation aims at synthesizing a high-quality talking face video from an arbitrary portrait image, driven by a video or an audio segment. One challenging quality factor is the resolution of the output video: higher…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Fei Yin , Yong Zhang , Xiaodong Cun , Mingdeng Cao , Yanbo Fan , Xuan Wang , Qingyan Bai , Baoyuan Wu , Jue Wang , Yujiu Yang

Face stylization refers to the transformation of a face into a specific portrait style. However, current methods require the use of example-based adaptation approaches to fine-tune pre-trained generative models so that they demand lots of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Jin Liu , Huaibo Huang , Chao Jin , Ran He

Our paper addresses the complex task of transferring a hairstyle from a reference image to an input photo for virtual hair try-on. This task is challenging due to the need to adapt to various photo poses, the sensitivity of hairstyles, and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Maxim Nikolaev , Mikhail Kuznetsov , Dmitry Vetrov , Aibek Alanov

This paper presents an innovative approach to achieve face cartoonisation while preserving the original identity and accommodating various poses. Unlike previous methods in this field that relied on conditional-GANs, which posed challenges…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Kushal Jain , Ankith Varun J , Anoop Namboodiri

Portrait Stylization aims to imbue portrait photos with vivid artistic effects drawn from style examples. Despite the availability of enormous training datasets and large network weights, existing methods struggle to maintain geometric…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Xinrui Wang , Zhuoru Li , Xiao Zhou , Yusuke Iwasawa , Yutaka Matsuo

Portrait synthesis creates realistic digital avatars which enable users to interact with others in a compelling way. Recent advances in StyleGAN and its extensions have shown promising results in synthesizing photorealistic and accurate…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Kai-En Lin , Alex Trevithick , Keli Cheng , Michel Sarkis , Mohsen Ghafoorian , Ning Bi , Gerhard Reitmayr , Ravi Ramamoorthi

Recent works on language-guided image manipulation have shown great power of language in providing rich semantics, especially for face images. However, the other natural information, motions, in language is less explored. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Tiankai Hang , Huan Yang , Bei Liu , Jianlong Fu , Xin Geng , Baining Guo

Recent research has witnessed advances in facial image editing tasks including face swapping and face reenactment. However, these methods are confined to dealing with one specific task at a time. In addition, for video facial editing,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-21 Meng Cao , Haozhi Huang , Hao Wang , Xuan Wang , Li Shen , Sheng Wang , Linchao Bao , Zhifeng Li , Jiebo Luo

The existing methods for audio-driven talking head video editing have the limitations of poor visual effects. This paper tries to tackle this problem through editing talking face images seamless with different emotions based on two modules:…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Jiacheng Su , Kunhong Liu , Liyan Chen , Junfeng Yao , Qingsong Liu , Dongdong Lv

Previous animatable 3D-aware GANs for human generation have primarily focused on either the human head or full body. However, head-only videos are relatively uncommon in real life, and full body generation typically does not deal with…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yue Wu , Sicheng Xu , Jianfeng Xiang , Fangyun Wei , Qifeng Chen , Jiaolong Yang , Xin Tong

We introduce PortraitGen, a powerful portrait video editing method that achieves consistent and expressive stylization with multimodal prompts. Traditional portrait video editing methods often struggle with 3D and temporal consistency, and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Xuan Gao , Haiyao Xiao , Chenglai Zhong , Shimin Hu , Yudong Guo , Juyong Zhang

Creating a realistic animatable avatar from a single static portrait remains challenging. Existing approaches often struggle to capture subtle facial expressions, the associated global body movements, and the dynamic background. To address…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Mengchao Wang , Qiang Wang , Fan Jiang , Yaqi Fan , Yunpeng Zhang , Yonggang Qi , Kun Zhao , Mu Xu

Photo-realistic re-rendering of a human from a single image with explicit control over body pose, shape and appearance enables a wide range of applications, such as human appearance transfer, virtual try-on, motion imitation, and novel view…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Kripasindhu Sarkar , Vladislav Golyanik , Lingjie Liu , Christian Theobalt

Video colorization aims to transform grayscale videos into vivid color representations while maintaining temporal consistency and structural integrity. Existing video colorization methods often suffer from color bleeding and lack…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Zixun Fang , Zhiheng Liu , Kai Zhu , Yu Liu , Ka Leong Cheng , Wei Zhai , Yang Cao , Zheng-Jun Zha

Throughout history, humans have created remarkable works of art, but artificial intelligence has only recently started to make strides in generating visually compelling art. Breakthroughs in the past few years have focused on using…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Kapil Kashyap , Mehak Garg , Sean Fargose , Sindhu Nair

Achieving fine-grained controllability in human image synthesis is a long-standing challenge in computer vision. Existing methods primarily focus on either facial synthesis or near-frontal body generation, with limited ability to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Zhengwentai Sun , Chenghong Li , Hongjie Liao , Xihe Yang , Keru Zheng , Heyuan Li , Yihao Zhi , Shuliang Ning , Shuguang Cui , Xiaoguang Han

StyleGAN generates photorealistic portrait images of faces with eyes, teeth, hair and context (neck, shoulders, background), but lacks a rig-like control over semantic face parameters that are interpretable in 3D, such as face pose,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Ayush Tewari , Mohamed Elgharib , Gaurav Bharaj , Florian Bernard , Hans-Peter Seidel , Patrick Pérez , Michael Zollhöfer , Christian Theobalt

Face re-aging is a prominent field in computer vision and graphics, with significant applications in photorealistic domains such as movies, advertising, and live streaming. Recently, the need to apply face re-aging to non-photorealistic…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Bumsoo Kim , Abdul Muqeet , Kyuchul Lee , Sanghyun Seo

Virtual Try-On (VTON) aims to synthesize photorealistic images of garments precisely aligned with a person's body and pose. Current diffusion-based methods, however, face a fundamental trade-off between structural integrity and textural…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Yixin Liu , Baihong Qian , Jinglin Jiang , Jeffery Wu , Yan Chen , Wei Wang , Yida Wang , Lanqing Yang , Guangtao Xue