English
Related papers

Related papers: MyStyle: A Personalized Generative Prior

200 papers

We present an invert-and-edit framework to automatically transform facial weight of an input face image to look thinner or heavier by leveraging semantic facial attributes encoded in the latent space of Generative Adversarial Networks…

Computer Vision and Pattern Recognition · Computer Science 2020-11-06 V N S Rama Krishna Pinnimty , Matt Zhao , Palakorn Achananuparp , Ee-Peng Lim

Recently, Generative Adversarial Networks (GANs)} have been widely used for portrait image generation. However, in the latent space learned by GANs, different attributes, such as pose, shape, and texture style, are generally entangled,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Anpei Chen , Ruiyang Liu , Ling Xie , Zhang Chen , Hao Su , Jingyi Yu

Realistic image manipulation is challenging because it requires modifying the image appearance in a user-controlled way, while preserving the realism of the result. Unless the user has considerable artistic skill, it is easy to "fall off"…

Computer Vision and Pattern Recognition · Computer Science 2018-12-18 Jun-Yan Zhu , Philipp Krähenbühl , Eli Shechtman , Alexei A. Efros

Recent advancements in personalized image generation using diffusion models have been noteworthy. However, existing methods suffer from inefficiencies due to the requirement for subject-specific fine-tuning. This computationally intensive…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Xu Peng , Junwei Zhu , Boyuan Jiang , Ying Tai , Donghao Luo , Jiangning Zhang , Wei Lin , Taisong Jin , Chengjie Wang , Rongrong Ji

AI-driven image generation has improved significantly in recent years. Generative adversarial networks (GANs), like StyleGAN, are able to generate high-quality realistic data and have artistic control over the output, as well. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Mohamed Shawky Sabae , Mohamed Ahmed Dardir , Remonda Talaat Eskarous , Mohamed Ramzy Ebbed

Generative art is a rules-driven approach to creating artistic outputs in various mediums. For example, a fluid simulation can govern the flow of colored pixels across a digital display or a rectangle placement algorithm can yield a…

Neural and Evolutionary Computing · Computer Science 2024-07-30 Erik M. Fredericks , Denton Bobeldyk , Jared M. Moore

In this paper, we propose a multi-stage and high-resolution model for image synthesis that uses fine-grained attributes and masks as input. With a fine-grained attribute, the proposed model can detailedly constrain the features of the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-13 Pengyang Li , Donghui Wang

Despite remarkable recent progress on both unconditional and conditional image synthesis, it remains a long-standing problem to learn generative models that are capable of synthesizing realistic and sharp images from reconfigurable spatial…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Wei Sun , Tianfu Wu

This study investigates identity-preserving image synthesis, an intriguing task in image generation that seeks to maintain a subject's identity while adding a personalized, stylistic touch. Traditional methods, such as Textual Inversion and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Yuxuan Yan , Chi Zhang , Rui Wang , Yichao Zhou , Gege Zhang , Pei Cheng , Gang Yu , Bin Fu

Leveraging Stable Diffusion for the generation of personalized portraits has emerged as a powerful and noteworthy tool, enabling users to create high-fidelity, custom character avatars based on their specific prompts. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Siying Cui , Jia Guo , Xiang An , Jiankang Deng , Yongle Zhao , Xinyu Wei , Ziyong Feng

Recent advances in generative models and adversarial training have enabled artificially generating artworks in various artistic styles. It is highly desirable to gain more control over the generated style in practice. However, artistic…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Xin Miao , Huayan Wang , Jun Fu , Jiayi Liu , Shen Wang , Zhenyu Liao

In this paper, we present StyleLipSync, a style-based personalized lip-sync video generative model that can generate identity-agnostic lip-synchronizing video from arbitrary audio. To generate a video of arbitrary identities, we leverage…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Taekyung Ki , Dongchan Min

Digital humans and, especially, 3D facial avatars have raised a lot of attention in the past years, as they are the backbone of several applications like immersive telepresence in AR or VR. Despite the progress, facial avatars reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Berna Kabadayi , Wojciech Zielonka , Bharat Lal Bhatnagar , Gerard Pons-Moll , Justus Thies

Semantic face editing of real world facial images is an important application of generative models. Recently, multiple works have explored possible techniques to generate such modifications using the latent structure of pre-trained GAN…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Ravi Kiran Reddy , Kumar Shubham , Gopalakrishnan Venkatesh , Sriram Gandikota , Sarthak Khoche , Dinesh Babu Jayagopi , Gopalakrishnan Srinivasaraghavan

Deep generative models make visual content creation more accessible to novice users by automating the synthesis of diverse, realistic content based on a collected dataset. However, the current machine learning approaches miss a key element…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Sheng-Yu Wang , David Bau , Jun-Yan Zhu

This paper studies the task of full generative modelling of realistic images of humans, guided only by coarse sketch of the pose, while providing control over the specific instance or type of outfit worn by the user. This is a difficult…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Xu Chen , Jie Song , Otmar Hilliges

In recent years, image generation has made great strides in improving the quality of images, producing high-fidelity ones. Also, quite recently, there are architecture designs, which enable GAN to unsupervisedly learn the semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Xin Jin , Shu Zhao , Le Zhang , Xin Zhao , Qiang Deng , Chaoen Xiao

Deep generative models are proficient in generating realistic data but struggle with producing rare samples in low density regions due to their scarcity of training datasets and the mode collapse problem. While recent methods aim to improve…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Subeen Lee , Jiyeon Han , Soyeon Kim , Jaesik Choi

Blind face restoration usually relies on facial priors, such as facial geometry prior or reference prior, to restore realistic and faithful details. However, very low-quality inputs cannot offer accurate geometric prior while high-quality…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Xintao Wang , Yu Li , Honglun Zhang , Ying Shan

Generative models make huge progress to the photorealistic image synthesis in recent years. To enable human to steer the image generation process and customize the output, many works explore the interpretable dimensions of the latent space…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Jianyuan Wang , Lalit Bhagat , Ceyuan Yang , Yinghao Xu , Yujun Shen , Hongdong Li , Bolei Zhou