English
Related papers

Related papers: PIE: Portrait Image Embedding for Semantic Control

200 papers

Facial attribute editing plays a crucial role in synthesizing realistic faces with specific characteristics while maintaining realistic appearances. Despite advancements, challenges persist in achieving precise, 3D-aware attribute…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Yu-Kai Huang , Yutong Zheng , Yen-Shuo Su , Anudeepsekhar Bolimera , Han Zhang , Fangyi Chen , Marios Savvides

We propose a novel ECGAN for the challenging semantic image synthesis task. Although considerable improvements have been achieved by the community in the recent period, the quality of synthesized images is far from satisfactory due to three…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Hao Tang , Guolei Sun , Nicu Sebe , Luc Van Gool

Developing techniques for editing an outfit image through natural sentences and accordingly generating new outfits has promising applications for art, fashion and design. However, it is considered as a certainly challenging task since image…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Mehmet Günel , Erkut Erdem , Aykut Erdem

State-of-the-art generative models (e.g. StyleGAN3 \cite{karras2021alias}) often generate photorealistic images based on vectors sampled from their latent space. However, the ability to control the output is limited. Here we present our…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Róbert Belanec , Peter Lacko , Kristína Malinovská

Generative Adversarial Networks (GANs) have witnessed significant advances in recent years, generating increasingly higher quality images, which are non-distinguishable from real ones. Recent GANs have proven to encode features in a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Wassim Kabbani , Marcel Grimmer , Christoph Busch

Semantic inpainting or image completion alludes to the task of inferring arbitrary large missing regions in images based on image semantics. Since the prediction of image pixels requires an indication of high-level context, this makes it…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Priyansh Saxena , Raahat Gupta , Akshat Maheshwari , Saumil Maheshwari

Previous portrait image generation methods roughly fall into two categories: 2D GANs and 3D-aware GANs. 2D GANs can generate high fidelity portraits but with low view consistency. 3D-aware GAN methods can maintain view consistency but their…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Jingxiang Sun , Xuan Wang , Yong Zhang , Xiaoyu Li , Qi Zhang , Yebin Liu , Jue Wang

Despite the recent success of face image generation with GANs, conditional hair editing remains challenging due to the under-explored complexity of its geometry and appearance. In this paper, we present MichiGAN (Multi-Input-Conditioned…

Computer Vision and Pattern Recognition · Computer Science 2020-11-02 Zhentao Tan , Menglei Chai , Dongdong Chen , Jing Liao , Qi Chu , Lu Yuan , Sergey Tulyakov , Nenghai Yu

Unconstrained Image generation with high realism is now possible using recent Generative Adversarial Networks (GANs). However, it is quite challenging to generate images with a given set of attributes. Recent methods use style-based GAN…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Rishubh Parihar , Ankit Dhiman , Tejan Karmali , R. Venkatesh Babu

The latent code of the recent popular model StyleGAN has learned disentangled representations thanks to the multi-layer style-based generator. Embedding a given image back to the latent space of StyleGAN enables wide interesting semantic…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Shanyan Guan , Ying Tai , Bingbing Ni , Feida Zhu , Feiyue Huang , Xiaokang Yang

Deep generative models, like GANs, have considerably improved the state of the art in image synthesis, and are able to generate near photo-realistic images in structured domains such as human faces. Based on this success, recent work on…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Guillaume Couairon , Asya Grechka , Jakob Verbeek , Holger Schwenk , Matthieu Cord

In this paper, we focus on how artificial intelligence (AI) can be used to assist users in the creation of anime portraits, that is, converting rough sketches into anime portraits during their sketching process. The input is a sequence of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Zhengyu Huang , Haoran Xie , Tsukasa Fukusato , Kazunori Miyata

Image inpainting approaches have achieved significant progress with the help of deep neural networks. However, existing approaches mainly focus on leveraging the priori distribution learned by neural networks to produce a single inpainting…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Wangbo Yu , Jinhao Du , Ruixin Liu , Yixuan Li , Yuesheng zhu

We propose a novel ECGAN for the challenging semantic image synthesis task. Although considerable improvement has been achieved, the quality of synthesized images is far from satisfactory due to three largely unresolved challenges. 1) The…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Hao Tang , Xiaojuan Qi , Guolei Sun , Dan Xu , Nicu Sebe , Radu Timofte , Luc Van Gool

Editing real facial images is a crucial task in computer vision with significant demand in various real-world applications. While GAN-based methods have showed potential in manipulating images especially when combined with CLIP, these…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Dongxu Yue , Qin Guo , Munan Ning , Jiaxi Cui , Yuesheng Zhu , Li Yuan

The term attribute transfer refers to the tasks of altering images in such a way, that the semantic interpretation of a given input image is shifted towards an intended direction, which is quantified by semantic attributes. Prominent…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Ricard Durall , Franz-Josef Pfreundt , Janis Keuper

The StyleGAN family succeed in high-fidelity image generation and allow for flexible and plausible editing of generated images by manipulating the semantic-rich latent style space.However, projecting a real image into its latent space…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Bingchuan Li , Tianxiang Ma , Peng Zhang , Miao Hua , Wei Liu , Qian He , Zili Yi

Recent studies on StyleGAN show high performance on artistic portrait generation by transfer learning with limited data. In this paper, we explore more challenging exemplar-based high-resolution portrait style transfer by introducing a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Shuai Yang , Liming Jiang , Ziwei Liu , Chen Change Loy

Generative models make huge progress to the photorealistic image synthesis in recent years. To enable human to steer the image generation process and customize the output, many works explore the interpretable dimensions of the latent space…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Jianyuan Wang , Lalit Bhagat , Ceyuan Yang , Yinghao Xu , Yujun Shen , Hongdong Li , Bolei Zhou

Pixel-level fine-grained image editing remains an open challenge. Previous works fail to achieve an ideal trade-off between control granularity and inference speed. They either fail to achieve pixel-level fine-grained control, or their…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Pengxiang Cai , Zhiwei Liu , Guibo Zhu , Yunfang Niu , Jinqiao Wang