English
Related papers

Related papers: Controllable Person Image Synthesis with Attribute…

200 papers

We introduce a highly robust GAN-based framework for digitizing a normalized 3D avatar of a person from a single unconstrained photo. While the input image can be of a smiling person or taken in extreme lighting conditions, our method can…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Huiwen Luo , Koki Nagano , Han-Wei Kung , Mclean Goldwhite , Qingguo Xu , Zejian Wang , Lingyu Wei , Liwen Hu , Hao Li

Generation of high-quality person images is challenging, due to the sophisticated entanglements among image factors, e.g., appearance, pose, foreground, background, local details, global structures, etc. In this paper, we present a novel…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Siyu Huang , Haoyi Xiong , Zhi-Qi Cheng , Qingzhong Wang , Xingran Zhou , Bihan Wen , Jun Huan , Dejing Dou

Millions of images of human faces are captured every single day; but these photographs portray the likeness of an individual with a fixed pose, expression, and appearance. Portrait image animation enables the post-capture adjustment of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Connor Z. Lin , David B. Lindell , Eric R. Chan , Gordon Wetzstein

In this paper we tackle the problem of pose guided person image generation, which aims to transfer a person image from the source pose to a novel target pose while maintaining the source appearance. Given the inefficiency of standard CNNs…

Computer Vision and Pattern Recognition · Computer Science 2021-02-08 Jilin Tang , Yi Yuan , Tianjia Shao , Yong Liu , Mengmeng Wang , Kun Zhou

Representation disentanglement aims at learning interpretable features, so that the output can be recovered or manipulated accordingly. While existing works like infoGAN and AC-GAN exist, they choose to derive disjoint attribute code for…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Shang-Fu Chen , Jia-Wei Yan , Ya-Fan Su , Yu-Chiang Frank Wang

Recent studies have shown that StyleGANs provide promising prior models for downstream tasks on image synthesis and editing. However, since the latent codes of StyleGANs are designed to control global styles, it is hard to achieve a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Yichun Shi , Xiao Yang , Yangyue Wan , Xiaohui Shen

Recent advances in generative adversarial networks (GANs) have led to remarkable achievements in face image synthesis. While methods that use style-based GANs can generate strikingly photorealistic face images, it is often difficult to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Safa C. Medin , Bernhard Egger , Anoop Cherian , Ye Wang , Joshua B. Tenenbaum , Xiaoming Liu , Tim K. Marks

In this paper, we introduce a new method for generating an object image from text attributes on a desired location, when the base image is given. One step further to the existing studies on text-to-image generation mainly focusing on the…

Computer Vision and Pattern Recognition · Computer Science 2018-08-16 Hyojin Park , YoungJoon Yoo , Nojun Kwak

Various controls over the generated data can be extracted from the latent space of a pre-trained GAN, as it implicitly encodes the semantics of the training data. The discovered controls allow to vary semantic attributes in the generated…

Machine Learning · Computer Science 2022-01-28 Perla Doubinsky , Nicolas Audebert , Michel Crucianu , Hervé Le Borgne

We tackle human image synthesis, including human motion imitation, appearance transfer, and novel view synthesis, within a unified framework. It means that the model, once being trained, can be used to handle all these tasks. The existing…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Wen Liu , Zhixin Piao , Zhi Tu , Wenhan Luo , Lin Ma , Shenghua Gao

Despite remarkable advances in image synthesis research, existing works often fail in manipulating images under the context of large geometric transformations. Synthesizing person images conditioned on arbitrary poses is one of the most…

Computer Vision and Pattern Recognition · Computer Science 2019-01-14 Haoye Dong , Xiaodan Liang , Ke Gong , Hanjiang Lai , Jia Zhu , Jian Yin

Generative adversarial networks (GANs) have attained photo-realistic quality in image generation. However, how to best control the image content remains an open challenge. We introduce LatentKeypointGAN, a two-stage GAN which is trained…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Xingzhe He , Bastian Wandt , Helge Rhodin

Generating a photorealistic image with intended human pose is a promising yet challenging research topic for many applications such as smart photo editing, movie making, virtual try-on, and fashion display. In this paper, we present a novel…

Computer Vision and Pattern Recognition · Computer Science 2019-09-19 Wei Sun , Jawadul H. Bappy , Shanglin Yang , Yi Xu , Tianfu Wu , Hui Zhou

We propose a novel multi-texture synthesis model based on generative adversarial networks (GANs) with a user-controllable mechanism. The user control ability allows to explicitly specify the texture which should be generated by the model.…

Computer Vision and Pattern Recognition · Computer Science 2019-04-25 Aibek Alanov , Max Kochurov , Denis Volkhonskiy , Daniil Yashkov , Evgeny Burnaev , Dmitry Vetrov

Generative models make huge progress to the photorealistic image synthesis in recent years. To enable human to steer the image generation process and customize the output, many works explore the interpretable dimensions of the latent space…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Jianyuan Wang , Lalit Bhagat , Ceyuan Yang , Yinghao Xu , Yujun Shen , Hongdong Li , Bolei Zhou

Pose Guided Human Image Synthesis (PGHIS) is a challenging task of transforming a human image from the reference pose to a target pose while preserving its style. Most existing methods encode the texture of the whole reference human image…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Jianhan Wu , Jianzong Wang , Shijing Si , Xiaoyang Qu , Jing Xiao

Image attribute transfer aims to change an input image to a target one with expected attributes, which has received significant attention in recent years. However, most of the existing methods lack the ability to de-correlate the target…

Computer Vision and Pattern Recognition · Computer Science 2019-02-19 De Xie , Muli Yang , Cheng Deng , Wei Liu , Dacheng Tao

This paper presents a novel method to manipulate the visual appearance (pose and attribute) of a person image according to natural language descriptions. Our method can be boiled down to two stages: 1) text guided pose generation and 2)…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Xingran Zhou , Siyu Huang , Bin Li , Yingming Li , Jiachen Li , Zhongfei Zhang

While the quality of GAN image synthesis has improved tremendously in recent years, our ability to control and condition the output is still limited. Focusing on StyleGAN, we introduce a simple and effective method for making local,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Edo Collins , Raja Bala , Bob Price , Sabine Süsstrunk

This paper describes a simple technique to analyze Generative Adversarial Networks (GANs) and create interpretable controls for image synthesis, such as change of viewpoint, aging, lighting, and time of day. We identify important latent…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Erik Härkönen , Aaron Hertzmann , Jaakko Lehtinen , Sylvain Paris