English
Related papers

Related papers: Art Creation with Multi-Conditional StyleGANs

200 papers

We present Poly-GAN, a novel conditional GAN architecture that is motivated by Fashion Synthesis, an application where garments are automatically placed on images of human models at an arbitrary pose. Poly-GAN allows conditioning on…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Nilesh Pandey , Andreas Savakis

While most image captioning aims to generate objective descriptions of images, the last few years have seen work on generating visually grounded image captions which have a specific style (e.g., incorporating positive or negative…

Computer Vision and Pattern Recognition · Computer Science 2019-08-09 Omid Mohamad Nezami , Mark Dras , Stephen Wan , Cecile Paris , Len Hamey

GANs (Generative adversarial networks) is a new AI technology that can perform deep learning with less training data and has the capability of achieving transformation between two image sets. Using GAN we have carried out a comparison…

Computer Vision and Pattern Recognition · Computer Science 2020-05-06 Mai Cong Hung , Ryohei Nakatsu , Naoko Tosa , Takashi Kusumi , Koji Koyamada

Generating music has a few notable differences from generating images and videos. First, music is an art of time, necessitating a temporal model. Second, music is usually composed of multiple instruments/tracks with their own temporal…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-06 Hao-Wen Dong , Wen-Yi Hsiao , Li-Chia Yang , Yi-Hsuan Yang

Humans can imagine a scene from a sound. We want machines to do so by using conditional generative adversarial networks (GANs). By applying the techniques including spectral norm, projection discriminator and auxiliary classifier, compared…

Computation and Language · Computer Science 2018-08-14 Chia-Hung Wan , Shun-Po Chuang , Hung-Yi Lee

In this paper, we explore the task of generating photo-realistic face images from lines. Previous methods based on conditional generative adversarial networks (cGANs) have shown their power to generate visually plausible images when a…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Yuhang Li , Xuejin Chen , Feng Wu , Zheng-Jun Zha

Current GAN-based art generation methods produce unoriginal artwork due to their dependence on conditional input. Here, we propose Sketch-And-Paint GAN (SAPGAN), the first model which generates Chinese landscape paintings from end to end,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-12 Alice Xue

Synthesizing high-quality images from text descriptions is a challenging problem in computer vision and has many practical applications. Samples generated by existing text-to-image approaches can roughly reflect the meaning of the given…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Han Zhang , Tao Xu , Hongsheng Li , Shaoting Zhang , Xiaogang Wang , Xiaolei Huang , Dimitris Metaxas

Generative adversarial networks (GANs) are a recent approach to train generative models of data, which have been shown to work particularly well on image data. In the current paper we introduce a new model for texture synthesis based on GAN…

Computer Vision and Pattern Recognition · Computer Science 2017-09-11 Nikolay Jetchev , Urs Bergmann , Roland Vollgraf

Most conditional generation tasks expect diverse outputs given a single conditional context. However, conditional generative adversarial networks (cGANs) often focus on the prior conditional information and ignore the input noise vectors,…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Qi Mao , Hsin-Ying Lee , Hung-Yu Tseng , Siwei Ma , Ming-Hsuan Yang

Most existing text-to-image synthesis tasks are static single-turn generation, based on pre-defined textual descriptions of images. To explore more practical and interactive real-life applications, we introduce a new task - Interactive…

Computer Vision and Pattern Recognition · Computer Science 2020-08-07 Yu Cheng , Zhe Gan , Yitong Li , Jingjing Liu , Jianfeng Gao

Recovering badly damaged face images is a useful yet challenging task, especially in extreme cases where the masked or damaged region is very large. One of the major challenges is the ability of the system to generalize on faces outside the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Nilesh Pandey , Andreas Savakis

We study the problem of conditional generative modeling based on designated semantics or structures. Existing models that build conditional generators either require massive labeled instances as supervision or are unable to accurately…

Machine Learning · Computer Science 2017-11-06 Zhijie Deng , Hao Zhang , Xiaodan Liang , Luona Yang , Shizhen Xu , Jun Zhu , Eric P. Xing

Recently, realistic image generation using deep neural networks has become a hot topic in machine learning and computer vision. Images can be generated at the pixel level by learning from a large collection of images. Learning to generate…

Computer Vision and Pattern Recognition · Computer Science 2017-05-09 Yifan Liu , Zengchang Qin , Zhenbo Luo , Hua Wang

In this paper we investigate image generation guided by hand sketch. When the input sketch is badly drawn, the output of common image-to-image translation follows the input edges due to the hard condition imposed by the translation process.…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Yongyi Lu , Shangzhe Wu , Yu-Wing Tai , Chi-Keung Tang

While generative adversarial networks (GANs) have revolutionized machine learning, a number of open questions remain to fully understand them and exploit their power. One of these questions is how to efficiently achieve proper diversity and…

Computer Vision and Pattern Recognition · Computer Science 2020-02-26 Ze Wang , Xiuyuan Cheng , Guillermo Sapiro , Qiang Qiu

Generating realistic 3D faces is of high importance for computer graphics and computer vision applications. Generally, research on 3D face generation revolves around linear statistical models of the facial surface. Nevertheless, these…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Baris Gecer , Alexander Lattas , Stylianos Ploumpis , Jiankang Deng , Athanasios Papaioannou , Stylianos Moschoglou , Stefanos Zafeiriou

In this paper, we propose a method that disentangles the effects of multiple input conditions in Generative Adversarial Networks (GANs). In particular, we demonstrate our method in controlling color, texture, and shape of a generated…

Computer Vision and Pattern Recognition · Computer Science 2018-06-21 Gökhan Yildirim , Calvin Seward , Urs Bergmann

In the field of computer vision, multimodal image generation has become a research hotspot, especially the task of integrating text, image, and style. In this study, we propose a multimodal image generation method based on Generative…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Chaoyi Tan , Wenqing Zhang , Zhen Qi , Kowei Shih , Xinshi Li , Ao Xiang

Conditional image synthesis from layout has recently attracted much interest. Previous approaches condition the generator on object locations as well as class labels but lack fine-grained control over the diverse appearance aspects of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Stanislav Frolov , Avneesh Sharma , Jörn Hees , Tushar Karayil , Federico Raue , Andreas Dengel