English
Related papers

Related papers: Visualize and Paint GAN Activations

200 papers

While Generative Adversarial Networks (GANs) show increasing performance and the level of realism is becoming indistinguishable from natural images, this also comes with high demands on data and computation. We show that state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Hui-Po Wang , Ning Yu , Mario Fritz

This paper presents a speculation on a fictive co-creation scenario that extends classical interaction patterns with generative models. While existing interfaces are restricted to the input and output layers, we suggest hidden layer…

Human-Computer Interaction · Computer Science 2023-04-28 Imke Grabe , Jichen Zhu

Despite significant improvements on the image generation performance of Generative Adversarial Networks (GANs), generations with low visual fidelity still have been observed. As widely used metrics for GANs focus more on the overall…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Haedong Jeong , Jiyeon Han , Jaesik Choi

Deep image inpainting has made impressive progress with recent advances in image generation and processing algorithms. We claim that the performance of inpainting algorithms can be better judged by the generated structures and textures.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Jitesh Jain , Yuqian Zhou , Ning Yu , Humphrey Shi

As the request for deep learning solutions increases, the need for explainability is even more fundamental. In this setting, particular attention has been given to visualization techniques, that try to attribute the right relevance to each…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Samuele Poppi , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

GANs provide a framework for training generative models which mimic a data distribution. However, in many cases we wish to train these generative models to optimize some auxiliary objective function within the data it generates, such as…

Computer Vision and Pattern Recognition · Computer Science 2017-10-02 Andrew Kyle Lampinen , David So , Douglas Eck , Fred Bertsch

As recent generative models can generate photo-realistic images, people seek to understand the mechanism behind the generation process. Interpretable generation process is beneficial to various image editing applications. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Yu-Ding Lu , Hsin-Ying Lee , Hung-Yu Tseng , Ming-Hsuan Yang

Neural Painters is a class of models that follows a GAN framework to generate brushstrokes, which are then composed to create paintings. GANs are great generative models for AI Art but they are known to be notoriously difficult to train. To…

Machine Learning · Computer Science 2021-11-23 Ernesto Diaz-Aviles , Claudia Orellana-Rodriguez , Beth Jochim

Generative Adversarial Networks (GANs) have been widely applied in modeling diverse image distributions. However, despite its impressive applications, the structure of the latent space in GANs largely remains as a black-box, leaving its…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Zikun Chen , Ruowei Jiang , Brendan Duke , Han Zhao , Parham Aarabi

We present Generative Adversarial Networks (GANs), in which the symmetric property of the generated images is controlled. This is obtained through the generator network's architecture, while the training procedure and the loss remain the…

Computer Vision and Pattern Recognition · Computer Science 2020-01-16 Irad Peleg , Lior Wolf

The objective of image outpainting is to extend image current border and generate new regions based on known ones. Previous methods adopt generative adversarial networks (GANs) to synthesize realistic images. However, the lack of explicit…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Ye Ma , Jin Ma , Min Zhou , Quan Chen , Tiezheng Ge , Yuning Jiang , Tong Lin

As applications of generative AI become mainstream, it is important to understand what generative models are capable of producing, and the extent to which one can predictably control their outputs. In this paper, we propose a visualization…

Human-Computer Interaction · Computer Science 2024-07-01 Sangwon Jeong , Mingwei Li , Matthew Berger , Shusen Liu

This paper describes a simple technique to analyze Generative Adversarial Networks (GANs) and create interpretable controls for image synthesis, such as change of viewpoint, aging, lighting, and time of day. We identify important latent…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Erik Härkönen , Aaron Hertzmann , Jaakko Lehtinen , Sylvain Paris

Generative adversarial networks (GANs) has gained tremendous popularity lately due to an ability to reinforce quality of its predictive model with generated objects and the quality of the generative model with and supervised feedback. GANs…

Computer Vision and Pattern Recognition · Computer Science 2017-05-31 Evgeny Zamyatin , Andrey Filchenkov

Image inpainting is one of the most challenging tasks in computer vision. Recently, generative-based image inpainting methods have been shown to produce visually plausible images. However, they still have difficulties to generate the…

Computer Vision and Pattern Recognition · Computer Science 2020-02-24 Mohamed Abbas Hedjazi , Yakup Genc

We tackle the problem of texture synthesis in the setting where many input images are given and a large-scale output is required. We build on recent generative adversarial networks and propose two extensions in this paper. First, we propose…

Graphics · Computer Science 2019-04-30 Anna Frühstück , Ibraheem Alhashim , Peter Wonka

We present a generative image inpainting system to complete images with free-form mask and guidance. The system is based on gated convolutions learned from millions of images without additional labelling efforts. The proposed gated…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Jiahui Yu , Zhe Lin , Jimei Yang , Xiaohui Shen , Xin Lu , Thomas Huang

This work presents an easy-to-use regularizer for GAN training, which helps explicitly link some axes of the latent space to a set of pixels in the synthesized image. Establishing such a connection facilitates a more convenient local…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Jiapeng Zhu , Ceyuan Yang , Yujun Shen , Zifan Shi , Bo Dai , Deli Zhao , Qifeng Chen

Advances in the realm of Generative Adversarial Networks (GANs) have led to architectures capable of producing amazingly realistic images such as StyleGAN2, which, when trained on the FFHQ dataset, generates images of human faces from…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Mengyu Yang , David Rokeby , Xavier Snelgrove

Recent advances in Generative Adversarial Networks (GANs) have led to the creation of realistic-looking digital images that pose a major challenge to their detection by humans or computers. GANs are used in a wide range of tasks, from…

Image and Video Processing · Electrical Eng. & Systems 2020-07-22 Michael Goebel , Lakshmanan Nataraj , Tejaswi Nanjundaswamy , Tajuddin Manhar Mohammed , Shivkumar Chandrasekaran , B. S. Manjunath