English
Related papers

Related papers: Vit-GAN: Image-to-image Translation with Vision Tr…

200 papers

Recent progress in Generative Adversarial Networks (GANs) has shown promising signs of improving GAN training via architectural change. Despite some early success, at present the design of GAN architectures requires human expertise,…

Machine Learning · Computer Science 2019-06-27 Hanchao Wang , Jun Huan

Generative adversarial networks (GANs) are widely used in image generation tasks, yet the generated images are usually lack of texture details. In this paper, we propose a general framework, called Progressively Unfreezing Perceptual GAN…

Computer Vision and Pattern Recognition · Computer Science 2020-06-20 Jinxuan Sun , Yang Chen , Junyu Dong , Guoqiang Zhong

CoMoGAN is a continuous GAN relying on the unsupervised reorganization of the target data on a functional manifold. To that matter, we introduce a new Functional Instance Normalization layer and residual mechanism, which together…

Computer Vision and Pattern Recognition · Computer Science 2022-06-30 Fabio Pizzati , Pietro Cerri , Raoul de Charette

Generating images according to natural language descriptions is a challenging task. Prior research has mainly focused to enhance the quality of generation by investigating the use of spatial attention and/or textual attention thereby…

Computer Vision and Pattern Recognition · Computer Science 2022-01-17 Henning Schulze , Dogucan Yaman , Alexander Waibel

Recent approaches in generative adversarial networks (GANs) can automatically synthesize realistic images from descriptive text. Despite the overall fair quality, the generated images often expose visible flaws that lack structural…

Computer Vision and Pattern Recognition · Computer Science 2017-08-31 Miriam Cha , Youngjune Gwon , H. T. Kung

For semantic-guided cross-view image translation, it is crucial to learn where to sample pixels from the source view image and where to reallocate them guided by the target view semantic map, especially when there is little overlap or…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Bin Ren , Hao Tang , Yiming Wang , Xia Li , Wei Wang , Nicu Sebe

We propose a simple yet powerful Landmark guided Generative Adversarial Network (LandmarkGAN) for the facial expression-to-expression translation using a single image, which is an important and challenging task in computer vision since the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Hao Tang , Nicu Sebe

While GANs have shown success in realistic image generation, the idea of using GANs for other tasks unrelated to synthesis is underexplored. Do GANs learn meaningful structural parts of objects during their attempt to reproduce those…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Nontawat Tritrong , Pitchaporn Rewatbowornwong , Supasorn Suwajanakorn

Recently, generative adversarial networks (GAN) have gathered a lot of interest. Their efficiency in generating unseen samples of high quality, especially images, has improved over the years. In the field of Natural Language Generation…

Computation and Language · Computer Science 2019-11-01 Jean-Benoit Delbrouck , Bastien Vanderplaetse , Stéphane Dupont

Generating an image from a provided descriptive text is quite a challenging task because of the difficulty in incorporating perceptual information (object shapes, colors, and their interactions) along with providing high relevancy related…

Computer Vision and Pattern Recognition · Computer Science 2020-07-03 Kanish Garg , Ajeet kumar Singh , Dorien Herremans , Brejesh Lall

This review surveys the state-of-the-art in text-to-image and image-to-image generation within the scope of generative AI. We provide a comparative analysis of three prominent architectures: Variational Autoencoders, Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Zineb Sordo , Eric Chagnon , Daniela Ushizima

This paper presents a new Vision Transformer (ViT) architecture Multi-Scale Vision Longformer, which significantly enhances the ViT of \cite{dosovitskiy2020image} for encoding high-resolution images using two techniques. The first is the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-28 Pengchuan Zhang , Xiyang Dai , Jianwei Yang , Bin Xiao , Lu Yuan , Lei Zhang , Jianfeng Gao

Unsupervised image translation, which aims in translating two independent sets of images, is challenging in discovering the correct correspondences without paired data. Existing works build upon Generative Adversarial Network (GAN) such…

Computer Vision and Pattern Recognition · Computer Science 2018-02-20 Shuang Ma , Jianlong Fu , Chang Wen Chen , Tao Mei

Image-to-image translation is a common task in computer vision and has been rapidly increasing the impact on the field of medical imaging. Deep learning-based methods that employ conditional generative adversarial networks (cGANs), such as…

Image and Video Processing · Electrical Eng. & Systems 2024-02-05 Wentao Chen , Xichen Xu , Jie Luo , Weimin Zhou

Image generation has rapidly evolved in recent years. Modern architectures for adversarial training allow to generate even high resolution images with remarkable quality. At the same time, more and more effort is dedicated towards…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Amrutha Saseendran , Kathrin Skubch , Margret Keuper

Conditional Generative Adversarial Networks (cGANs) have enabled controllable image synthesis for many vision and graphics applications. However, recent cGANs are 1-2 orders of magnitude more compute-intensive than modern recognition CNNs.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Muyang Li , Ji Lin , Yaoyao Ding , Zhijian Liu , Jun-Yan Zhu , Song Han

In the recent years, there has been a significant improvement in the quality of samples produced by (deep) generative models such as variational auto-encoders and generative adversarial networks. However, the representation capabilities of…

Image and Video Processing · Electrical Eng. & Systems 2026-03-31 Shady Abu Hussein , Tom Tirer , Raja Giryes

Generative Adversarial Networks (GANs) have been widely used for the image-to-image translation task. While these models rely heavily on the labeled image pairs, recently some GAN variants have been proposed to tackle the unpaired image…

Computer Vision and Pattern Recognition · Computer Science 2019-03-18 Lei Chen , Le Wu , Zhenzhen Hu , Meng Wang

A good Text-to-Image model should not only generate high quality images, but also ensure the consistency between the text and the generated image. Previous models failed to simultaneously fix both sides well. This paper proposes a Gradual…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Bo Yang , Fangxiang Feng , Xiaojie Wang

Semantic segmentation has a broad range of applications in a variety of domains including land coverage analysis, autonomous driving, and medical image analysis. Convolutional neural networks (CNN) and Vision Transformers (ViTs) provide the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Hans Thisanke , Chamli Deshan , Kavindu Chamith , Sachith Seneviratne , Rajith Vidanaarachchi , Damayanthi Herath