English
Related papers

Related papers: ViTGAN: Training GANs with Vision Transformers

200 papers

We describe a new training methodology for generative adversarial networks. The key idea is to grow both the generator and discriminator progressively: starting from a low resolution, we add new layers that model increasingly fine details…

Neural and Evolutionary Computing · Computer Science 2018-02-28 Tero Karras , Timo Aila , Samuli Laine , Jaakko Lehtinen

Vision Transformers (ViT) are competing to replace Convolutional Neural Networks (CNN) for various computer vision tasks in medical imaging such as classification and segmentation. While the vulnerability of CNNs to adversarial attacks is a…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Faris Almalik , Mohammad Yaqub , Karthik Nandakumar

Generative Adversarial Networks (GANs) are the most popular image generation models that have achieved remarkable progress on various computer vision tasks. However, training instability is still one of the open problems for all GAN-based…

Image and Video Processing · Electrical Eng. & Systems 2022-07-20 Ziqiang Li , Pengfei Xia , Rentuo Tao , Hongjing Niu , Bin Li

Virtual Adversarial Training (VAT) has shown impressive results among recently developed regularization methods called consistency regularization. VAT utilizes adversarial samples, generated by injecting perturbation in the input space, for…

Machine Learning · Computer Science 2022-12-27 Genki Osada , Budrul Ahsan , Revoti Prasad Bora , Takashi Nishide

Convolutional neural networks (CNNs) have so far been the de-facto model for visual data. Recent work has shown that (Vision) Transformer models (ViT) can achieve comparable or even superior performance on image classification tasks. This…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Maithra Raghu , Thomas Unterthiner , Simon Kornblith , Chiyuan Zhang , Alexey Dosovitskiy

This paper proposes a working recipe of using Vision Transformer (ViT) in class incremental learning. Although this recipe only combines existing techniques, developing the combination is not trivial. Firstly, naive application of ViT to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Pei Yu , Yinpeng Chen , Ying Jin , Zicheng Liu

Vision Transformers (ViTs) are becoming more popular and dominating technique for various vision tasks, compare to Convolutional Neural Networks (CNNs). As a demanding technique in computer vision, ViTs have been successfully solved various…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Khawar Islam

Vision Transformer (ViT), a radically different architecture than convolutional neural networks offers multiple advantages including design simplicity, robustness and state-of-the-art performance on many vision tasks. However, in contrast…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Hanan Gani , Muzammal Naseer , Mohammad Yaqub

One of the challenges in the study of generative adversarial networks is the instability of its training. In this paper, we propose a novel weight normalization technique called spectral normalization to stabilize the training of the…

Machine Learning · Computer Science 2018-02-19 Takeru Miyato , Toshiki Kataoka , Masanori Koyama , Yuichi Yoshida

In recent years, vision transformers (ViTs) have emerged as powerful and promising techniques for computer vision tasks such as image classification, object detection, and segmentation. Unlike convolutional neural networks (CNNs), which…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Shaibal Saha , Lanyu Xu

Generative Adversarial Networks (GANs) coupled with self-supervised tasks have shown promising results in unconditional and semi-supervised image generation. We propose a self-supervised approach (LT-GAN) to improve the generation quality…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Parth Patel , Nupur Kumari , Mayank Singh , Balaji Krishnamurthy

Recent advances in generative adversarial networks (GANs) have achieved great success in automated image composition that generates new images by embedding interested foreground objects into background images automatically. On the other…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Changgong Zhang , Fangneng Zhan , Shijian Lu , Feiying Ma , Xuansong Xie

While Generative Adversarial Networks (GANs) are fundamental to many generative modelling applications, they suffer from numerous issues. In this work, we propose a principled framework to simultaneously mitigate two fundamental issues in…

Machine Learning · Computer Science 2020-11-24 Kwot Sin Lee , Ngoc-Trung Tran , Ngai-Man Cheung

Recently, generative adversarial networks (GANs) have shown promising performance in generating realistic images. However, they often struggle in learning complex underlying modalities in a given dataset, resulting in poor-quality generated…

Computer Vision and Pattern Recognition · Computer Science 2018-05-09 David Keetae Park , Seungjoo Yoo , Hyojin Bahng , Jaegul Choo , Noseong Park

This work targets to merge various Vision Transformers (ViTs) trained on different tasks (i.e., datasets with different object categories) or domains (i.e., datasets with the same categories but different environments) into one unified…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Peng Ye , Chenyu Huang , Mingzhu Shen , Tao Chen , Yongqi Huang , Yuning Zhang , Wanli Ouyang

Generative Adversarial Networks (GANs) have become a powerful approach for generative image modeling. However, GANs are notorious for their training instability, especially on large-scale, complex datasets. While the recent work of BigGAN…

Computer Vision and Pattern Recognition · Computer Science 2020-09-30 Ting-Yun Chang , Chi-Jen Lu

Since their inception, Vision Transformers (ViTs) have emerged as a compelling alternative to Convolutional Neural Networks (CNNs) across a wide spectrum of tasks. ViTs exhibit notable characteristics, including global attention, resilience…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Hanan Gani , Nada Saadi , Noor Hussein , Karthik Nandakumar

The recent explosive interest on transformers has suggested their potential to become powerful "universal" models for computer vision tasks, such as classification, detection, and segmentation. While those attempts mainly study the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Yifan Jiang , Shiyu Chang , Zhangyang Wang

The recent advances in image transformers have shown impressive results and have largely closed the gap between traditional CNN architectures. The standard procedure is to train on large datasets like ImageNet-21k and then finetune on…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Ethan Huynh

We address the problem of finding realistic geometric corrections to a foreground object such that it appears natural when composited into a background image. To achieve this, we propose a novel Generative Adversarial Network (GAN)…

Computer Vision and Pattern Recognition · Computer Science 2018-03-06 Chen-Hsuan Lin , Ersin Yumer , Oliver Wang , Eli Shechtman , Simon Lucey