English
Related papers

Related papers: Combining Transformer Generators with Convolutiona…

200 papers

The recent explosive interest on transformers has suggested their potential to become powerful "universal" models for computer vision tasks, such as classification, detection, and segmentation. While those attempts mainly study the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Yifan Jiang , Shiyu Chang , Zhangyang Wang

Generative Adversarial Networks (GANs) have been very successful for synthesizing the images in a given dataset. The artificially generated images by GANs are very realistic. The GANs have shown potential usability in several computer…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Shiv Ram Dubey , Satish Kumar Singh

Transformer becomes prevalent in computer vision, especially for high-level vision tasks. However, adopting Transformer in the generative adversarial network (GAN) framework is still an open yet challenging problem. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Rui Xu , Xiangyu Xu , Kai Chen , Bolei Zhou , Chen Change Loy

Automated liver segmentation from radiology scans (CT, MRI) can improve surgery and therapy planning and follow-up assessment in addition to conventional use for diagnosis and prognosis. Although convolutional neural networks (CNNs) have…

Image and Video Processing · Electrical Eng. & Systems 2022-05-31 Ugur Demir , Zheyuan Zhang , Bin Wang , Matthew Antalek , Elif Keles , Debesh Jha , Amir Borhani , Daniela Ladner , Ulas Bagci

Image super-resolution aims to synthesize high-resolution image from a low-resolution image. It is an active area to overcome the resolution limitations in several applications like low-resolution object-recognition, medical image…

Image and Video Processing · Electrical Eng. & Systems 2023-12-05 Neeraj Baghel , Shiv Ram Dubey , Satish Kumar Singh

Despite the tantalizing success in a broad of vision tasks, transformers have not yet demonstrated on-par ability as ConvNets in high-resolution image generative modeling. In this paper, we seek to explore using pure transformers to build a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Bowen Zhang , Shuyang Gu , Bo Zhang , Jianmin Bao , Dong Chen , Fang Wen , Yong Wang , Baining Guo

Generative Adversarial Networks (GANs) have demonstrated immense potential in synthesizing diverse and high-fidelity images. However, critical questions remain unanswered regarding how quantum principles might best enhance their…

Supervised super-resolution deep convolutional neural networks (CNNs) have gained significant attention for their potential in reconstructing velocity and scalar fields in turbulent flows. Despite their popularity, CNNs currently lack the…

Vision transformers have become popular as a possible substitute to convolutional neural networks (CNNs) for a variety of computer vision applications. These transformers, with their ability to focus on global relationships in images, offer…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Asifullah Khan , Zunaira Rauf , Anabia Sohail , Abdul Rehman , Hifsa Asif , Aqsa Asif , Umair Farooq

We present a novel graph Transformer generative adversarial network (GTGAN) to learn effective graph node relations in an end-to-end fashion for challenging graph-constrained architectural layout generation tasks. The proposed…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Hao Tang , Ling Shao , Nicu Sebe , Luc Van Gool

One of the most significant challenges in statistical signal processing and machine learning is how to obtain a generative model that can produce samples of large-scale data distribution, such as images and speeches. Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Pegah Salehi , Abdolah Chalechale , Maryam Taghizadeh

We introduce the GANformer, a novel and efficient type of transformer, and explore it for the task of visual generative modeling. The network employs a bipartite structure that enables long-range interactions across the image, while…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Drew A. Hudson , C. Lawrence Zitnick

We propose Styleformer, which is a style-based generator for GAN architecture, but a convolution-free transformer-based generator. In our paper, we explain how a transformer can generate high-quality images, overcoming the disadvantage that…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Jeeseung Park , Younggeun Kim

Attention-based models, exemplified by the Transformer, can effectively model long range dependency, but suffer from the quadratic complexity of self-attention operation, making them difficult to be adopted for high-resolution image…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Long Zhao , Zizhao Zhang , Ting Chen , Dimitris N. Metaxas , Han Zhang

One of the main motivations for training high quality image generative models is their potential use as tools for image manipulation. Recently, generative adversarial networks (GANs) have been able to generate images of remarkable quality.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Aviv Gabbay , Yedid Hoshen

Transformer, which originates from machine translation, is particularly powerful at modeling long-range dependencies. Currently, the transformer is making revolutionary progress in various vision tasks, leading to significant performance…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Yuxin Mao , Jing Zhang , Zhexiong Wan , Yuchao Dai , Aixuan Li , Yunqiu Lv , Xinyu Tian , Deng-Ping Fan , Nick Barnes

Existing GAN inversion methods fail to provide latent codes for reliable reconstruction and flexible editing simultaneously. This paper presents a transformer-based image inversion and editing model for pretrained StyleGAN which is not only…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Xueqi Hu , Qiusheng Huang , Zhengyi Shi , Siyuan Li , Changxin Gao , Li Sun , Qingli Li

Most existing GANs architectures that generate images use transposed convolution or resize-convolution as their upsampling algorithm from lower to higher resolution feature maps in the generator. We argue that this kind of fixed operation…

Computer Vision and Pattern Recognition · Computer Science 2018-02-08 Nhat M. Nguyen , Nilanjan Ray

Recently, Vision Transformers (ViTs) have shown competitive performance on image recognition while requiring less vision-specific inductive biases. In this paper, we investigate if such performance can be extended to image generation. To…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Kwonjoon Lee , Huiwen Chang , Lu Jiang , Han Zhang , Zhuowen Tu , Ce Liu

While convolutional neural networks have shown a tremendous impact on various computer vision tasks, they generally demonstrate limitations in explicitly modeling long-range dependencies due to the intrinsic locality of the convolution…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Guanglei Yang , Hao Tang , Mingli Ding , Nicu Sebe , Elisa Ricci
‹ Prev 1 2 3 10 Next ›