English
Related papers

Related papers: StyleSwin: Transformer-based GAN for High-resoluti…

200 papers

We introduce the GANformer, a novel and efficient type of transformer, and explore it for the task of visual generative modeling. The network employs a bipartite structure that enables long-range interactions across the image, while…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Drew A. Hudson , C. Lawrence Zitnick

Wide-angle lenses are commonly used in perception tasks requiring a large field of view. Unfortunately, these lenses produce significant distortions, making conventional models that ignore the distortion effects unable to adapt to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Akshaya Athwale , Arman Afrasiyabi , Justin Lagüe , Ichrak Shili , Ola Ahmad , Jean-François Lalonde

In single image super-resolution (SISR), given a low-resolution (LR) image, one wishes to find a high-resolution (HR) version of it which is both accurate and photo-realistic. Recently, it has been shown that there exists a fundamental…

Image and Video Processing · Electrical Eng. & Systems 2019-10-10 Xin Deng , Ren Yang , Mai Xu , Pier Luigi Dragotti

Recently, transformer-based methods have demonstrated impressive results in various vision tasks, including image super-resolution (SR), by exploiting the self-attention (SA) for feature extraction. However, the computation of SA in most…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Xindong Zhang , Hui Zeng , Shi Guo , Lei Zhang

Vector-quantized image modeling has shown great potential in synthesizing high-quality images. However, generating high-resolution images remains a challenging task due to the quadratic computational overhead of the self-attention process.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Shiyue Cao , Yueqin Yin , Lianghua Huang , Yu Liu , Xin Zhao , Deli Zhao , Kaiqi Huang

Window-based transformers have demonstrated outstanding performance in super-resolution tasks due to their adaptive modeling capabilities through local self-attention (SA). However, they exhibit higher computational complexity and inference…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Zhenyu Hu , Wanjie Sun

To address the high resolution of image pixels, the Swin Transformer introduces window attention. This mechanism divides an image into non-overlapping windows and restricts attention computation to within each window, significantly…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Zhendong Zhang

Transformer's recent integration into style transfer leverages its proficiency in establishing long-range dependencies, albeit at the expense of attenuated local modeling. This paper introduces Strips Window Attention Transformer (S2WAT), a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Chiyu Zhang , Xiaogang Xu , Lei Wang , Zaiyan Dai , Jun Yang

Single Image Super-Resolution (SISR) reconstructs high-resolution images from low-resolution inputs, enhancing image details. While Vision Transformer (ViT)-based models improve SISR by capturing long-range dependencies, they suffer from…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Junyoung Kim , Youngrok Kim , Siyeol Jung , Donghyun Min

Neural networks have proven their capabilities by outperforming many other approaches on regression or classification tasks on various kinds of data. Other astonishing results have been achieved using neural nets as data generators,…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Andrej Junginger , Markus Hanselmann , Thilo Strauss , Sebastian Boblest , Jens Buchner , Holger Ulmer

Potential radioactive hazards in full-dose positron emission tomography (PET) imaging remain a concern, whereas the quality of low-dose images is never desirable for clinical use. So it is of great interest to translate low-dose PET images…

Image and Video Processing · Electrical Eng. & Systems 2023-06-06 Yang Zhou , Zhiwen Yang , Hui Zhang , Eric I-Chao Chang , Yubo Fan , Yan Xu

In recent years, considerable advancements have been made in the area of Generative Adversarial Networks (GANs), particularly with the advent of style-based architectures that address many key shortcomings - both in terms of modeling…

Computer Vision and Pattern Recognition · Computer Science 2022-08-04 Nikos Kostagiolas , Mihalis A. Nicolaou , Yannis Panagakis

A promise of Generative Adversarial Networks (GANs) is to provide cheap photorealistic data for training and validating AI models in autonomous driving. Despite their huge success, their performance on complex images featuring multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 George Eskandar , Youssef Farag , Tarun Yenamandra , Daniel Cremers , Karim Guirguis , Bin Yang

Fusing a sequence of perfectly aligned images captured at various exposures, has shown great potential to approach High Dynamic Range (HDR) imaging by sensors with limited dynamic range. However, in the presence of large motion of scene…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Rui Zhou , Yan Niu

While some studies have proven that Swin Transformer (Swin) with window self-attention (WSA) is suitable for single image super-resolution (SR), the plain WSA ignores the broad regions when reconstructing high-resolution images due to a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Haram Choi , Jeongmin Lee , Jihoon Yang

Real-world image manipulation has achieved fantastic progress in recent years as a result of the exploration and utilization of GAN latent spaces. GAN inversion is the first step in this pipeline, which aims to map the real image to the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Tan M. Dinh , Anh Tuan Tran , Rang Nguyen , Binh-Son Hua

Unconditional video generation is a challenging task that involves synthesizing high-quality videos that are both coherent and of extended duration. To address this challenge, researchers have used pretrained StyleGAN image generators for…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Yuhan Wang , Liming Jiang , Chen Change Loy

Unpaired image-to-image translation using Generative Adversarial Networks (GAN) is successful in converting images among multiple domains. Moreover, recent studies have shown a way to diversify the outputs of the generator. However, since…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Sho Inoue , Tad Gonsalves

Designed to learn long-range interactions on sequential data, transformers continue to show state-of-the-art results on a wide variety of tasks. In contrast to CNNs, they contain no inductive bias that prioritizes local interactions. This…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Patrick Esser , Robin Rombach , Björn Ommer

Generative Adversarial Networks (GANs) have been very successful for synthesizing the images in a given dataset. The artificially generated images by GANs are very realistic. The GANs have shown potential usability in several computer…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Shiv Ram Dubey , Satish Kumar Singh