English
Related papers

Related papers: StyleSwin: Transformer-based GAN for High-resoluti…

200 papers

In the research area of image super-resolution, Swin-transformer-based models are favored for their global spatial modeling and shifting window attention mechanism. However, existing methods often limit self-attention to non overlapping…

Image and Video Processing · Electrical Eng. & Systems 2024-12-11 Song-Jiang Lai , Tsun-Hin Cheung , Ka-Chun Fung , Kai-wen Xue , Kin-Man Lam

Numerous attempts have been made to the task of person-agnostic face swapping given its wide applications. While existing methods mostly rely on tedious network and loss designs, they still struggle in the information balancing between the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Zhiliang Xu , Hang Zhou , Zhibin Hong , Ziwei Liu , Jiaming Liu , Zhizhi Guo , Junyu Han , Jingtuo Liu , Errui Ding , Jingdong Wang

Existing GAN inversion methods fail to provide latent codes for reliable reconstruction and flexible editing simultaneously. This paper presents a transformer-based image inversion and editing model for pretrained StyleGAN which is not only…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Xueqi Hu , Qiusheng Huang , Zhengyi Shi , Siyuan Li , Changxin Gao , Li Sun , Qingli Li

3D Swin Transformer (3D-ST) known for its hierarchical attention and window-based processing, excels in capturing intricate spatial relationships within images. Spatial-spectral Transformer (SST), meanwhile, specializes in modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Muhammad Ahmad , Manuel Mazzara , Salvatore Distifano

Single Image Super-resolution (SISR) produces high-resolution images with fine spatial resolutions from aremotely sensed image with low spatial resolution. Recently, deep learning and generative adversarial networks(GANs) have made…

Image and Video Processing · Electrical Eng. & Systems 2022-02-01 Fayaz Ali Dharejo , Farah Deeba , Yuanchun Zhou , Bhagwan Das , Munsif Ali Jatoi , Muhammad Zawish , Yi Du , Xuezhi Wang

We present a new perspective of achieving image synthesis by viewing this task as a visual token generation problem. Different from existing paradigms that directly synthesize a full image from a single input (e.g., a latent code), the new…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Yanhong Zeng , Huan Yang , Hongyang Chao , Jianbo Wang , Jianlong Fu

Following the success in language domain, the self-attention mechanism (transformer) is adopted in the vision domain and achieving great success recently. Additionally, as another stream, multi-layer perceptron (MLP) is also explored in the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Mocho Go , Hideyuki Tachibana

The use of coarse-grained layouts for controllable synthesis of complex scene images via deep generative models has recently gained popularity. However, results of current approaches still fall short of their promise of high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Manuel Jahn , Robin Rombach , Björn Ommer

Image restoration has witnessed significant advancements with the development of deep learning models. Transformer-based models, particularly those using window-based self-attention, have become a dominant force. However, their performance…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Gang Wu , Junjun Jiang , Kui Jiang , Xianming Liu , Liqiang Nie

In recent years, diffusion models have emerged as a superior alternative to generative adversarial networks (GANs) for high-fidelity image generation, with wide applications in text-to-image generation, image-to-image translation, and…

Image and Video Processing · Electrical Eng. & Systems 2026-05-08 Lorenzo Aloisi , Luigi Sigillo , Aurelio Uncini , Danilo Comminiello

Generative Adversarial Networks (GANs) with style-based generators (e.g. StyleGAN) successfully enable semantic control over image synthesis, and recent studies have also revealed that interpretable image translations could be obtained by…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Yunfan Liu , Qi Li , Zhenan Sun , Tieniu Tan

Generative Adversarial Networks (GANs) have established themselves as a prevalent approach to image synthesis. Of these, StyleGAN offers a fascinating case study, owing to its remarkable visual quality and an ability to support a large…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Amit H. Bermano , Rinon Gal , Yuval Alaluf , Ron Mokady , Yotam Nitzan , Omer Tov , Or Patashnik , Daniel Cohen-Or

Text-to-image synthesis has recently seen significant progress thanks to large pretrained language models, large-scale training data, and the introduction of scalable model families such as diffusion and autoregressive models. However, the…

Machine Learning · Computer Science 2023-01-24 Axel Sauer , Tero Karras , Samuli Laine , Andreas Geiger , Timo Aila

Texture synthesis is a fundamental task in computer vision, whose goal is to generate visually realistic and structurally coherent textures for a wide range of applications, from graphics to scientific simulations. While traditional methods…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Elahe Salari , Zohreh Azimifar

Recently, Transformers have shown promising performance in various vision tasks. However, the high costs of global self-attention remain challenging for Transformers, especially for high-resolution vision tasks. Local self-attention runs…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Zhemin Zhang , Xun Gong

We introduce Iwin Transformer, a novel position-embedding-free hierarchical vision transformer, which can be fine-tuned directly from low to high resolution, through the collaboration of innovative interleaved window attention and depthwise…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Simin Huo , Ning Li

Transformer models have shown great potential in computer vision, following their success in language tasks. Swin Transformer is one of them that outperforms convolution-based architectures in terms of accuracy, while improving efficiency…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Jinkyu Koo , John Yang , Le An , Gwenaelle Cunha Sergio , Su Inn Park

Learning to generate natural scenes has always been a daunting task in computer vision. This is even more laborious when generating images with very different views. When the views are very different, the view fields have little overlap or…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Hao Ding , Songsong Wu , Hao Tang , Fei Wu , Guangwei Gao , Xiao-Yuan Jing

With the popularity of Transformer architectures in computer vision, the research focus has shifted towards developing computationally efficient designs. Window-based local attention is one of the major techniques being adopted in recent…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Ammarah Farooq , Muhammad Awais , Sara Ahmed , Josef Kittler

The Swin transformer has recently attracted attention in medical image analysis due to its computational efficiency and long-range modeling capability. Owing to these properties, the Swin Transformer is suitable for establishing more…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Mingrui Ma , Tao Wang , Lei Song , Weijie Wang , Guixia Liu