English
Related papers

Related papers: Layout-to-Image Translation with Double Pooling Ge…

200 papers

While attention-based transformer networks achieve unparalleled success in nearly all language tasks, the large number of tokens (pixels) found in images coupled with the quadratic activation memory usage makes them prohibitive for problems…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 George Cazenavette , Manuel Ladron De Guevara

Generative adversarial networks (GANs) have achieved great success in image translation and manipulation. However, high-fidelity image generation with faithful style control remains a grand challenge in computer vision. This paper presents…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Fangneng Zhan , Yingchen Yu , Rongliang Wu , Jiahui Zhang , Kaiwen Cui , Aoran Xiao , Shijian Lu , Chunyan Miao

Semantic segmentation relies on many dense pixel-wise annotations to achieve the best performance, but owing to the difficulty of obtaining accurate annotations for real world data, practitioners train on large-scale synthetic datasets.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Cristina Mata , Michael S. Ryoo , Henrik Turbell

Recent studies have shown remarkable success in image-to-image translation for two domains. However, existing approaches have limited scalability and robustness in handling more than two domains, since different models should be built…

Computer Vision and Pattern Recognition · Computer Science 2018-09-24 Yunjey Choi , Minje Choi , Munyoung Kim , Jung-Woo Ha , Sunghun Kim , Jaegul Choo

Existing models for unsupervised image translation with Generative Adversarial Networks (GANs) can learn the mapping from the source domain to the target domain using a cycle-consistency loss. However, these methods always adopt a symmetric…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Hao Tang , Nicu Sebe

For semantic-guided cross-view image translation, it is crucial to learn where to sample pixels from the source view image and where to reallocate them guided by the target view semantic map, especially when there is little overlap or…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Bin Ren , Hao Tang , Yiming Wang , Xia Li , Wei Wang , Nicu Sebe

It's useful to automatically transform an image from its original form to some synthetic form (style, partial contents, etc.), while keeping the original structure or semantics. We define this requirement as the "image-to-image translation"…

Computer Vision and Pattern Recognition · Computer Science 2017-01-11 Hao Dong , Paarth Neekhara , Chao Wu , Yike Guo

Limited by the computational efficiency and accuracy, generating complex 3D scenes remains a challenging problem for existing generation networks. In this work, we propose DepthGAN, a novel method of generating depth maps with only semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Yidi Li , Yiqun Wang , Zhengda Lu , Jun Xiao

In this paper, we have developed a general-purpose architecture, Vit-Gan, capable of performing most of the image-to-image translation tasks from semantic image segmentation to single image depth perception. This paper is a follow-up paper,…

Image and Video Processing · Electrical Eng. & Systems 2021-10-19 Yiğit Gündüç

We propose a novel ECGAN for the challenging semantic image synthesis task. Although considerable improvements have been achieved by the community in the recent period, the quality of synthesized images is far from satisfactory due to three…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Hao Tang , Guolei Sun , Nicu Sebe , Luc Van Gool

Image-to-image translation aims to learn the mapping between two visual domains. There are two main challenges for this task: 1) lack of aligned training pairs and 2) multiple possible outputs from a single input image. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2019-12-19 Hsin-Ying Lee , Hung-Yu Tseng , Qi Mao , Jia-Bin Huang , Yu-Ding Lu , Maneesh Singh , Ming-Hsuan Yang

Despite the ever-increasing interest in applying deep learning (DL) models to medical imaging, the typical scarcity and imbalance of medical datasets can severely impact the performance of DL models. The generation of synthetic data that…

Image and Video Processing · Electrical Eng. & Systems 2023-04-03 Pouria Rouzrokh , Bardia Khosravi , Shahriar Faghani , Mana Moassefi , Sanaz Vahdati , Bradley J. Erickson

Recent advancements in large-scale pre-trained text-to-image models have led to remarkable progress in semantic image synthesis. Nevertheless, synthesizing high-quality images with consistent semantics and layout remains a challenge. In…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Zhengyao Lv , Yuxiang Wei , Wangmeng Zuo , Kwan-Yee K. Wong

Image-to-image translation aims to learn the mapping between two visual domains. There are two main challenges for many applications: 1) the lack of aligned training pairs and 2) multiple possible outputs from a single input image. In this…

Computer Vision and Pattern Recognition · Computer Science 2018-08-03 Hsin-Ying Lee , Hung-Yu Tseng , Jia-Bin Huang , Maneesh Kumar Singh , Ming-Hsuan Yang

Deep image translation methods have recently shown excellent results, outputting high-quality images covering multiple modes of the data distribution. There has also been increased interest in disentangling the internal representations…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Abel Gonzalez-Garcia , Joost van de Weijer , Yoshua Bengio

Deep networks are now ubiquitous in large-scale multi-center imaging studies. However, the direct aggregation of images across sites is contraindicated for downstream statistical and deep learning-based image analysis due to inconsistent…

Image and Video Processing · Electrical Eng. & Systems 2021-04-16 Mengwei Ren , Neel Dey , James Fishbaugh , Guido Gerig

Recent Image-to-Image Translation algorithms have achieved significant progress in neural style transfer and image attribute manipulation tasks. However, existing approaches require exhaustively labelling training data, which is labor…

Computer Vision and Pattern Recognition · Computer Science 2020-06-01 Jichao Zhang , Yezhi Shu , Songhua Xu , Gongze Cao , Fan Zhong , Meng Liu , Xueying Qin

Deep learning techniques, especially Generative Adversarial Networks (GANs) have significantly improved image inpainting and image-to-image translation tasks over the past few years. To the best of our knowledge, the problem of combining…

Image and Video Processing · Electrical Eng. & Systems 2022-06-23 Aref Abedjooy , Mehran Ebrahimi

Semantic layouts based Image synthesizing, which has benefited from the success of Generative Adversarial Network (GAN), has drawn much attention in these days. How to enhance the synthesis image equality while keeping the stochasticity of…

Computer Vision and Pattern Recognition · Computer Science 2018-01-11 Ziqiang Zheng , Chao Wang , Zhibin Yu , Haiyong Zheng , Bing Zheng

Domain adaptation for semantic segmentation enables to alleviate the need for large-scale pixel-wise annotations. Recently, self-supervised learning (SSL) with a combination of image-to-image translation shows great effectiveness in…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Yiting Cheng , Fangyun Wei , Jianmin Bao , Dong Chen , Fang Wen , Wenqiang Zhang