English
Related papers

Related papers: Region and Object based Panoptic Image Synthesis t…

200 papers

In this paper, we address the task of semantic-guided image generation. One challenge common to most existing image-level generation methods is the difficulty in generating small objects and detailed local textures. To address this, in this…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Hao Tang , Ling Shao , Philip H. S. Torr , Nicu Sebe

This paper develops a unified framework for image-to-image translation based on conditional diffusion models and evaluates this framework on four challenging image-to-image translation tasks, namely colorization, inpainting, uncropping, and…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Chitwan Saharia , William Chan , Huiwen Chang , Chris A. Lee , Jonathan Ho , Tim Salimans , David J. Fleet , Mohammad Norouzi

We introduce a simple and versatile framework for image-to-image translation. We unearth the importance of normalization layers, and provide a carefully designed two-stream generative model with newly proposed feature transformations in a…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Liming Jiang , Changxu Zhang , Mingyang Huang , Chunxiao Liu , Jianping Shi , Chen Change Loy

Conditional image generation is effective for diverse tasks including training data synthesis for learning-based computer vision. However, despite the recent advances in generative adversarial networks (GANs), it is still a challenging task…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Yutaro Miyauchi , Yusuke Sugano , Yasuyuki Matsushita

In this paper, we offer a preliminary investigation into the task of in-image machine translation: transforming an image containing text in one language into an image containing the same text in another language. We propose an end-to-end…

Computation and Language · Computer Science 2020-10-22 Elman Mansimov , Mitchell Stern , Mia Chen , Orhan Firat , Jakob Uszkoreit , Puneet Jain

Image-to-image translation (I2I) aims to transfer images from a source domain to a target domain while preserving the content representations. I2I has drawn increasing attention and made tremendous progress in recent years because of its…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Yingxue Pang , Jianxin Lin , Tao Qin , Zhibo Chen

Recently image inpainting has witnessed rapid progress due to generative adversarial networks (GAN) that are able to synthesize realistic contents. However, most existing GAN-based methods for semantic inpainting apply an auto-encoder…

Computer Vision and Pattern Recognition · Computer Science 2017-12-22 Haofeng Li , Guanbin Li , Liang Lin , Yizhou Yu

Conditional Generative Adversarial Networks (GANs) for cross-domain image-to-image translation have made much progress recently. Depending on the task complexity, thousands to millions of labeled image pairs are needed to train a…

Computer Vision and Pattern Recognition · Computer Science 2018-10-12 Zili Yi , Hao Zhang , Ping Tan , Minglun Gong

Image-to-image translation is an important and challenging problem in computer vision and image processing. Diffusion models (DM) have shown great potentials for high-quality image synthesis, and have gained competitive performance on the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Bo Li , Kaitao Xue , Bin Liu , Yu-Kun Lai

With the advent of generative adversarial networks, synthesizing images from textual descriptions has recently become an active research area. It is a flexible and intuitive way for conditional image generation with significant progress in…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Stanislav Frolov , Tobias Hinz , Federico Raue , Jörn Hees , Andreas Dengel

The goal of this paper is to embed controllable factors, i.e., natural language descriptions, into image-to-image translation with generative adversarial networks, which allows text descriptions to determine the visual attributes of…

Computer Vision and Pattern Recognition · Computer Science 2020-02-14 Bowen Li , Xiaojuan Qi , Philip H. S. Torr , Thomas Lukasiewicz

The crux of text-to-image synthesis stems from the difficulty of preserving the cross-modality semantic consistency between the input text and the synthesized image. Typical methods, which seek to model the text-to-image mapping directly,…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Jiadong Liang , Wenjie Pei , Feng Lu

Unsupervised multi-domain image-to-image translation aims to synthesis images among multiple domains without labeled data, which is more general and complicated than one-to-one image mapping. However, existing methods mainly focus on…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Ye Lin , Keren Fu , Shenggui Ling , Cheng Peng

Generative models are widely employed to enhance the photorealism of visual synthetic data for training computer vision algorithms. However, they often introduce visual artifacts that degrade the accuracy of these algorithms and require…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Stefanos Pasios , Nikos Nikolaidis

We present the first approach for 3D point-cloud to image translation based on conditional Generative Adversarial Networks (cGAN). The model handles multi-modal information sources from different domains, i.e. raw point-sets and images. The…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Stefan Milz , Martin Simon , Kai Fischer , Maximillian Pöpperl

Visual domain gaps often impact object detection performance. Image-to-image translation can mitigate this effect, where contrastive approaches enable learning of the image-to-image mapping under unsupervised regimes. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Danai Triantafyllidou , Sarah Parisot , Ales Leonardis , Steven McDonagh

Unsupervised image-to-image translation is a recently proposed task of translating an image to a different style or domain given only unpaired image examples at training time. In this paper, we formulate a new task of unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Dina Bashkirova , Ben Usman , Kate Saenko

Generally, image-to-image translation (i2i) methods aim at learning mappings across domains with the assumption that the images used for translation share content (e.g., pose) but have their own domain-specific information (a.k.a. style).…

Image and Video Processing · Electrical Eng. & Systems 2023-05-12 Mohamed Abid , Arman Afrasiyabi , Ihsen Hedhli , Jean-François Lalonde , Christian Gagné

In recent years, text-guided image manipulation has gained increasing attention in the multimedia and computer vision community. The input to conditional image generation has evolved from image-only to multimodality. In this paper, we study…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Tianhao Zhang , Hung-Yu Tseng , Lu Jiang , Weilong Yang , Honglak Lee , Irfan Essa

We present an image-conditional image generation model. The model transfers an input domain to a target domain in semantic level, and generates the target image in pixel level. To generate realistic target images, we employ the…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Donggeun Yoo , Namil Kim , Sunggyun Park , Anthony S. Paek , In So Kweon