English
Related papers

Related papers: Image-to-image Translation as a Unique Source of K…

200 papers

Unsupervised image-to-image translation is an important and challenging problem in computer vision. Given an image in the source domain, the goal is to learn the conditional distribution of corresponding images in the target domain, without…

Computer Vision and Pattern Recognition · Computer Science 2018-08-16 Xun Huang , Ming-Yu Liu , Serge Belongie , Jan Kautz

It is well known that humans can learn and recognize objects effectively from several limited image samples. However, learning from just a few images is still a tremendous challenge for existing main-stream deep neural networks. Inspired by…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Ziqiang Zheng , Zhibin Yu , Haiyong Zheng , Yang Yang , Heng Tao Shen

Sketch-to-image (S2I) translation plays an important role in image synthesis and manipulation tasks, such as photo editing and colorization. Some specific S2I translation including sketch-to-photo and sketch-to-painting can be used as…

Computer Vision and Pattern Recognition · Computer Science 2020-06-19 Jialu Huang , Jing Liao , Zhifeng Tan , Sam Kwong

The Diffusion Model (DM) has emerged as the SOTA approach for image synthesis. However, the existing DM cannot perform well on some image-to-image translation (I2I) tasks. Different from image synthesis, some I2I tasks, such as…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Bin Xia , Yulun Zhang , Shiyin Wang , Yitong Wang , Xinglong Wu , Yapeng Tian , Wenming Yang , Radu Timotfe , Luc Van Gool

Image-to-image translation (I2I) methods allow the generation of artificial images that share the content of the original image but have a different style. With the advances in Generative Adversarial Networks (GANs)-based methods, I2I…

Image and Video Processing · Electrical Eng. & Systems 2023-04-07 Igor Zingman , Sergio Frayle , Ivan Tankoyeu , Segrey Sukhanov , Fabian Heinemann

We present a mutual information-based framework for unsupervised image-to-image translation. Our MCMI approach treats single-cycle image translation models as modules that can be used recurrently in a multi-cycle translation setting where…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Xiang Xu , Megha Nawhal , Greg Mori , Manolis Savva

Large-scale diffusion models have made significant advances in image generation, particularly through cross-attention mechanisms. While cross-attention has been well-studied in text-to-image tasks, their interpretability in image-to-image…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Junseo Park , Hyeryung Jang

A self-driving car must be able to reliably handle adverse weather conditions (e.g., snowy) to operate safely. In this paper, we investigate the idea of turning sensor inputs (i.e., images) captured in an adverse condition into a benign one…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Youya Xia , Josephine Monica , Wei-Lun Chao , Bharath Hariharan , Kilian Q Weinberger , Mark Campbell

It's useful to automatically transform an image from its original form to some synthetic form (style, partial contents, etc.), while keeping the original structure or semantics. We define this requirement as the "image-to-image translation"…

Computer Vision and Pattern Recognition · Computer Science 2017-01-11 Hao Dong , Paarth Neekhara , Chao Wu , Yike Guo

Multi-domain image-to-image translation has gained increasing attention recently. Previous methods take an image and some target attributes as inputs and generate an output image with the desired attributes. However, such methods have two…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Po-Wei Wu , Yu-Jing Lin , Che-Han Chang , Edward Y. Chang , Shih-Wei Liao

We investigate conditional adversarial networks as a general-purpose solution to image-to-image translation problems. These networks not only learn the mapping from input image to output image, but also learn a loss function to train this…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Phillip Isola , Jun-Yan Zhu , Tinghui Zhou , Alexei A. Efros

Every recent image-to-image translation model inherently requires either image-level (i.e. input-output pairs) or set-level (i.e. domain labels) supervision. However, even set-level supervision can be a severe bottleneck for data collection…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Kyungjune Baek , Yunjey Choi , Youngjung Uh , Jaejun Yoo , Hyunjung Shim

Unsupervised image-to-image translation aims at learning a mapping between two visual domains. However, learning a translation across large geometry variations always ends up with failure. In this work, we present a novel…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Wayne Wu , Kaidi Cao , Cheng Li , Chen Qian , Chen Change Loy

Translating images from a source domain to a target domain for learning target models is one of the most common strategies in domain adaptive semantic segmentation (DASS). However, existing methods still struggle to preserve…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Duo Peng , Ping Hu , Qiuhong Ke , Jun Liu

Image-to-image translation is significant to many computer vision and machine learning tasks such as image synthesis and video synthesis. It has primary applications in the graphics editing and animation industries. With the development of…

Computer Vision and Pattern Recognition · Computer Science 2019-12-17 Heng Wang , Donghao Zhang , Yang Song , Heng Huang , Mei Chen , Weidong Cai

Domain adaptation is one of the prominent strategies for handling both domain shift, that is widely encountered in large-scale land use/land cover map calculation, and the scarcity of pixel-level ground truth that is crucial for supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Sarmad F. Ismael , Koray Kayabol , Erchan Aptoula

The applicability of computer vision to real paintings and artworks has been rarely investigated, even though a vast heritage would greatly benefit from techniques which can understand and process data from the artistic domain. This is…

Computer Vision and Pattern Recognition · Computer Science 2019-05-20 Matteo Tomei , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Recent studies have shown remarkable success in unsupervised image-to-image translation. However, if there has no access to enough images in target classes, learning a mapping from source classes to the target classes always suffers from…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Yuanqi Chen , Xiaoming Yu , Shan Liu , Ge Li

Current image-to-image translation methods formulate the task with conditional generation models, leading to learning only the recolorization or regional changes as being constrained by the rich structural information provided by the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Yu-Jie Chen , Shin-I Cheng , Wei-Chen Chiu , Hung-Yu Tseng , Hsin-Ying Lee

With a strong understanding of the target domain from natural language, we produce promising results in translating across large domain gaps and bringing skeletons back to life. In this work, we use text-guided latent diffusion models for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Alexander Martin , Haitian Zheng , Jie An , Jiebo Luo