English
Related papers

Related papers: Unsupervised Structure-Consistent Image-to-Image T…

200 papers

Unpaired image-to-image translation (UNIT) aims to map images between two visual domains without paired training data. However, given a UNIT model trained on certain domains, it is difficult for current methods to incorporate new domains…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Siyu Huang , Jie An , Donglai Wei , Zudi Lin , Jiebo Luo , Hanspeter Pfister

Image-to-image translation is a fundamental task in computer vision. It transforms images from one domain to images in another domain so that they have particular domain-specific characteristics. Most prior works train a generative model to…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Sihan Xu , Zelong Jiang , Ruisi Liu , Kaikai Yang , Zhijie Huang

We present a generic image-to-image translation framework, pixel2style2pixel (pSp). Our pSp framework is based on a novel encoder network that directly generates a series of style vectors which are fed into a pretrained StyleGAN generator,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Elad Richardson , Yuval Alaluf , Or Patashnik , Yotam Nitzan , Yaniv Azar , Stav Shapiro , Daniel Cohen-Or

Taking full advantage of the excellent performance of StyleGAN, style transfer-based face swapping methods have been extensively investigated recently. However, these studies require separate face segmentation and blending modules for…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Chenhao Lin , Pengbin Hu , Chao Shen , Qian Li

In unsupervised image-to-image translation, the goal is to learn the mapping between an input image and an output image using a set of unpaired training images. In this paper, we propose an extension of the unsupervised image-to-image…

Computer Vision and Pattern Recognition · Computer Science 2017-11-28 Pramuditha Perera , Mahdi Abavisani , Vishal M. Patel

Image to image translation aims to learn a mapping that transforms an image from one visual domain to another. Recent works assume that images descriptors can be disentangled into a domain-invariant content representation and a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Raul Gomez , Yahui Liu , Marco De Nadai , Dimosthenis Karatzas , Bruno Lepri , Nicu Sebe

Cross-domain image-to-image translation should satisfy two requirements: (1) preserve the information that is common to both domains, and (2) generate convincing images covering variations that appear in the target domain. This is…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Adam W. Harley , Shih-En Wei , Jason Saragih , Katerina Fragkiadaki

Many applications, such as autonomous driving, heavily rely on multi-modal data where spatial alignment between the modalities is required. Most multi-modal registration methods struggle computing the spatial correspondence between the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-19 Moab Arar , Yiftach Ginger , Dov Danon , Ilya Leizerson , Amit Bermano , Daniel Cohen-Or

Large-scale text-to-image models have demonstrated amazing ability to synthesize diverse and high-fidelity images. However, these models are often violated by several limitations. Firstly, they require the user to provide precise and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Yupei Lin , Sen Zhang , Xiaojun Yang , Xiao Wang , Yukai Shi

Image inpainting has made significant advances in recent years. However, it is still challenging to recover corrupted images with both vivid textures and reasonable structures. Some specific methods only tackle regular textures while losing…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Qiaole Dong , Chenjie Cao , Yanwei Fu

This work introduces ArtAdapter, a transformative text-to-image (T2I) style transfer framework that transcends traditional limitations of color, brushstrokes, and object shape, capturing high-level style elements such as composition and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Dar-Yen Chen , Hamish Tennent , Ching-Wen Hsu

We present a novel framework for exemplar based image translation. Recent advanced methods for this task mainly focus on establishing cross-domain semantic correspondence, which sequentially dominates image generation in the manner of local…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Chang Jiang , Fei Gao , Biao Ma , Yuhao Lin , Nannan Wang , Gang Xu

This work introduces a Transformer-based image compression system. It has the flexibility to switch between the standard image reconstruction and the denoising reconstruction from a single compressed bitstream. Instead of training separate…

Image and Video Processing · Electrical Eng. & Systems 2024-02-21 Yi-Hsin Chen , Kuan-Wei Ho , Shiau-Rung Tsai , Guan-Hsun Lin , Alessandro Gnutti , Wen-Hsiao Peng , Riccardo Leonardi

Deep image translation methods have recently shown excellent results, outputting high-quality images covering multiple modes of the data distribution. There has also been increased interest in disentangling the internal representations…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Abel Gonzalez-Garcia , Joost van de Weijer , Yoshua Bengio

This paper introduces a new encoder-decoder architecture that is trained to reconstruct images by disentangling the salient information of the image and the values of attributes directly in the latent space. As a result, after training, our…

Computer Vision and Pattern Recognition · Computer Science 2018-01-30 Guillaume Lample , Neil Zeghidour , Nicolas Usunier , Antoine Bordes , Ludovic Denoyer , Marc'Aurelio Ranzato

Recent advances of image-to-image translation focus on learning the one-to-many mapping from two aspects: multi-modal translation and multi-domain translation. However, the existing methods only consider one of the two perspectives, which…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Xiaoming Yu , Yuanqi Chen , Thomas Li , Shan Liu , Ge Li

We propose an auto-encoder architecture for multi-texture synthesis. The approach relies on both a compact encoder accounting for second order neural statistics and a generator incorporating adaptive periodic content. Images are embedded in…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Pierrick Chatillon , Yann Gousseau , Sidonie Lefebvre

We introduce a simple and versatile framework for image-to-image translation. We unearth the importance of normalization layers, and provide a carefully designed two-stream generative model with newly proposed feature transformations in a…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Liming Jiang , Changxu Zhang , Mingyang Huang , Chunxiao Liu , Jianping Shi , Chen Change Loy

We propose a novel approach for multi-modal Image-to-image (I2I) translation. To tackle the one-to-many relationship between input and output domains, previous works use complex training objectives to learn a latent embedding, jointly with…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Moustafa Meshry , Yixuan Ren , Larry S Davis , Abhinav Shrivastava

Image-to-image translation aims to preserve source contents while translating to discriminative target styles between two visual domains. Most works apply adversarial learning in the ambient image space, which could be computationally…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Yang Zhao , Changyou Chen