English
Related papers

Related papers: Vector Quantized Image-to-Image Translation

200 papers

Deep image translation methods have recently shown excellent results, outputting high-quality images covering multiple modes of the data distribution. There has also been increased interest in disentangling the internal representations…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Abel Gonzalez-Garcia , Joost van de Weijer , Yoshua Bengio

We introduce a simple and versatile framework for image-to-image translation. We unearth the importance of normalization layers, and provide a carefully designed two-stream generative model with newly proposed feature transformations in a…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Liming Jiang , Changxu Zhang , Mingyang Huang , Chunxiao Liu , Jianping Shi , Chen Change Loy

Image-to-image translation is significant to many computer vision and machine learning tasks such as image synthesis and video synthesis. It has primary applications in the graphics editing and animation industries. With the development of…

Computer Vision and Pattern Recognition · Computer Science 2019-12-17 Heng Wang , Donghao Zhang , Yang Song , Heng Huang , Mei Chen , Weidong Cai

The mechanism of existing style transfer algorithms is by minimizing a hybrid loss function to push the generated image toward high similarities in both content and style. However, this type of approach cannot guarantee visual fidelity,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Siyu Huang , Jie An , Donglai Wei , Jiebo Luo , Hanspeter Pfister

Unsupervised image-to-image translation methods aim to map images from one domain into plausible examples from another domain while preserving structures shared across two domains. In the many-to-many setting, an additional guidance example…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Ben Usman , Dina Bashkirova , Kate Saenko

Generative models have made significant progress in the tasks of modeling complex data distributions such as natural images. The introduction of Generative Adversarial Networks (GANs) and auto-encoders lead to the possibility of training on…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Tobias Hinz , Stefan Wermter

Given the ever-increasing computational costs of modern machine learning models, we need to find new ways to reuse such expert models and thus tap into the resources that have been invested in their creation. Recent work suggests that the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Robin Rombach , Patrick Esser , Björn Ommer

Image vectorization converts raster images into vector graphics composed of regions separated by curves. Typical vectorization methods first define the regions by grouping similar colored regions via color quantization, then approximate…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Roy Y. He , Sung Ha Kang , Jean-Michel Morel

Unsupervised multi-domain image-to-image translation aims to synthesis images among multiple domains without labeled data, which is more general and complicated than one-to-one image mapping. However, existing methods mainly focus on…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Ye Lin , Keren Fu , Shenggui Ling , Cheng Peng

Diffusion models have shown impressive results in text-to-image synthesis. Using massive datasets of captioned images, diffusion models learn to generate raster images of highly diverse objects and scenes. However, designers frequently use…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Ajay Jain , Amber Xie , Pieter Abbeel

Image vectorization is a process to convert a raster image into a scalable vector graphic format. Objective is to effectively remove the pixelization effect while representing boundaries of image by scaleable parameterized curves. We…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Ho Law , Sung Ha Kang

Vector quantization (VQ) is a key technique in high-resolution and high-fidelity image synthesis, which aims to learn a codebook to encode an image with a sequence of discrete codes and then generate an image in an auto-regression manner.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Guotao Liang , Baoquan Zhang , Yaowei Wang , Xutao Li , Yunming Ye , Huaibin Wang , Chuyao Luo , Kola Ye , linfeng Luo

Image colorization aims to bring colors back to grayscale images. Automatic image colorization methods, which requires no additional guidance, struggle to generate high-quality images due to color ambiguity, and provides limited user…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Yifan Li , Shuai Yang , Jiaying Liu

Recently, a unified model for image-to-image translation tasks within adversarial learning framework has aroused widespread research interests in computer vision practitioners. Their reported empirical success however lacks solid…

Machine Learning · Statistics 2018-06-20 Xudong Pan , Mi Zhang , Daizong Ding

Quantizing images into discrete representations has been a fundamental problem in unified generative modeling. Predominant approaches learn the discrete representation either in a deterministic manner by selecting the best-matching token or…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Jiahui Zhang , Fangneng Zhan , Christian Theobalt , Shijian Lu

Generating 3D images of complex objects conditionally from a few 2D views is a difficult synthesis problem, compounded by issues such as domain gap and geometric misalignment. For instance, a unified framework such as Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Abril Corona-Figueroa , Sam Bond-Taylor , Neelanjan Bhowmik , Yona Falinie A. Gaus , Toby P. Breckon , Hubert P. H. Shum , Chris G. Willcocks

Unsupervised image-to-image translation is a recently proposed task of translating an image to a different style or domain given only unpaired image examples at training time. In this paper, we formulate a new task of unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Dina Bashkirova , Ben Usman , Kate Saenko

We present a novel unsupervised framework for instance-level image-to-image translation. Although recent advances have been made by incorporating additional object annotations, existing methods often fail to handle images with multiple…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Somi Jeong , Youngjung Kim , Eungbean Lee , Kwanghoon Sohn

Vector quantized diffusion (VQ-Diffusion) is a powerful generative model for text-to-image synthesis, but sometimes can still generate low-quality samples or weakly correlated images with text input. We find these issues are mainly due to…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Zhicong Tang , Shuyang Gu , Jianmin Bao , Dong Chen , Fang Wen

Over the last decades, hand-crafted feature extractors have been used to encode image visual properties into feature vectors. Recently, data-driven feature learning approaches have been successfully explored as alternatives for producing…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Érico M. Pereira , Ricardo da S. Torres , Jefersson A. dos Santos