English
Related papers

Related papers: TSIT: A Simple and Versatile Framework for Image-t…

200 papers

In many scenarios in computer vision, machine learning, and computer graphics, there is a requirement to learn the mapping from an image of one domain to an image of another domain, called Image-to-image translation. For example, style…

Image and Video Processing · Electrical Eng. & Systems 2020-03-09 Mohammad Akif Beg , Jia Yuan Yu

Typical methods for text-to-image synthesis seek to design effective generative architecture to model the text-to-image mapping directly. It is fairly arduous due to the cross-modality translation. In this paper we circumvent this problem…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Jiadong Liang , Wenjie Pei , Feng Lu

Image-to-image translation has played an important role in enabling synthetic data for computer vision. However, if the source and target domains have a large semantic mismatch, existing techniques often suffer from source content…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Justin Theiss , Jay Leverett , Daeil Kim , Aayush Prakash

This paper presents an end-to-end multilingual translation pipeline that integrates a custom U-Net for text detection, the Tesseract engine for text recognition, and a from-scratch sequence-to-sequence (Seq2Seq) Transformer for Neural…

Machine Learning · Computer Science 2025-10-28 Siddharth Sahay , Radhika Agarwal

Recent progress in text-to-image (T2I) models enables high-quality image generation with flexible textual control. To utilize the abundant visual priors in the off-the-shelf T2I models, a series of methods try to invert an image to proper…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Zijie Wu , Chaohui Yu , Zhen Zhu , Fan Wang , Xiang Bai

Translating information between text and image is a fundamental problem in artificial intelligence that connects natural language processing and computer vision. In the past few years, performance in image caption generation has seen…

Computer Vision and Pattern Recognition · Computer Science 2017-06-06 Hao Dong , Jingqing Zhang , Douglas McIlwraith , Yike Guo

Multi-domain image-to-image translation is a problem where the goal is to learn mappings among multiple domains. This problem is challenging in terms of scalability because it requires the learning of numerous mappings, the number of which…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Takuhiro Kaneko , Tatsuya Harada

In spite of the rapidly evolving landscape of text-to-image generation, the synthesis and manipulation of multiple entities while adhering to specific relational constraints pose enduring challenges. This paper introduces an innovative…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 YuTeng Ye , Jiale Cai , Hang Zhou , Guanwen Li , Youjia Zhang , Zikai Song , Chenxing Gao , Junqing Yu , Wei Yang

Unpaired image-to-image translation (UNIT) aims to map images between two visual domains without paired training data. However, given a UNIT model trained on certain domains, it is difficult for current methods to incorporate new domains…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Siyu Huang , Jie An , Donglai Wei , Zudi Lin , Jiebo Luo , Hanspeter Pfister

Recently, there has been an increasing interest in image editing methods that employ pre-trained unconditional image generators (e.g., StyleGAN). However, applying these methods to translate images to multiple visual domains remains…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Yahui Liu , Yajing Chen , Linchao Bao , Nicu Sebe , Bruno Lepri , Marco De Nadai

Text-to-image (T2I) models have significantly advanced the development of artificial intelligence, enabling the generation of high-quality images in diverse contexts based on specific text prompts. However, existing T2I-based methods often…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Salaheldin Mohamed , Dong Han , Yong Li

There has been remarkable recent work in unpaired image-to-image translation. However, they're restricted to translation on single pairs of distributions, with some exceptions. In this study, we extend one of these works to a scalable…

Machine Learning · Computer Science 2018-04-17 Laura Graesser , Anant Gupta

Most image-to-image translation methods require a large number of training images, which restricts their applicability. We instead propose ManiFest: a framework for few-shot image translation that learns a context-aware representation of a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Fabio Pizzati , Jean-François Lalonde , Raoul de Charette

Since the advent of deep convolutional neural networks (DNNs), computer vision has seen an extremely rapid progress that has led to huge advances in medical imaging. This article does not aim to cover all aspects of the field but focuses on…

Medical Physics · Physics 2019-06-11 Shizuo Kaji , Satoshi Kida

Unsupervised image-to-image translation is a recently proposed task of translating an image to a different style or domain given only unpaired image examples at training time. In this paper, we formulate a new task of unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Dina Bashkirova , Ben Usman , Kate Saenko

Image-to-image (I2I) translation is a pixel-level mapping that requires a large number of paired training data and often suffers from the problems of high diversity and strong category bias in image scenes. In order to tackle these…

Computer Vision and Pattern Recognition · Computer Science 2019-04-22 Liqian Ma , Qianru Sun , Bernt Schiele , Luc Van Gool

We introduce native-resolution image synthesis, a novel generative modeling paradigm that enables the synthesis of images at arbitrary resolutions and aspect ratios. This approach overcomes the limitations of conventional fixed-resolution,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Zidong Wang , Lei Bai , Xiangyu Yue , Wanli Ouyang , Yiyuan Zhang

It this paper we revisit the fast stylization method introduced in Ulyanov et. al. (2016). We show how a small change in the stylization architecture results in a significant qualitative improvement in the generated images. The change is…

Computer Vision and Pattern Recognition · Computer Science 2017-11-07 Dmitry Ulyanov , Andrea Vedaldi , Victor Lempitsky

Image-to-image (I2I) translation has matured in recent years and is able to generate high-quality realistic images. However, despite current success, it still faces important challenges when applied to small domains. Existing methods use…

Computer Vision and Pattern Recognition · Computer Science 2021-05-17 Yaxing Wang , Hector Laria Mantecon , Joost van de Weijer , Laura Lopez-Fuentes , Bogdan Raducanu

We propose a new and completely data-driven approach for generating a photo-consistent image transform. We show that simple classical algorithms which operate in the transform domain become extremely resilient to illumination changes. This…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Damian Kaliroff , Guy Gilboa