English
Related papers

Related papers: Image-to-image Transformation with Auxiliary Condi…

200 papers

Synthesizing high-quality images from text descriptions is a challenging problem in computer vision and has many practical applications. Samples generated by existing text-to-image approaches can roughly reflect the meaning of the given…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Han Zhang , Tao Xu , Hongsheng Li , Shaoting Zhang , Xiaogang Wang , Xiaolei Huang , Dimitris Metaxas

With recent progress in graphics, it has become more tractable to train models on synthetic images, potentially avoiding the need for expensive annotations. However, learning from synthetic images may not achieve the desired performance due…

Computer Vision and Pattern Recognition · Computer Science 2017-07-21 Ashish Shrivastava , Tomas Pfister , Oncel Tuzel , Josh Susskind , Wenda Wang , Russ Webb

In this paper, we propose a novel way to interpret text information by extracting visual feature presentation from multiple high-resolution and photo-realistic synthetic images generated by Text-to-image Generative Adversarial Network (GAN)…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 Tao Hu , Chengjiang Long , Leheng Zhang , Chunxia Xiao

In most scenarios, conditional image generation can be thought of as an inversion of the image understanding process. Since generic image understanding involves solving multiple tasks, it is natural to aim at generating images via…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Ritika Chakraborty , Nikola Popovic , Danda Pani Paudel , Thomas Probst , Luc Van Gool

In this work, we study the problem of training deep networks for semantic image segmentation using only a fraction of annotated images, which may significantly reduce human annotation efforts. Particularly, we propose a strategy that…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Arnab Kumar Mondal , Aniket Agarwal , Jose Dolz , Christian Desrosiers

Image clustering is an important and open-challenging task in computer vision. Although many methods have been proposed to solve the image clustering task, they only explore images and uncover clusters according to the image features, thus…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Shaotian Cai , Liping Qiu , Xiaojun Chen , Qin Zhang , Longteng Chen

Given the dependency of current CNN architectures on a large training set, the possibility of using synthetic data is alluring as it allows generating a virtually infinite amount of labeled training data. However, producing such data is a…

Computer Vision and Pattern Recognition · Computer Science 2020-12-25 Pavel Rojtberg , Thomas Pöllabauer , Arjan Kuijper

Vision-based control relies on accurate perception to achieve robustness. However, image distribution changes caused by sensor noise, adverse weather, and dynamic lighting can degrade perception, leading to suboptimal control decisions.…

Robotics · Computer Science 2025-08-01 Carson Sobolewski , Zhenjiang Mao , Kshitij Maruti Vejre , Ivan Ruchkin

Text to Image Synthesis refers to the process of automatic generation of a photo-realistic image starting from a given text and is revolutionizing many real-world applications. In order to perform such process it is necessary to exploit…

Machine Learning · Computer Science 2019-10-10 Marco Menardi , Alex Falcon , Saida S. Mohamed , Lorenzo Seidenari , Giuseppe Serra , Alberto Del Bimbo , Carlo Tasso

Image-to-image translation aims to learn the mapping between two visual domains. There are two main challenges for many applications: 1) the lack of aligned training pairs and 2) multiple possible outputs from a single input image. In this…

Computer Vision and Pattern Recognition · Computer Science 2018-08-03 Hsin-Ying Lee , Hung-Yu Tseng , Jia-Bin Huang , Maneesh Kumar Singh , Ming-Hsuan Yang

Despite that the performance of image-to-image translation has been significantly improved by recent progress in generative models, current methods still suffer from severe degradation in training stability and sample quality when applied…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Jie Cao , Huaibo Huang , Yi Li , Jingtuo Liu , Ran He , Zhenan Sun

One highly promising direction for enabling flexible real-time on-device image editing is utilizing data distillation by leveraging large-scale text-to-image diffusion models to generate paired datasets used for training generative…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Yifan Gong , Zheng Zhan , Qing Jin , Yanyu Li , Yerlan Idelbayev , Xian Liu , Andrey Zharkov , Kfir Aberman , Sergey Tulyakov , Yanzhi Wang , Jian Ren

In the field of computer vision, visible light images often exhibit low contrast in low-light conditions, presenting a significant challenge. While infrared imagery provides a potential solution, its utilization entails high costs and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Yijia Chen , Pinghua Chen , Xiangxin Zhou , Yingtie Lei , Ziyang Zhou , Mingxian Li

Image-to-image translation has recently achieved remarkable results. But despite current success, it suffers from inferior performance when translations between classes require large shape changes. We attribute this to the high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2020-11-12 Yaxing Wang , Lu Yu , Joost van de Weijer

This paper proposes a series of new approaches to improve Generative Adversarial Network (GAN) for conditional image synthesis and we name the proposed model as ArtGAN. One of the key innovation of ArtGAN is that, the gradient of the loss…

Computer Vision and Pattern Recognition · Computer Science 2018-08-27 Wei Ren Tan , Chee Seng Chan , Hernan Aguirre , Kiyoshi Tanaka

In this paper, we focus on the semantic image synthesis task that aims at transferring semantic label maps to photo-realistic images. Existing methods lack effective semantic constraints to preserve the semantic information and ignore the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Hao Tang , Song Bai , Nicu Sebe

Text-to-Image translation has been an active area of research in the recent past. The ability for a network to learn the meaning of a sentence and generate an accurate image that depicts the sentence shows ability of the model to think more…

Machine Learning · Computer Science 2018-08-15 Satya Krishna Gorti , Jeremy Ma

In image morphing, a sequence of plausible frames are synthesized and composited together to form a smooth transformation between given instances. Intermediates must remain faithful to the input, stand on their own as members of the set,…

Graphics · Computer Science 2020-05-05 Noa Fish , Richard Zhang , Lilach Perry , Daniel Cohen-Or , Eli Shechtman , Connelly Barnes

Data efficiency, or the ability to generalize from a few labeled data, remains a major challenge in deep learning. Semi-supervised learning has thrived in traditional recognition tasks alleviating the need for large amounts of labeled data,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 George Eskandar , Shuai Zhang , Mohamed Abdelsamad , Mark Youssef , Diandian Guo , Bin Yang

In this paper, we address the problem of generating person images conditioned on both pose and appearance information. Specifically, given an image xa of a person and a target pose P(xb), extracted from a different image xb, we synthesize a…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Aliaksandr Siarohin , Stéphane Lathuilière , Enver Sangineto , Nicu Sebe