English
Related papers

Related papers: Target-Free Text-guided Image Manipulation

200 papers

Image-to-image translation tasks have been widely investigated with Generative Adversarial Networks (GANs) and dual learning. However, existing models lack the ability to control the translated results in the target domain and their results…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Jianxin Lin , Yingce Xia , Tao Qin , Zhibo Chen , Tie-Yan Liu

Developing techniques for editing an outfit image through natural sentences and accordingly generating new outfits has promising applications for art, fashion and design. However, it is considered as a certainly challenging task since image…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Mehmet Günel , Erkut Erdem , Aykut Erdem

The original publication Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks served as the inspiration for this implementation project. Researchers developed a novel method for doing image-to-image translations…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Sai Pavan Tadem

Recently, language-guided global image editing draws increasing attention with growing application potentials. However, previous GAN-based methods are not only confined to domain-specific, low-resolution data but also lacking in…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Jing Shi , Ning Xu , Yihang Xu , Trung Bui , Franck Dernoncourt , Chenliang Xu

Recent pre-trained text-to-image flow models have enabled remarkable progress in text-based image editing. Mainstream approaches adopt a corruption-then-restoration paradigm, where the source image is first corrupted into an editable…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yanghao Wang , Zhen Wang , Long Chen

Unpaired image-to-image translation methods aim at learning a mapping of images from a source domain to a target domain. Recently, these methods proved to be very useful in biological applications to display subtle phenotypic cell…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Anis Bourou , Auguste Genovesio

Text-driven image manipulation is developed since the vision-language model (CLIP) has been proposed. Previous work has adopted CLIP to design a text-image consistency-based objective to address this issue. However, these methods require…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Wanfeng Zheng , Qiang Li , Xiaoyan Guo , Pengfei Wan , Zhongyuan Wang

Image Completion refers to the task of filling in the missing regions of an image and Image Extrapolation refers to the task of extending an image at its boundaries while keeping it coherent. Many recent works based on GAN have shown…

Computer Vision and Pattern Recognition · Computer Science 2020-06-05 Sai Hemanth Kasaraneni , Abhishek Mishra

Machine learning has enabled the development of powerful systems capable of editing images from natural language instructions. However, in many common scenarios it is difficult for users to specify precise image transformations with text…

Artificial Intelligence · Computer Science 2024-02-14 Alec Helbling , Seongmin Lee , Polo Chau

Text-based semantic image editing assumes the manipulation of an image using a natural language instruction. Although recent works are capable of generating creative and qualitative images, the problem is still mostly approached as a black…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Maria Mihaela Trusca , Tinne Tuytelaars , Marie-Francine Moens

We propose Fast text2StyleGAN, a natural language interface that adapts pre-trained GANs for text-guided human face synthesis. Leveraging the recent advances in Contrastive Language-Image Pre-training (CLIP), no text data is required during…

Computer Vision and Pattern Recognition · Computer Science 2022-09-09 Xiaodan Du , Raymond A. Yeh , Nicholas Kolkin , Eli Shechtman , Greg Shakhnarovich

Generative Adversarial Networks (GANs) have facilitated a new direction to tackle the image-to-image transformation problem. Different GANs use generator and discriminator networks with different losses in the objective function. Still…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Kancharagunta Kishan Babu , Shiv Ram Dubey

Medical image translation (e.g. CT to MR) is a challenging task as it requires I) faithful translation of domain-invariant features (e.g. shape information of anatomical structures) and II) realistic synthesis of target-domain features…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Siyu Liu , Jason A. Dowling , Craig Engstrom , Peter B. Greer , Stuart Crozier , Shekhar S. Chandra

Unsupervised image-to-image translation methods such as CycleGAN learn to convert images from one domain to another using unpaired training data sets from different domains. Unfortunately, these approaches still require centrally collected…

Computer Vision and Pattern Recognition · Computer Science 2021-06-18 Joonyoung Song , Jong Chul Ye

Getting rid of the fundamental limitations in fitting to the paired training data, recent unsupervised low-light enhancement methods excel in adjusting illumination and contrast of images. However, for unsupervised low light enhancement,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Zhangkai Ni , Wenhan Yang , Hanli Wang , Shiqi Wang , Lin Ma , Sam Kwong

Latent space exploration is a technique that discovers interpretable latent directions and manipulates latent codes to edit various attributes in images generated by generative adversarial networks (GANs). However, in previous work, spatial…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Yuki Endo

Cross-view image translation is challenging because it involves images with drastically different views and severe deformation. In this paper, we propose a novel approach named Multi-Channel Attention SelectionGAN (SelectionGAN) that makes…

Computer Vision and Pattern Recognition · Computer Science 2019-04-18 Hao Tang , Dan Xu , Nicu Sebe , Yanzhi Wang , Jason J. Corso , Yan Yan

This paper addresses the problem of manipulating images using natural language description. Our task aims to semantically modify visual attributes of an object in an image according to the text describing the new visual appearance. Although…

Computer Vision and Pattern Recognition · Computer Science 2018-11-29 Seonghyeon Nam , Yunji Kim , Seon Joo Kim

Consistent editing of real images is a challenging task, as it requires performing non-rigid edits (e.g., changing postures) to the main objects in the input image without changing their identity or attributes. To guarantee consistent…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Xiaoyue Duan , Shuhao Cui , Guoliang Kang , Baochang Zhang , Zhengcong Fei , Mingyuan Fan , Junshi Huang

The problem of image-to-image translation is one that is intruiging and challenging at the same time, for the impact potential it can have on a wide variety of other computer vision applications like colorization, inpainting, segmentation…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 BahaaEddin AlAila , Zahra Jandaghi , Abolfazl Farahani , Mohammad Ziad Al-Saad