English
Related papers

Related papers: ManiGAN: Text-Guided Image Manipulation

200 papers

Researchers have recently begun exploring the use of StyleGAN-based models for real image editing. One particularly interesting application is using natural language descriptions to guide the editing process. Existing approaches for editing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Ahmet Canberk Baykal , Abdul Basit Anees , Duygu Ceylan , Erkut Erdem , Aykut Erdem , Deniz Yuret

In this work we propose a new computational framework, based on generative deep models, for synthesis of photo-realistic food meal images from textual list of its ingredients. Previous works on synthesis of images from text typically rely…

Computer Vision and Pattern Recognition · Computer Science 2020-02-27 Fangda Han , Ricardo Guerrero , Vladimir Pavlovic

Text-to-image generation is conducted through Generative Adversarial Networks (GANs) or transformer models. However, the current challenge lies in accurately generating images based on textual descriptions, especially in scenarios where the…

Human-Computer Interaction · Computer Science 2024-01-10 Yang Li , Huaqiang Jiang , Yangkai Wu

Synthesizing high-quality realistic images from text descriptions is a challenging task. Existing text-to-image Generative Adversarial Networks generally employ a stacked architecture as the backbone yet still remain three flaws. First, the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Ming Tao , Hao Tang , Fei Wu , Xiao-Yuan Jing , Bing-Kun Bao , Changsheng Xu

Facial attribute editing aims to manipulate single or multiple attributes of a face image, i.e., to generate a new face with desired attributes while preserving other details. Recently, generative adversarial net (GAN) and encoder-decoder…

Computer Vision and Pattern Recognition · Computer Science 2018-07-26 Zhenliang He , Wangmeng Zuo , Meina Kan , Shiguang Shan , Xilin Chen

Recent advances in image generation gave rise to powerful tools for semantic image editing. However, existing approaches can either operate on a single image or require an abundance of additional information. They are not capable of…

Computer Vision and Pattern Recognition · Computer Science 2020-10-09 Evangelos Ntavelis , Andrés Romero , Iason Kastanis , Luc Van Gool , Radu Timofte

Multi-domain image-to-image translation with conditional Generative Adversarial Networks (GANs) can generate highly photo realistic images with desired target classes, yet these synthetic images have not always been helpful to improve…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Suman Sapkota , Bidur Khanal , Binod Bhattarai , Bishesh Khanal , Tae-Kyun Kim

This paper tackles text-guided control of StyleGAN for editing garments in full-body human images. Existing StyleGAN-based methods suffer from handling the rich diversity of garments and body shapes and poses. We propose a framework for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Takato Yoshikawa , Yuki Endo , Yoshihiro Kanamori

Deep generative models (DGMs) have the potential to revolutionize diagnostic imaging. Generative adversarial networks (GANs) are one kind of DGM which are widely employed. The overarching problem with deploying GANs, and other DGMs, in any…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Rucha Deshpande , Mark A. Anastasio , Frank J. Brooks

Image-text retrieval is a widely studied topic in the field of computer vision due to the exponential growth of multimedia data, whose core concept is to measure the similarity between images and text. However, most existing retrieval…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Yang Zhang

In image editing, the most common task is pasting objects from one image to the other and then eventually adjusting the manifestation of the foreground object with the background object. This task is called image compositing. But image…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Shivangi Aneja , Soham Mazumder

Synthesising a text-to-image model of high-quality images by guiding the generative model through the Text description is an innovative and challenging task. In recent years, AttnGAN based on the Attention mechanism to guide GAN training…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Mingyu Jin , Chong Zhang , Qinkai Yu , Haochen Xue , Xiaobo Jin , Xi Yang

Text-to-image synthesis refers to generating an image from a given text description, the key goal of which lies in photo realism and semantic consistency. Previous methods usually generate an initial image with sentence embedding and then…

Computer Vision and Pattern Recognition · Computer Science 2021-08-30 Shulan Ruan , Yong Zhang , Kun Zhang , Yanbo Fan , Fan Tang , Qi Liu , Enhong Chen

Text-to-image diffusion models can generate high-quality images but lack fine-grained control of visual concepts, limiting their creativity. Thus, we introduce component-controllable personalization, a new task that enables users to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Donghao Zhou , Jiancheng Huang , Jinbin Bai , Jiaze Wang , Hao Chen , Guangyong Chen , Xiaowei Hu , Pheng-Ann Heng

Image-to-image translation is considered a new frontier in the field of medical image analysis, with numerous potential applications. However, a large portion of recent approaches offers individualized solutions based on specialized…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Karim Armanious , Chenming Jiang , Marc Fischer , Thomas Küstner , Konstantin Nikolaou , Sergios Gatidis , Bin Yang

Image inpainting is the task of filling-in missing regions of a damaged or incomplete image. In this work we tackle this problem not only by using the available visual data but also by incorporating image semantics through the use of…

Computer Vision and Pattern Recognition · Computer Science 2018-12-05 Patricia Vitoria , Joan Sintes , Coloma Ballester

Facial attribute editing aims to modify target attributes while preserving attribute-irrelevant content and overall image fidelity. Existing GAN-based methods provide favorable controllability, but often suffer from weak alignment between…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Wenmin Huang , Weiqi Luo , Xiaochun Cao , Jiwu Huang

Recent years have witnessed remarkable progress in image generation task, where users can create visually astonishing images with high-quality. However, existing text-to-image diffusion models are proficient in generating concrete concepts…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Jingyuan Yang , Jiawei Feng , Hui Huang

We propose VecGAN, an image-to-image translation framework for facial attribute editing with interpretable latent directions. Facial attribute editing task faces the challenges of precise attribute editing with controllable strength and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Yusuf Dalva , Said Fahri Altindis , Aysegul Dundar

This paper investigates an open research task of text-to-image synthesis for automatically generating or manipulating images from text descriptions. Prevailing methods mainly use the text as conditions for GAN generation, and train…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Hao Wang , Guosheng Lin , Steven C. H. Hoi , Chunyan Miao