English
Related papers

Related papers: Condition-Aware Neural Network for Controlled Imag…

200 papers

Generative adversarial networks (GANs) have demonstrated to be successful at generating realistic real-world images. In this paper we compare various GAN techniques, both supervised and unsupervised. The effects on training stability of…

Machine Learning · Computer Science 2018-03-28 Mathijs Pieters , Marco Wiering

Recent advances in autoregressive (AR) models have demonstrated their potential to rival diffusion models in image synthesis. However, for complex spatially-conditioned generation, current AR approaches rely on fine-tuning the pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Jiaqi Liu , Tao Huang , Chang Xu

Generating photo-realistic images from a text description is a challenging problem in computer vision. Previous works have shown promising performance to generate synthetic images conditional on text by Generative Adversarial Networks…

Computer Vision and Pattern Recognition · Computer Science 2021-07-29 Tao Hu , Chengjiang Long , Chunxia Xiao

Existing generative adversarial network (GAN) based conditional image generative models typically produce fixed output for the same conditional input, which is unreasonable for highly subjective tasks, such as large-mask image inpainting or…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Tianyi Chu , Wei Xing , Jiafu Chen , Zhizhong Wang , Jiakai Sun , Lei Zhao , Haibo Chen , Huaizhong Lin

Contemporary Artificial Intelligence technologies allow for the employment of Computer Vision to discern good crops from bad, providing a step in the pipeline of selecting healthy fruit from undesirable fruit, such as those which are mouldy…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Jordan J. Bird , Chloe M. Barnes , Luis J. Manso , Anikó Ekárt , Diego R. Faria

While existing makeup style transfer models perform an image synthesis whose results cannot be explicitly controlled, the ability to modify makeup color continuously is a desirable property for virtual try-on applications. We propose a new…

Computer Vision and Pattern Recognition · Computer Science 2021-03-12 Robin Kips , Pietro Gori , Matthieu Perrot , Isabelle Bloch

We present a new method for synthesizing high-resolution photo-realistic images from semantic label maps using conditional generative adversarial networks (conditional GANs). Conditional GANs have enabled a variety of applications, but the…

Computer Vision and Pattern Recognition · Computer Science 2018-08-21 Ting-Chun Wang , Ming-Yu Liu , Jun-Yan Zhu , Andrew Tao , Jan Kautz , Bryan Catanzaro

To enhance the controllability of text-to-image diffusion models, existing efforts like ControlNet incorporated image-based conditional controls. In this paper, we reveal that existing methods still face significant challenges in generating…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Ming Li , Taojiannan Yang , Huafeng Kuang , Jie Wu , Zhaoning Wang , Xuefeng Xiao , Chen Chen

Autoregressive (AR) models have reformulated image generation as next-token prediction, demonstrating remarkable potential and emerging as strong competitors to diffusion models. However, control-to-image generation, akin to ControlNet,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Zongming Li , Tianheng Cheng , Shoufa Chen , Peize Sun , Haocheng Shen , Longjin Ran , Xiaoxin Chen , Wenyu Liu , Xinggang Wang

Diffusion models are emerging as powerful solutions for generating high-fidelity and diverse images, often surpassing GANs under many circumstances. However, their slow inference speed hinders their potential for real-time applications. To…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Luan Thanh Trinh , Tomoki Hamagami

In this paper, we propose a novel controllable text-to-image generative adversarial network (ControlGAN), which can effectively synthesise high-quality images and also control parts of the image generation according to natural language…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Bowen Li , Xiaojuan Qi , Thomas Lukasiewicz , Philip H. S. Torr

Denoising diffusion models have gained popularity as a generative modeling technique for producing high-quality and diverse images. Applying these models to downstream tasks requires conditioning, which can take the form of text, class…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Alexandros Graikos , Srikar Yellapragada , Dimitris Samaras

Recently, generative adversarial networks (GAN) have gathered a lot of interest. Their efficiency in generating unseen samples of high quality, especially images, has improved over the years. In the field of Natural Language Generation…

Computation and Language · Computer Science 2019-11-01 Jean-Benoit Delbrouck , Bastien Vanderplaetse , Stéphane Dupont

Conditioning image generation on specific features of the desired output is a key ingredient of modern generative models. However, existing approaches lack a general and unified way of representing structural and semantic conditioning at…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Luca Butera , Andrea Cini , Alberto Ferrante , Cesare Alippi

Recently image inpainting has witnessed rapid progress due to generative adversarial networks (GAN) that are able to synthesize realistic contents. However, most existing GAN-based methods for semantic inpainting apply an auto-encoder…

Computer Vision and Pattern Recognition · Computer Science 2017-12-22 Haofeng Li , Guanbin Li , Liang Lin , Yizhou Yu

We present a novel algorithm to reduce tensor compute required by a conditional image generation autoencoder without sacrificing quality of photo-realistic image generation. Our method is device agnostic, and can optimize an autoencoder for…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Nisarg A. Shah , Gaurav Bharaj

Denoising diffusion models achieved impressive results on several image generation tasks often outperforming GAN based models. Recently, the generative capabilities of diffusion models have been employed for perceptual image compression,…

Image and Video Processing · Electrical Eng. & Systems 2025-05-20 Jonas Brenig , Radu Timofte

Learning to generate natural scenes has always been a challenging task in computer vision. It is even more painstaking when the generation is conditioned on images with drastically different views. This is mainly because understanding,…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Krishna Regmi , Ali Borji

As a powerful technique in medical imaging, image synthesis is widely used in applications such as denoising, super resolution and modality transformation etc. Recently, the revival of deep neural networks made immense progress in the field…

Image and Video Processing · Electrical Eng. & Systems 2021-04-23 Gengyan Zhao , Mary E. Meyerand , Rasmus M. Birn

This paper outlines an end-to-end optimized lossy image compression framework using diffusion generative models. The approach relies on the transform coding paradigm, where an image is mapped into a latent space for entropy coding and, from…

Image and Video Processing · Electrical Eng. & Systems 2024-01-03 Ruihan Yang , Stephan Mandt