English
Related papers

Related papers: Augmented Conditioning Is Enough For Effective Tra…

200 papers

In recent years, image generation has shown a great leap in performance, where diffusion models play a central role. Although generating high-quality images, such models are mainly conditioned on textual descriptions. This begs the…

Sound · Computer Science 2023-05-23 Guy Yariv , Itai Gat , Lior Wolf , Yossi Adi , Idan Schwartz

Image classifiers should be used with caution in the real world. Performance evaluated on a validation set may not reflect performance in the real world. In particular, classifiers may perform well for conditions that are frequently…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Adrien LeCoz , Houssem Ouertatani , Stéphane Herbin , Faouzi Adjed

The performance of generative adversarial networks (GANs) heavily deteriorates given a limited amount of training data. This is mainly because the discriminator is memorizing the exact training set. To combat it, we propose Differentiable…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Shengyu Zhao , Zhijian Liu , Ji Lin , Jun-Yan Zhu , Song Han

The recent emergence of latent diffusion models such as SDXL and SD 1.5 has shown significant capability in generating highly detailed and realistic images. Despite their remarkable ability to produce images, generating accurate text within…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Jun Young Koh , Sang Hyun Park , Joy Song

In this paper, we propose a novel variational generator framework for conditional GANs to catch semantic details for improving the generation quality and diversity. Traditional generators in conditional GANs simply concatenate the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Mingqi Hu , Deyu Zhou , Yulan He

By optimizing the rate-distortion-realism trade-off, generative compression approaches produce detailed, realistic images, even at low bit rates, instead of the blurry reconstructions produced by rate-distortion optimized models. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Eirikur Agustsson , David Minnen , George Toderici , Fabian Mentzer

Recent deep generative models (DGMs) such as generative adversarial networks (GANs) and diffusion probabilistic models (DPMs) have shown their impressive ability in generating high-fidelity photorealistic images. Although looking appealing…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Ruyu Wang , Sabrina Schmedding , Marco F. Huber

The life of a photo begins with photons striking the sensor, whose signals are passed through a sophisticated image signal processing (ISP) pipeline to produce a display-referred image. However, such images are no longer faithful to the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Yuekun Dai , Zhoutong Zhang , Shangchen Zhou , Nanxuan Zhao

Recent advances in deep learning have significantly increased the performance of face recognition systems. The performance and reliability of these models depend heavily on the amount and quality of the training data. However, the…

Computer Vision and Pattern Recognition · Computer Science 2018-02-19 Adam Kortylewski , Andreas Schneider , Thomas Gerig , Bernhard Egger , Andreas Morel-Forster , Thomas Vetter

Data availability is a bottleneck during early stages of development of new capabilities for intelligent artificial agents. We investigate the use of text generation techniques to augment the training data of a popular commercial artificial…

Computation and Language · Computer Science 2019-10-09 Nikolaos Malandrakis , Minmin Shen , Anuj Goyal , Shuyang Gao , Abhishek Sethi , Angeliki Metallinou

Text-to-image (T2I) generative models have recently emerged as a powerful tool, enabling the creation of photo-realistic images and giving rise to a multitude of applications. However, the effective integration of T2I models into…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Zhicai Wang , Longhui Wei , Tan Wang , Heyu Chen , Yanbin Hao , Xiang Wang , Xiangnan He , Qi Tian

In recent years, Generative Adversarial Networks (GANs) have seen significant advancements, leading to their widespread adoption across various fields. The original GAN architecture enables the generation of images without any specific…

Machine Learning · Computer Science 2024-09-04 Anis Bourou , Valérie Mezger , Auguste Genovesio

Conditional image synthesis for generating photorealistic images serves various applications for content editing to content generation. Previous conditional image synthesis algorithms mostly rely on semantic maps, and often fail in complex…

Computer Vision and Pattern Recognition · Computer Science 2020-04-23 Aysegul Dundar , Karan Sapra , Guilin Liu , Andrew Tao , Bryan Catanzaro

Existing generative adversarial network (GAN) based conditional image generative models typically produce fixed output for the same conditional input, which is unreasonable for highly subjective tasks, such as large-mask image inpainting or…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Tianyi Chu , Wei Xing , Jiafu Chen , Zhizhong Wang , Jiakai Sun , Lei Zhao , Haibo Chen , Huaizhong Lin

Large generative diffusion models have revolutionized text-to-image generation and offer immense potential for conditional generation tasks such as image enhancement, restoration, editing, and compositing. However, their widespread adoption…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Kangfu Mei , Mauricio Delbracio , Hossein Talebi , Zhengzhong Tu , Vishal M. Patel , Peyman Milanfar

As synthetic imagery is used more frequently in training deep models, it is important to understand how different synthesis techniques impact the performance of such models. In this work, we perform a thorough evaluation of the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Kristofer Schlachter , Connor DeFanti , Sebastian Herscher , Ken Perlin , Jonathan Tompson

Recent advances in conditional image generation tasks, such as image-to-image translation and image inpainting, are largely accounted to the success of conditional GAN models, which are often optimized by the joint use of the GAN loss with…

Machine Learning · Computer Science 2019-02-26 Soochan Lee , Junsoo Ha , Gunhee Kim

Conditional text-to-image generation is an active area of research, with many possible applications. Existing research has primarily focused on generating a single image from available conditioning information in one step. One practical…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Alaaeldin El-Nouby , Shikhar Sharma , Hannes Schulz , Devon Hjelm , Layla El Asri , Samira Ebrahimi Kahou , Yoshua Bengio , Graham W. Taylor

Synthetic data is being used lately for training deep neural networks in computer vision applications such as object detection, object segmentation and 6D object pose estimation. Domain randomization hereby plays an important role in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Parth Rawal , Mrunal Sompura , Wolfgang Hintze

Image generation from a single image using generative adversarial networks is quite interesting due to the realism of generated images. However, recent approaches need improvement for such realistic and diverse image generation, when the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-26 Sutharsan Mahendren , Chamira Edussooriya , Ranga Rodrigo