English
Related papers

Related papers: LACON: Training Text-to-Image Model from Uncurated…

200 papers

Image forgery is a topic that has been studied for many years. Before the breakthrough of deep learning, forged images were detected using handcrafted features that did not require training. These traditional methods failed to perform…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Eren Tahir , Mert Bal

We argue that diffusion models' success in modeling complex distributions is, for the most part, coming from their input conditioning. This paper investigates the representation used to condition diffusion models from the perspective that…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Samuel Lavoie , Michael Noukhovitch , Aaron Courville

Vision-language models (VLMs) are trained for thousands of GPU hours on carefully curated web datasets. In recent times, data curation has gained prominence with several works developing strategies to retain 'high-quality' subsets of 'raw'…

Machine Learning · Computer Science 2024-04-11 Sachin Goyal , Pratyush Maini , Zachary C. Lipton , Aditi Raghunathan , J. Zico Kolter

Generative AI models have recently achieved astonishing results in quality and are consequently employed in a fast-growing number of applications. However, since they are highly data-driven, relying on billion-sized datasets randomly…

Conditional image generation is effective for diverse tasks including training data synthesis for learning-based computer vision. However, despite the recent advances in generative adversarial networks (GANs), it is still a challenging task…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Yutaro Miyauchi , Yusuke Sugano , Yasuyuki Matsushita

Latent diffusion models excel at generating high-quality images but lose the benefits of end-to-end modeling. They discard information during image encoding, require a separately trained decoder, and model an auxiliary distribution to the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Alan Baade , Eric Ryan Chan , Kyle Sargent , Changan Chen , Justin Johnson , Ehsan Adeli , Li Fei-Fei

Despite their fundamental role, it remains unclear what properties could make tokenizers more effective for generative modeling. We observe that modern generative models share a conceptually similar training objective -- reconstructing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Jiawei Yang , Tianhong Li , Lijie Fan , Yonglong Tian , Yue Wang

In this paper, we study a simple and generic framework to tackle the problem of learning model parameters when a fraction of the training samples are corrupted. We first make a simple observation: in a variety of such settings, the…

Machine Learning · Computer Science 2019-02-20 Yanyao Shen , Sujay Sanghavi

Image classification datasets are often imbalanced, characteristic that negatively affects the accuracy of deep-learning classifiers. In this work we propose balancing GAN (BAGAN) as an augmentation tool to restore balance in imbalanced…

Computer Vision and Pattern Recognition · Computer Science 2018-06-06 Giovanni Mariani , Florian Scheidegger , Roxana Istrate , Costas Bekas , Cristiano Malossi

Text-conditioned image generation models have recently achieved astonishing results in image quality and text alignment and are consequently employed in a fast-growing number of applications. Since they are highly data-driven, relying on…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Patrick Schramowski , Manuel Brack , Björn Deiseroth , Kristian Kersting

While there has been remarkable progress in the performance of visual recognition algorithms, the state-of-the-art models tend to be exceptionally data-hungry. Large labeled training datasets, expensive and tedious to produce, are required…

Computer Vision and Pattern Recognition · Computer Science 2016-06-07 Fisher Yu , Ari Seff , Yinda Zhang , Shuran Song , Thomas Funkhouser , Jianxiong Xiao

Contemporary Artificial Intelligence technologies allow for the employment of Computer Vision to discern good crops from bad, providing a step in the pipeline of selecting healthy fruit from undesirable fruit, such as those which are mouldy…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Jordan J. Bird , Chloe M. Barnes , Luis J. Manso , Anikó Ekárt , Diego R. Faria

Despite the tremendous success in text-to-image generative models, localized text-to-image generation (that is, generating objects or features at specific locations in an image while maintaining a consistent overall generation) still…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Yutong He , Ruslan Salakhutdinov , J. Zico Kolter

We propose a novel training-free image generation algorithm that precisely controls the occlusion relationships between objects in an image. Existing image generation methods typically rely on prompts to influence occlusion, which often…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Xiaohang Zhan , Dingming Liu

Recent advances in conditional image generation tasks, such as image-to-image translation and image inpainting, are largely accounted to the success of conditional GAN models, which are often optimized by the joint use of the GAN loss with…

Machine Learning · Computer Science 2019-02-26 Soochan Lee , Junsoo Ha , Gunhee Kim

Learning an empirically effective model with generalization using limited data is a challenging task for deep neural networks. In this paper, we propose a novel learning framework called PurifiedLearning to exploit task-irrelevant features…

Machine Learning · Computer Science 2022-07-12 Yinghui Li , Chen Wang , Yangning Li , Hai-Tao Zheng , Ying Shen

We show how to use low-quality, synthetic, and out-of-distribution images to improve the quality of a diffusion model. Typically, diffusion models are trained on curated datasets that emerge from highly filtered data pools from the Web and…

Text-to-image generation has achieved astonishing results, yet precise spatial controllability and prompt fidelity remain highly challenging. This limitation is typically addressed through cumbersome prompt engineering, scene layout…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Petru-Daniel Tudosiu , Yongxin Yang , Shifeng Zhang , Fei Chen , Steven McDonagh , Gerasimos Lampouras , Ignacio Iacobacci , Sarah Parisot

In the big data era, the impetus to digitize the vast reservoirs of data trapped in unstructured scanned documents such as invoices, bank documents and courier receipts has gained fresh momentum. The scanning process often results in the…

Computer Vision and Pattern Recognition · Computer Science 2019-02-01 Monika Sharma , Abhishek Verma , Lovekesh Vig

Over the past few years, Text-to-Image (T2I) generation approaches based on diffusion models have gained significant attention. However, vanilla diffusion models often suffer from spelling inaccuracies in the text displayed within the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Sanyam Lakhanpal , Shivang Chopra , Vinija Jain , Aman Chadha , Man Luo