English
Related papers

Related papers: Augmented Conditioning Is Enough For Effective Tra…

200 papers

Contrastive models like CLIP have been shown to learn robust representations of images that capture both semantics and style. To leverage these representations for image generation, we propose a two-stage model: a prior that generates a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Aditya Ramesh , Prafulla Dhariwal , Alex Nichol , Casey Chu , Mark Chen

We introduce nested diffusion models, an efficient and powerful hierarchical generative framework that substantially enhances the generation quality of diffusion models, particularly for images of complex scenes. Our approach employs a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xiao Zhang , Ruoxi Jiang , Rebecca Willett , Michael Maire

Deep image matting methods have achieved increasingly better results on benchmarks (e.g., Composition-1k/alphamatting.com). However, the robustness, including robustness to trimaps and generalization to images from different domains, is…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Yutong Dai , Brian Price , He Zhang , Chunhua Shen

Synthetic training data has gained prominence in numerous learning tasks and scenarios, offering advantages such as dataset augmentation, generalization evaluation, and privacy preservation. Despite these benefits, the efficiency of…

Machine Learning · Computer Science 2024-03-21 Jianhao Yuan , Jie Zhang , Shuyang Sun , Philip Torr , Bo Zhao

Text-based audio generation models have limitations as they cannot encompass all the information in audio, leading to restricted controllability when relying solely on text. To address this issue, we propose a novel model that enhances the…

Sound · Computer Science 2023-12-29 Zhifang Guo , Jianguo Mao , Rui Tao , Long Yan , Kazushige Ouchi , Hong Liu , Xiangdong Wang

Image generation in the fashion domain has predominantly focused on preserving body characteristics or following input prompts, but little attention has been paid to improving the inherent fashionability of the output images. This paper…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Qice Qin , Yuki Hirakawa , Ryotaro Shimizu , Takuya Furusawa , Edgar Simo-Serra

Generative Adversarial Networks (GANs) have significantly advanced image synthesis, however, the synthesis quality drops significantly given a limited amount of training data. To improve the data efficiency of GAN training, prior work…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Ceyuan Yang , Yujun Shen , Yinghao Xu , Bolei Zhou

In most scenarios, conditional image generation can be thought of as an inversion of the image understanding process. Since generic image understanding involves solving multiple tasks, it is natural to aim at generating images via…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Ritika Chakraborty , Nikola Popovic , Danda Pani Paudel , Thomas Probst , Luc Van Gool

With the advent of generative adversarial networks, synthesizing images from textual descriptions has recently become an active research area. It is a flexible and intuitive way for conditional image generation with significant progress in…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Stanislav Frolov , Tobias Hinz , Federico Raue , Jörn Hees , Andreas Dengel

Deep learning approaches have become the standard solution to many problems in computer vision and robotics, but obtaining sufficient training data in high enough quality is challenging, as human labor is error prone, time consuming, and…

Machine Learning · Computer Science 2021-06-16 Jan Blumenkamp , Andreas Baude , Tim Laue

Data augmentation is crucial for pixel-wise annotation tasks like semantic segmentation, where labeling requires significant effort and intensive labor. Traditional methods, involving simple transformations such as rotations and flips,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Quang-Huy Che , Duc-Tri Le , Bich-Nga Pham , Duc-Khai Lam , Vinh-Tiep Nguyen

In creativity support and computational co-creativity contexts, the task of discovering appropriate prompts for use with text-to-image generative models remains difficult. In many cases the creator wishes to evoke a certain impression with…

Artificial Intelligence · Computer Science 2023-02-21 Francisco Ibarrola , Rohan Lulham , Kazjon Grace

Deep learning techniques have become widely utilized in histopathology image classification due to their superior performance. However, this success heavily relies on the availability of substantial labeled data, which necessitates…

Image and Video Processing · Electrical Eng. & Systems 2024-10-15 Meng Li , Chaoyi Li , Can Peng , Brian C. Lovell

Recently, text-to-image generation models have achieved remarkable advancements, particularly with diffusion models facilitating high-quality image synthesis from textual descriptions. However, these models often struggle with achieving…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Lunhao Duan , Shanshan Zhao , Wenjun Yan , Yinglun Li , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang , Mingming Gong , Gui-Song Xia

Performing data augmentation for learning deep neural networks is well known to be important for training visual recognition systems. By artificially increasing the number of training examples, it helps reducing overfitting and improves…

Computer Vision and Pattern Recognition · Computer Science 2018-07-20 Nikita Dvornik , Julien Mairal , Cordelia Schmid

As deep learning technology continues to evolve, the images yielded by generative models are becoming more and more realistic, triggering people to question the authenticity of images. Existing generated image detection methods detect…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Xiuli Bi , Bo Liu , Fan Yang , Bin Xiao , Weisheng Li , Gao Huang , Pamela C. Cosman

Exploiting learning algorithms under scarce data regimes is a limitation and a reality of the medical imaging field. In an attempt to mitigate the problem, we propose a data augmentation protocol based on generative adversarial networks. We…

Image and Video Processing · Electrical Eng. & Systems 2021-03-30 Ahmad B Qasim , Ivan Ezhov , Suprosanna Shit , Oliver Schoppe , Johannes C Paetzold , Anjany Sekuboyina , Florian Kofler , Jana Lipkova , Hongwei Li , Bjoern Menze

Data augmentation is one of the most prevalent tools in deep learning, underpinning many recent advances, including those from classification, generative models, and representation learning. The standard approach to data augmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Brandon Trabucco , Kyle Doherty , Max Gurinas , Ruslan Salakhutdinov

Text to Image Synthesis refers to the process of automatic generation of a photo-realistic image starting from a given text and is revolutionizing many real-world applications. In order to perform such process it is necessary to exploit…

Machine Learning · Computer Science 2019-10-10 Marco Menardi , Alex Falcon , Saida S. Mohamed , Lorenzo Seidenari , Giuseppe Serra , Alberto Del Bimbo , Carlo Tasso

Generalization to unseen real-world scenarios for robot manipulation requires exposure to diverse datasets during training. However, collecting large real-world datasets is intractable due to high operational costs. For robot learning to…

Robotics · Computer Science 2024-09-04 Zoey Chen , Zhao Mandi , Homanga Bharadhwaj , Mohit Sharma , Shuran Song , Abhishek Gupta , Vikash Kumar