English
Related papers

Related papers: Fill-Up: Balancing Long-Tailed Data with Generativ…

200 papers

Deep learning approaches have become the standard solution to many problems in computer vision and robotics, but obtaining sufficient training data in high enough quality is challenging, as human labor is error prone, time consuming, and…

Machine Learning · Computer Science 2021-06-16 Jan Blumenkamp , Andreas Baude , Tim Laue

Translating information between text and image is a fundamental problem in artificial intelligence that connects natural language processing and computer vision. In the past few years, performance in image caption generation has seen…

Computer Vision and Pattern Recognition · Computer Science 2017-06-06 Hao Dong , Jingqing Zhang , Douglas McIlwraith , Yike Guo

With the advent of generative adversarial networks, synthesizing images from textual descriptions has recently become an active research area. It is a flexible and intuitive way for conditional image generation with significant progress in…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Stanislav Frolov , Tobias Hinz , Federico Raue , Jörn Hees , Andreas Dengel

Long-tailed class distributions are pervasive in multi-class medical datasets and pose significant challenges for deep learning models which typically underperform on tail classes with limited samples. This limitation is particularly…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Jiaxiang Jiang , Mahesh Subedar , Omesh Tickoo

While recent text-to-image models can generate photorealistic images from text prompts that reflect detailed instructions, they still face significant challenges in accurately rendering words in the image. In this paper, we propose to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Wataru Shimoda , Naoto Inoue , Daichi Haraguchi , Hayato Mitani , Seiichi Uchida , Kota Yamaguchi

The field of advanced text-to-image generation is witnessing the emergence of unified frameworks that integrate powerful text encoders, such as CLIP and T5, with Diffusion Transformer backbones. Although there have been efforts to control…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Liang Chen , Shuai Bai , Wenhao Chai , Weichu Xie , Haozhe Zhao , Leon Vinci , Junyang Lin , Baobao Chang

Synthesizing high-quality, realistic images from text-descriptions is a challenging task, and current methods synthesize images from text in a multi-stage manner, typically by first generating a rough initial image and then refining image…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Amrit Diggavi Seshadri , Balaraman Ravindran

Synthetic image data generation represents a promising avenue for training deep learning models, particularly in the realm of transfer learning, where obtaining real images within a specific domain can be prohibitively expensive due to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Yuhang Li , Xin Dong , Chen Chen , Jingtao Li , Yuxin Wen , Michael Spranger , Lingjuan Lyu

Recent advancements in text-to-image generation using diffusion models have significantly improved the quality of generated images and expanded the ability to depict a wide range of objects. However, ensuring that these models adhere…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Michail Tarasiou , Stylianos Moschoglou , Jiankang Deng , Stefanos Zafeiriou

Advances in generative models have led to significant interest in image synthesis, demonstrating the ability to generate high-quality images for a diverse range of text prompts. Despite this progress, most studies ignore the presence of…

Artificial Intelligence · Computer Science 2024-07-02 Nila Masrourisaadat , Nazanin Sedaghatkish , Fatemeh Sarshartehrani , Edward A. Fox

Text-to-image synthesis refers to computational methods which translate human written textual descriptions, in the form of keywords or sentences, into images with similar semantic meaning to the text. In earlier research, image synthesis…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Jorge Agnese , Jonathan Herrera , Haicheng Tao , Xingquan Zhu

Generative text-to-image models enable us to synthesize unlimited amounts of images in a controllable manner, spurring many recent efforts to train vision models with synthetic data. However, every synthetic image ultimately originates from…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Scott Geng , Cheng-Yu Hsieh , Vivek Ramanujan , Matthew Wallingford , Chun-Liang Li , Pang Wei Koh , Ranjay Krishna

Text-to-image generation requires large amount of training data to synthesizing high-quality images. For augmenting training data, previous methods rely on data interpolations like cropping, flipping, and mixing up, which fail to introduce…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Senmao Ye , Fei Liu

Visual recognition in a low-data regime is challenging and often prone to overfitting. To mitigate this issue, several data augmentation strategies have been proposed. However, standard transformations, e.g., rotation, cropping, and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Aniket Roy , Anshul Shah , Ketul Shah , Anirban Roy , Rama Chellappa

Image generation today can produce somewhat realistic images from text prompts. However, if one asks the generator to synthesize a specific camera setting such as creating different fields of view using a 24mm lens versus a 70mm lens, the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Yu Yuan , Xijun Wang , Yichen Sheng , Prateek Chennuri , Xingguang Zhang , Stanley Chan

Deep learning-based models encounter challenges when processing long-tailed data in the real world. Existing solutions usually employ some balancing strategies or transfer learning to deal with the class imbalance problem, based on the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Changyao Tian , Wenhai Wang , Xizhou Zhu , Jifeng Dai , Yu Qiao

Synthesizing high-quality realistic images from text descriptions is a challenging task. Existing text-to-image Generative Adversarial Networks generally employ a stacked architecture as the backbone yet still remain three flaws. First, the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Ming Tao , Hao Tang , Fei Wu , Xiao-Yuan Jing , Bing-Kun Bao , Changsheng Xu

Text-to-Image (T2I) has been prevalent in recent years, with most common condition tasks having been optimized nicely. Besides, counterfactual Text-to-Image is obstructing us from a more versatile AIGC experience. For those scenes that are…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Sifan Li , Ming Tao , Hao Zhao , Ling Shao , Hao Tang

Recently, methods based on deep learning have dominated the field of text recognition. With a large number of training data, most of them can achieve the state-of-the-art performances. However, it is hard to harvest and label sufficient…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Yanxiang Gong , Linjie Deng , Zheng Ma , Mei Xie

Typical methods for text-to-image synthesis seek to design effective generative architecture to model the text-to-image mapping directly. It is fairly arduous due to the cross-modality translation. In this paper we circumvent this problem…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Jiadong Liang , Wenjie Pei , Feng Lu