English
Related papers

Related papers: Efficient Neural Architecture for Text-to-Image Sy…

200 papers

In the field of computer vision, multimodal image generation has become a research hotspot, especially the task of integrating text, image, and style. In this study, we propose a multimodal image generation method based on Generative…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Chaoyi Tan , Wenqing Zhang , Zhen Qi , Kowei Shih , Xinshi Li , Ao Xiang

Performance achievable by modern deep learning approaches are directly related to the amount of data used at training time. Unfortunately, the annotation process is notoriously tedious and expensive, especially for pixel-wise tasks like…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Pierluigi Zama Ramirez , Alessio Tonioni , Luigi Di Stefano

While generative models produce high-quality images of concepts learned from a large-scale database, a user often wishes to synthesize instantiations of their own concepts (for example, their family, pets, or items). Can we teach a model to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Nupur Kumari , Bingliang Zhang , Richard Zhang , Eli Shechtman , Jun-Yan Zhu

Generative adversarial networks (GANs) are a recent approach to train generative models of data, which have been shown to work particularly well on image data. In the current paper we introduce a new model for texture synthesis based on GAN…

Computer Vision and Pattern Recognition · Computer Science 2017-09-11 Nikolay Jetchev , Urs Bergmann , Roland Vollgraf

Generating images according to natural language descriptions is a challenging task. Prior research has mainly focused to enhance the quality of generation by investigating the use of spatial attention and/or textual attention thereby…

Computer Vision and Pattern Recognition · Computer Science 2022-01-17 Henning Schulze , Dogucan Yaman , Alexander Waibel

Visual generative AI models often encounter challenges related to text-image alignment and reasoning limitations. This paper presents a novel method for selectively enhancing the signal at critical denoising steps, optimizing image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Paul Grimal , Hervé Le Borgne , Olivier Ferret

Deep generative models have shown impressive results in text-to-image synthesis. However, current text-to-image models often generate images that are inadequately aligned with text prompts. We propose a fine-tuning method for aligning such…

AI-based text-to-image models do not only excel at generating realistic images, they also give designers more and more fine-grained control over the image content. Consequently, these approaches have gathered increased attention within the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-30 Sebastian Hartwig , Dominik Engel , Leon Sick , Hannah Kniesel , Tristan Payer , Poonam Poonam , Michael Glöckler , Alex Bäuerle , Timo Ropinski

Text-to-image generation models represent the next step of evolution in image synthesis, offering a natural way to achieve flexible yet fine-grained control over the result. One emerging area of research is the fast adaptation of large…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Anton Voronov , Mikhail Khoroshikh , Artem Babenko , Max Ryabinin

Text-to-image synthesis has made encouraging progress and attracted lots of public attention recently. However, popular evaluation metrics in this area, like the Inception Score and Fr'echet Inception Distance, incur several issues. First…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Qi Chen , Chaorui Deng , Zixiong Huang , Bowen Zhang , Mingkui Tan , Qi Wu

Text-to-image synthesis refers to generating an image from a given text description, the key goal of which lies in photo realism and semantic consistency. Previous methods usually generate an initial image with sentence embedding and then…

Computer Vision and Pattern Recognition · Computer Science 2021-08-30 Shulan Ruan , Yong Zhang , Kun Zhang , Yanbo Fan , Fan Tang , Qi Liu , Enhong Chen

Customizing pre-trained text-to-image generation model has attracted massive research interest recently, due to its huge potential in real-world applications. Although existing methods are able to generate creative content for a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Yufan Zhou , Ruiyi Zhang , Jiuxiang Gu , Tong Sun

Text-to-image diffusion models have demonstrated remarkable capabilities in transforming textual prompts into coherent images, yet the computational cost of their inference remains a persistent challenge. To address this issue, we present…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Yanwu Xu , Yang Zhao , Zhisheng Xiao , Tingbo Hou

Content creation, central to applications such as virtual reality, can be a tedious and time-consuming. Recent image synthesis methods simplify this task by offering tools to generate new views from as little as a single input image, or by…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Tewodros Habtegebrial , Varun Jampani , Orazio Gallo , Didier Stricker

Text-to-image synthesis aims to generate a photo-realistic and semantic consistent image from a specific text description. The images synthesized by off-the-shelf models usually contain limited components compared with the corresponding…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Qingrong Cheng , Keyu Wen , Xiaodong Gu

Powerful generative adversarial networks (GAN) have been developed to automatically synthesize realistic images from text. However, most existing tasks are limited to generating simple images such as flowers from captions. In this work, we…

Machine Learning · Computer Science 2019-11-27 Osaid Rehman Nasir , Shailesh Kumar Jha , Manraj Singh Grover , Yi Yu , Ajit Kumar , Rajiv Ratn Shah

We review research on generating visual data from text from the angle of "cross-modal generation." This point of view allows us to draw parallels between various methods geared towards working on input text and producing visual output,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Maciej Żelaszczyk , Jacek Mańdziuk

Recently, some works have tried to combine diffusion and Generative Adversarial Networks (GANs) to alleviate the computational cost of the iterative denoising inference in Diffusion Models (DMs). However, existing works in this line suffer…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Yihong Luo , Xiaolong Chen , Xinghua Qu , Tianyang Hu , Jing Tang

Text-to-image generation requires large amount of training data to synthesizing high-quality images. For augmenting training data, previous methods rely on data interpolations like cropping, flipping, and mixing up, which fail to introduce…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Senmao Ye , Fei Liu

Proposed are alternative generator architectures for Boundary Equilibrium Generative Adversarial Networks, motivated by Learning from Simulated and Unsupervised Images through Adversarial Training. It disentangles the need for a noise-based…

Computer Vision and Pattern Recognition · Computer Science 2021-08-29 Alex Nasser