English
Related papers

Related papers: GILT: Generating Images from Long Text

200 papers

Generating a virtual try-on image from in-shop clothing images and a model person's snapshot is a challenging task because the human body and clothes have high flexibility in their shapes. In this paper, we develop a Virtual Try-on…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Shion Honda

Generating images from word descriptions is a challenging task. Generative adversarial networks(GANs) are shown to be able to generate realistic images of real-life objects. In this paper, we propose a new neural network architecture of…

Computer Vision and Pattern Recognition · Computer Science 2018-06-11 Xu Ouyang , Xi Zhang , Di Ma , Gady Agam

Text-to-image generation requires large amount of training data to synthesizing high-quality images. For augmenting training data, previous methods rely on data interpolations like cropping, flipping, and mixing up, which fail to introduce…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Senmao Ye , Fei Liu

We introduce a recipe for generating immersive 3D worlds from a single image by framing the task as an in-context learning problem for 2D inpainting models. This approach requires minimal training and uses existing generative models. Our…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Katja Schwarz , Denys Rozumnyi , Samuel Rota Bulò , Lorenzo Porzi , Peter Kontschieder

Although current image generation methods have reached impressive quality levels, they are still unable to produce plausible yet diverse images of handwritten words. On the contrary, when writing by hand, a great variability is observed…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Lei Kang , Pau Riba , Yaxing Wang , Marçal Rusiñol , Alicia Fornés , Mauricio Villegas

In this work we focus on the problem of image caption generation. We propose an extension of the long short term memory (LSTM) model, which we coin gLSTM for short. In particular, we add semantic information extracted from the image as…

Computer Vision and Pattern Recognition · Computer Science 2015-09-17 Xu Jia , Efstratios Gavves , Basura Fernando , Tinne Tuytelaars

The problem of generating textual descriptions for the visual data has gained research attention in the recent years. In contrast to that the problem of generating visual data from textual descriptions is still very challenging, because it…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Bulla Rajesh , Nandakishore Dusa , Mohammed Javed , Shiv Ram Dubey , P. Nagabhushan

Text-to-image models have made significant strides, producing impressive results in generating images from textual descriptions. However, creating a scalable pipeline for deploying these models in production remains a challenge. Achieving…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Parmida Atighehchian , Henry Wang , Andrei Kapustin , Boris Lerner , Tiancheng Jiang , Taylor Jensen , Negin Sokhandan

In this paper, we introduce the task of automatically generating text to describe the differences between two similar images. We collect a new dataset by crowd-sourcing difference descriptions for pairs of image frames extracted from…

Computation and Language · Computer Science 2018-09-03 Harsh Jhamtani , Taylor Berg-Kirkpatrick

Despite rapid advancements in the capabilities of generative models, pretrained text-to-image models still struggle in capturing the semantics conveyed by complex prompts that compound multiple objects and instance-level attributes.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Etai Sella , Yanir Kleiman , Hadar Averbuch-Elor

There has been a significant progress in text conditional image generation models. Recent advancements in this field depend not only on improvements in model structures, but also vast quantities of text-image paired datasets. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Seungdae Han , Joohee Kim

Current text recognition systems, including those for handwritten scripts and scene text, have relied heavily on image synthesis and augmentation, since it is difficult to realize real-world complexity and diversity through collecting and…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Yuanzhi Zhu , Zhaohai Li , Tianwei Wang , Mengchao He , Cong Yao

In this paper, we propose a novel way to interpret text information by extracting visual feature presentation from multiple high-resolution and photo-realistic synthetic images generated by Text-to-image Generative Adversarial Network (GAN)…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 Tao Hu , Chengjiang Long , Leheng Zhang , Chunxia Xiao

Creating engaging narratives from visual data is crucial for automated digital media consumption, assistive technologies, and interactive entertainment. This survey covers methodologies used in the generation of these narratives, focusing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Daniel A. P. Oliveira , Eugénio Ribeiro , David Martins de Matos

We introduce a large-scale dataset for instruction-guided vector image editing, consisting of over 270,000 pairs of SVG images paired with natural language edit instructions. Our dataset enables training and evaluation of models that modify…

Machine Learning · Computer Science 2025-06-23 Josef Kuchař , Marek Kadlčík , Michal Spiegel , Michal Štefánik

In many applications of computer graphics, art and design, it is desirable for a user to provide intuitive non-image input, such as text, sketch, stroke, graph or layout, and have a computer system automatically generate photo-realistic…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Yuan Xue , Yuan-Chen Guo , Han Zhang , Tao Xu , Song-Hai Zhang , Xiaolei Huang

Recent advancements in text-to-image generation models have excelled in creating diverse and realistic images. This success extends to food imagery, where various conditional inputs like cooking styles, ingredients, and recipes are…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Yuan Wang , Bin Zhu , Yanbin Hao , Chong-Wah Ngo , Yi Tan , Xiang Wang

In this paper, we describe a first publicly available fine-grained product recognition dataset based on leaflet images. Using advertisement leaflets, collected over several years from different European retailers, we provide a total of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Daniel Ladwig , Bianca Lamm , Janis Keuper

Research on food image understanding using recipe data has been a long-standing focus due to the diversity and complexity of the data. Moreover, food is inextricably linked to people's lives, making it a vital research area for practical…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Yuki Imajuku , Yoko Yamakata , Kiyoharu Aizawa

Food image classification models are crucial for dietary management applications because they reduce the burden of manual meal logging. However, most publicly available datasets for training such models rely on web-crawled images, which…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Mitsuki Watanabe , Sosuke Amano , Kiyoharu Aizawa , Yoko Yamakata