中文
相关论文

相关论文: Re-Imagen: Retrieval-Augmented Text-to-Image Gener…

200 篇论文

As a challenging task, text-to-image generation aims to generate photo-realistic and semantically consistent images according to the given text descriptions. Existing methods mainly extract the text information from only one sentence to…

计算机视觉与模式识别 · 计算机科学 2022-09-29 Xintian Wu , Hanbin Zhao , Liangli Zheng , Shouhong Ding , Xi Li

While recent text-to-image models can generate photorealistic images from text prompts that reflect detailed instructions, they still face significant challenges in accurately rendering words in the image. In this paper, we propose to…

计算机视觉与模式识别 · 计算机科学 2025-05-01 Wataru Shimoda , Naoto Inoue , Daichi Haraguchi , Hayato Mitani , Seiichi Uchida , Kota Yamaguchi

Deep generative models have shown impressive results in text-to-image synthesis. However, current text-to-image models often generate images that are inadequately aligned with text prompts. We propose a fine-tuning method for aligning such…

Text-to-Image (TTI) generative models have shown great progress in the past few years in terms of their ability to generate complex and high-quality imagery. At the same time, these models have been shown to suffer from harmful biases,…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Aditya Chinchure , Pushkar Shukla , Gaurav Bhatt , Kiri Salij , Kartik Hosanagar , Leonid Sigal , Matthew Turk

We present Qwen-Image, an image generation foundation model in the Qwen series that achieves significant advances in complex text rendering and precise image editing. To address the challenges of complex text rendering, we design a…

Large-scale text-to-image generative models have been a revolutionary breakthrough in the evolution of generative AI, allowing us to synthesize diverse images that convey highly complex visual concepts. However, a pivotal challenge in…

计算机视觉与模式识别 · 计算机科学 2022-11-24 Narek Tumanyan , Michal Geyer , Shai Bagon , Tali Dekel

Article comprehension is an important challenge in natural language processing with many applications such as article generation or image-to-article retrieval. Prior work typically encodes all tokens in articles uniformly using pretrained…

计算与语言 · 计算机科学 2023-10-24 Zhongping Zhang , Yiwen Gu , Bryan A. Plummer

Although contemporary text-to-image generation models have achieved remarkable breakthroughs in producing visually appealing images, their capacity to generate precise and flexible typographic elements, especially non-Latin alphabets,…

计算机视觉与模式识别 · 计算机科学 2025-04-29 Haofan Wang , Yujia Xu , Yimeng Li , Junchen Li , Chaowei Zhang , Jing Wang , Kejia Yang , Zhibo Chen

Diffusion models enable high-quality and diverse visual content synthesis. However, they struggle to generate rare or unseen concepts. To address this challenge, we explore the usage of Retrieval-Augmented Generation (RAG) with image…

计算机视觉与模式识别 · 计算机科学 2026-02-10 Rotem Shalev-Arkushin , Rinon Gal , Amit H. Bermano , Ohad Fried

Text-to-image synthesis is the task of generating images from text descriptions. Image generation, by itself, is a challenging task. When we combine image generation and text, we bring complexity to a new level: we need to combine data from…

机器学习 · 计算机科学 2020-04-27 Douglas M. Souza , Jônatas Wehrmann , Duncan D. Ruiz

Generating desired images conditioned on given text descriptions has received lots of attention. Recently, diffusion models and autoregressive models have demonstrated their outstanding expressivity and gradually replaced GAN as the favored…

计算机视觉与模式识别 · 计算机科学 2025-01-03 Xiaozhou You , Jian Zhang

We propose a new paradigm to automatically generate training data with accurate labels at scale using the text-to-image synthesis frameworks (e.g., DALL-E, Stable Diffusion, etc.). The proposed approach1 decouples training data generation…

计算机视觉与模式识别 · 计算机科学 2023-09-13 Yunhao Ge , Jiashu Xu , Brian Nlong Zhao , Neel Joshi , Laurent Itti , Vibhav Vineet

Explanatory images play a pivotal role in accessible and easy-to-read (E2R) texts. However, the images available in online databases are not tailored toward the respective texts, and the creation of customized images is expensive. In this…

计算机视觉与模式识别 · 计算机科学 2024-10-07 Miriam Anschütz , Tringa Sylaj , Georg Groh

Plain text has become a prevalent interface for text-to-image synthesis. However, its limited customization options hinder users from accurately describing desired outputs. For example, plain text makes it hard to specify continuous…

计算机视觉与模式识别 · 计算机科学 2025-01-16 Songwei Ge , Taesung Park , Jun-Yan Zhu , Jia-Bin Huang

General text-to-image models bring revolutionary innovation to the fields of arts, design, and media. However, when applied to garment generation, even the state-of-the-art text-to-image models suffer from fine-grained semantic…

计算机视觉与模式识别 · 计算机科学 2024-08-26 Shiyue Zhang , Zheng Chong , Xujie Zhang , Hanhui Li , Yuhao Cheng , Yiqiang Yan , Xiaodan Liang

Text-to-image (T2I) models have achieved remarkable progress, yet they continue to struggle with complex prompts that require simultaneously handling multiple objects, relations, and attributes. Existing inference-time strategies, such as…

计算机视觉与模式识别 · 计算机科学 2026-01-22 Shantanu Jaiswal , Mihir Prabhudesai , Nikash Bhardwaj , Zheyang Qin , Amir Zadeh , Chuan Li , Katerina Fragkiadaki , Deepak Pathak

Text-to-image generation has recently emerged as a viable alternative to text-to-image retrieval, driven by the visually impressive results of generative diffusion models. Although query performance prediction is an active research topic in…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Eduard Poesina , Adriana Valentina Costache , Adrian-Gabriel Chifu , Josiane Mothe , Radu Tudor Ionescu

Text-to-image generative models often present issues regarding fairness with respect to certain sensitive attributes, such as gender or skin tone. This study aims to reproduce the results presented in "ITI-GEN: Inclusive Text-to-Image…

计算机视觉与模式识别 · 计算机科学 2024-07-30 Daniel Gallo Fernández , Răzvan-Andrei Matisan , Alejandro Monroy Muñoz , Janusz Partyka

When humans read a specific text, they often visualize the corresponding images, and we hope that computers can do the same. Text-to-image synthesis (T2I), which focuses on generating high-quality images from textual descriptions, has…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Nonghai Zhang , Hao Tang

Text-to-image generative models excel in creating images from text but struggle with ensuring alignment and consistency between outputs and prompts. This paper introduces TextMatch, a novel framework that leverages multimodal optimization…

计算机视觉与模式识别 · 计算机科学 2025-01-28 Yucong Luo , Mingyue Cheng , Jie Ouyang , Xiaoyu Tao , Qi Liu