中文
相关论文

相关论文: Boosting Text-to-Image Diffusion Models via Core T…

200 篇论文

Text-to-image diffusion models enable high-quality image generation but are computationally expensive. While prior work optimizes per-inference efficiency, we explore an orthogonal approach: reducing redundancy across correlated prompts.…

计算机视觉与模式识别 · 计算机科学 2025-08-29 Dale Decatur , Thibault Groueix , Wang Yifan , Rana Hanocka , Vladimir Kim , Matheus Gadelha

Large-scale text-to-image models have demonstrated amazing ability to synthesize diverse and high-fidelity images. However, these models are often violated by several limitations. Firstly, they require the user to provide precise and…

计算机视觉与模式识别 · 计算机科学 2023-05-09 Yupei Lin , Sen Zhang , Xiaojun Yang , Xiao Wang , Yukai Shi

Previous text-to-image diffusion models typically employ supervised fine-tuning (SFT) to enhance pre-trained base models. However, this approach primarily minimizes the loss of mean squared error (MSE) at the pixel level, neglecting the…

计算机视觉与模式识别 · 计算机科学 2025-04-22 Liang Peng , Boxi Wu , Haoran Cheng , Yibo Zhao , Xiaofei He

Recent advances in text-to-image diffusion models have achieved remarkable success in generating high-quality, realistic images from textual descriptions. However, these approaches have faced challenges in precisely aligning the generated…

计算机视觉与模式识别 · 计算机科学 2024-10-25 Zutao Jiang , Guian Fang , Jianhua Han , Guansong Lu , Hang Xu , Shengcai Liao , Xiaojun Chang , Xiaodan Liang

Advanced diffusion models have made notable progress in text-to-image compositional generation. However, it is still a challenge for existing models to achieve text-image alignment when confronted with complex text prompts. In this work, we…

计算机视觉与模式识别 · 计算机科学 2025-05-07 Chang Xie , Chenyi Zhuang , Pan Gao

Diffusion models have emerged as a powerful paradigm for generation, obtaining strong performance in various continuous domains. However, applying continuous diffusion models to natural language remains challenging due to its discrete…

计算与语言 · 计算机科学 2024-02-22 Rabeeh Karimi Mahabadi , Hamish Ivison , Jaesung Tae , James Henderson , Iz Beltagy , Matthew E. Peters , Arman Cohan

The advent of open-source AI communities has produced a cornucopia of powerful text-guided diffusion models that are trained on various datasets. While few explorations have been conducted on ensembling such models to combine their…

计算机视觉与模式识别 · 计算机科学 2023-07-20 Jing Zhao , Heliang Zheng , Chaoyue Wang , Long Lan , Wenjing Yang

The progress in the generation of synthetic images has made it crucial to assess their quality. While several metrics have been proposed to assess the rendering of images, it is crucial for Text-to-Image (T2I) models, which generate images…

计算机视觉与模式识别 · 计算机科学 2024-01-04 Paul Grimal , Hervé Le Borgne , Olivier Ferret , Julien Tourille

Real-world text image super-resolution aims to restore overall visual quality and text legibility in images suffering from diverse degradations and text distortions. However, the scarcity of text image data in existing datasets results in…

计算机视觉与模式识别 · 计算机科学 2026-01-27 Haodong He , Xin Zhan , Yancheng Bai , Rui Lan , Lei Sun , Xiangxiang Chu

Deep Text-to-Image Synthesis (TIS) models such as Stable Diffusion have recently gained significant popularity for creative Text-to-image generation. Yet, for domain-specific scenarios, tuning-free Text-guided Image Editing (TIE) is of…

计算机视觉与模式识别 · 计算机科学 2024-03-07 Bingyan Liu , Chengyu Wang , Tingfeng Cao , Kui Jia , Jun Huang

Subsampling is commonly used to mitigate costs associated with data acquisition, such as time or energy requirements, motivating the development of algorithms for estimating the fully-sampled signal of interest $x$ from partially observed…

机器学习 · 计算机科学 2025-04-23 Oisin Nolan , Tristan S. W. Stevens , Wessel L. van Nierop , Ruud J. G. van Sloun

While text-driven diffusion models demonstrate remarkable performance in image editing, the critical components of their text embeddings remain underexplored. The ambiguity and entanglement of these embeddings pose challenges for precise…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Yitong Yang , Yinglin Wang , Tian Zhang , Jing Wang , Shuting He

Diffusion models are well known for their ability to generate a high-fidelity image for an input prompt through an iterative denoising process. Unfortunately, the high fidelity also comes at a high computational cost due the inherently…

计算机视觉与模式识别 · 计算机科学 2025-06-24 Qinchan Li , Kenneth Chen , Changyue Su , Wittawat Jitkrittum , Qi Sun , Patsorn Sangkloy

Stable diffusion, a generative model used in text-to-image synthesis, frequently encounters resolution-induced composition problems when generating images of varying sizes. This issue primarily stems from the model being trained on pairs of…

计算机视觉与模式识别 · 计算机科学 2023-09-12 Qingping Zheng , Yuanfan Guo , Jiankang Deng , Jianhua Han , Ying Li , Songcen Xu , Hang Xu

Recent advancements in diffusion-based text-to-image (T2I) models have enabled the generation of high-quality and photorealistic images from text. However, they often exhibit societal biases related to gender, race, and socioeconomic…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Jeonghoon Park , Juyoung Lee , Chaeyeon Chung , Jaeseong Lee , Jaegul Choo , Jindong Gu

Recent advancements in text-to-image diffusion models have demonstrated their remarkable capability to generate high-quality images from textual prompts. However, increasing research indicates that these models memorize and replicate images…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Jie Ren , Yaxin Li , Shenglai Zeng , Han Xu , Lingjuan Lyu , Yue Xing , Jiliang Tang

Unsupervised learning of keypoints and landmarks has seen significant progress with the help of modern neural network architectures, but performance is yet to match the supervised counterpart, making their practicability questionable. We…

计算机视觉与模式识别 · 计算机科学 2024-05-24 Eric Hedlin , Gopal Sharma , Shweta Mahajan , Xingzhe He , Hossam Isack , Abhishek Kar Helge Rhodin , Andrea Tagliasacchi , Kwang Moo Yi

In this paper, we propose an Attentional Generative Adversarial Network (AttnGAN) that allows attention-driven, multi-stage refinement for fine-grained text-to-image generation. With a novel attentional generative network, the AttnGAN can…

计算机视觉与模式识别 · 计算机科学 2017-11-30 Tao Xu , Pengchuan Zhang , Qiuyuan Huang , Han Zhang , Zhe Gan , Xiaolei Huang , Xiaodong He

As a challenging task, text-to-image generation aims to generate photo-realistic and semantically consistent images according to the given text descriptions. Existing methods mainly extract the text information from only one sentence to…

计算机视觉与模式识别 · 计算机科学 2022-09-29 Xintian Wu , Hanbin Zhao , Liangli Zheng , Shouhong Ding , Xi Li

Text-to-image generation has recently seen remarkable success, granting users with the ability to create high-quality images through the use of text. However, contemporary methods face challenges in capturing the precise semantics conveyed…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Shay Shomer-Chai , Wenxuan Peng , Bharath Hariharan , Hadar Averbuch-Elor