中文
相关论文

相关论文: Wuerstchen: An Efficient Architecture for Large-Sc…

200 篇论文

Diffusion models have emerged as frontrunners in text-to-image generation, but their fixed image resolution during training often leads to challenges in high-resolution image generation, such as semantic deviations and object replication.…

计算机视觉与模式识别 · 计算机科学 2024-11-19 Haoning Wu , Shaocheng Shen , Qiang Hu , Xiaoyun Zhang , Ya Zhang , Yanfeng Wang

Text-to-image diffusion models have remarkably excelled in producing diverse, high-quality, and photo-realistic images. This advancement has spurred a growing interest in incorporating specific identities into generated content. Most…

计算机视觉与模式识别 · 计算机科学 2023-11-30 Xiaoming Li , Xinyu Hou , Chen Change Loy

Layout-to-image generation refers to the task of synthesizing photo-realistic images based on semantic layouts. In this paper, we propose LayoutDiffuse that adapts a foundational diffusion model pretrained on large-scale image or text-image…

计算机视觉与模式识别 · 计算机科学 2023-02-20 Jiaxin Cheng , Xiao Liang , Xingjian Shi , Tong He , Tianjun Xiao , Mu Li

Diffusion models have revolutionized text-to-image generation, but their real-world applications are hampered by the extensive time needed for hundreds of diffusion steps. Although progressive distillation has been proposed to speed up…

计算机视觉与模式识别 · 计算机科学 2023-12-01 Yifan Zhang , Bryan Hooi

In this paper, we introduce LDGen, a novel method for integrating large language models (LLMs) into existing text-to-image diffusion models while minimizing computational demands. Traditional text encoders, such as CLIP and T5, exhibit…

计算机视觉与模式识别 · 计算机科学 2025-02-26 Pengzhi Li , Pengfei Yu , Zide Liu , Wei He , Xuhao Pan , Xudong Rao , Tao Wei , Wei Chen

Diffusion models (DMs) have recently gained attention with state-of-the-art performance in text-to-image synthesis. Abiding by the tradition in deep learning, DMs are trained and evaluated on the images with fixed sizes. However, users are…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Zhiyu Jin , Xuli Shen , Bin Li , Xiangyang Xue

The most advanced text-to-image (T2I) models require significant training costs (e.g., millions of GPU hours), seriously hindering the fundamental innovation for the AIGC community while increasing CO2 emissions. This paper introduces…

计算机视觉与模式识别 · 计算机科学 2024-01-01 Junsong Chen , Jincheng Yu , Chongjian Ge , Lewei Yao , Enze Xie , Yue Wu , Zhongdao Wang , James Kwok , Ping Luo , Huchuan Lu , Zhenguo Li

As scaling laws in generative AI push performance, they also simultaneously concentrate the development of these models among actors with large computational resources. With a focus on text-to-image (T2I) generative models, we aim to…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Vikash Sehwag , Xianghao Kong , Jingtao Li , Michael Spranger , Lingjuan Lyu

Flow matching and diffusion models have shown impressive results in text-to-image generation, producing photorealistic images through an iterative denoising process. A common strategy to speed up synthesis is to perform early denoising at…

计算机视觉与模式识别 · 计算机科学 2025-07-23 Jyun-Ze Tang , Chih-Fan Hsu , Jeng-Lin Li , Ming-Ching Chang , Wei-Chao Chen

As recent advances in large-scale Text-to-Image (T2I) diffusion models have yielded remarkable high-quality image generation, diverse downstream Image-to-Image (I2I) applications have emerged. Despite the impressive results achieved by…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Geonung Kim , Beomsu Kim , Eunhyeok Park , Sunghyun Cho

Diffusion models have revolutionized generative tasks, especially in the domain of text-to-image synthesis; however, their iterative denoising process demands substantial computational resources. In this paper, we present a novel…

计算机视觉与模式识别 · 计算机科学 2025-02-04 Xinle Cheng , Zhuoming Chen , Zhihao Jia

Diffusion models have shown unprecedented success in the task of text-to-image generation. While these models are capable of generating high-quality and realistic images, the complexity of sequential denoising has raised societal concerns…

计算机视觉与模式识别 · 计算机科学 2024-12-24 Qinchan Li , Kenneth Chen , Changyue Su , Qi Sun

While diffusion models have revolutionized text-to-image generation with their ability to synthesize realistic and diverse scenes, they continue to struggle to generate consistent and legible text within images. This shortcoming is commonly…

机器学习 · 计算机科学 2025-09-16 Tianyu Zhang , Xinyu Wang , Lu Li , Zhenghan Tai , Jijun Chi , Jingrui Tian , Hailin He , Suyuchen Wang

Visual synthesis has recently seen significant leaps in performance, largely due to breakthroughs in generative models. Diffusion models have been a key enabler, as they excel in image diversity. However, this comes at the cost of slow…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Johannes Schusterbauer , Ming Gui , Pingchuan Ma , Nick Stracke , Stefan A. Baumann , Vincent Tao Hu , Björn Ommer

Diffusion models have achieved success in high-fidelity data synthesis, yet their capacity for more complex, structured reasoning like text following tasks remains constrained. While advances in language models have leveraged strategies…

计算机视觉与模式识别 · 计算机科学 2026-04-29 Yuwei Sun , Yuxuan Yao , Hui Li , Siyu Zhu

We present a simple but effective training-free approach for text-driven image-to-image translation based on a pretrained text-to-image diffusion model. Our goal is to generate an image that aligns with the target task while preserving the…

计算机视觉与模式识别 · 计算机科学 2024-12-23 Hyunsoo Lee , Minsoo Kang , Bohyung Han

We present Stable Video Diffusion - a latent video diffusion model for high-resolution, state-of-the-art text-to-video and image-to-video generation. Recently, latent diffusion models trained for 2D image synthesis have been turned into…

Driven by the scalable diffusion models trained on large-scale datasets, text-to-image synthesis methods have shown compelling results. However, these models still fail to precisely follow the text prompt involving multiple objects,…

计算机视觉与模式识别 · 计算机科学 2023-12-06 Quynh Phung , Songwei Ge , Jia-Bin Huang

The development of generative models in the past decade has allowed for hyperrealistic data synthesis. While potentially beneficial, this synthetic data generation process has been relatively underexplored in cancer histopathology. One…

图像与视频处理 · 电气工程与系统科学 2024-12-10 Aakash Madhav Rao , Debayan Gupta

In the text-to-image generation field, recent remarkable progress in Stable Diffusion makes it possible to generate rich kinds of novel photorealistic images. However, current models still face misalignment issues (e.g., problematic spatial…

计算机视觉与模式识别 · 计算机科学 2023-08-15 Leigang Qu , Shengqiong Wu , Hao Fei , Liqiang Nie , Tat-Seng Chua