中文
相关论文

相关论文: PiCo: Enhancing Text-Image Alignment with Improved…

200 篇论文

Large-scale diffusion-based generative models have led to breakthroughs in text-conditioned high-resolution image synthesis. Starting from random noise, such text-to-image diffusion models gradually synthesize images in an iterative fashion…

Text-to-image diffusion models generate images by iteratively denoising random noise, conditioned on a prompt. While these models have enabled impressive progress in image generation, they often fail to accurately reflect all semantic…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Nicola Bernold , Moritz Vandenhirtz , Alice Bizeul , Julia E. Vogt

Recently, there have been significant improvements in the quality and performance of text-to-image generation, largely due to the impressive results attained by diffusion models. However, text-to-image diffusion models sometimes struggle to…

计算机视觉与模式识别 · 计算机科学 2025-03-06 Wonjun Kang , Kevin Galim , Hyung Il Koo , Nam Ik Cho

In recent years, large-scale pre-trained diffusion models have demonstrated their outstanding capabilities in image and video generation tasks. However, existing models tend to produce visual objects commonly found in the training dataset,…

计算机视觉与模式识别 · 计算机科学 2024-07-30 Changgu Chen , Libing Yang , Xiaoyan Yang , Lianggangxu Chen , Gaoqi He , CHangbo Wang , Yang Li

Learning from feedback has been shown to enhance the alignment between text prompts and images in text-to-image diffusion models. However, due to the lack of focus in feedback content, especially regarding the object type and quantity,…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Xuexiang Niu , Jinping Tang , Lei Wang , Ge Zhu

Text-to-image diffusion models have advanced towards more controllable generation via supporting various additional conditions (e.g.,depth map, bounding box) beyond text. However, these models are learned based on the premise of perfect…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Luozhou Wang , Guibao Shen , Wenhang Ge , Guangyong Chen , Yijun Li , Ying-cong Chen

Recent work uses reinforcement learning (RL) to fine-tune text-to-image diffusion models, improving text-image alignment and sample quality. However, existing approaches introduce unnecessary complexity: they cache the full sampling…

机器学习 · 计算机科学 2025-07-02 Yanting Miao , William Loh , Pacal Poupart , Suraj Kothawade

Diffusion models excel at image generation. Recent studies have shown that these models not only generate high-quality images but also encode text-image alignment information through attention maps or loss functions. This information is…

计算机视觉与模式识别 · 计算机科学 2025-06-12 Qin Zhou , Zhiyang Zhang , Jinglong Wang , Xiaobin Li , Jing Zhang , Qian Yu , Lu Sheng , Dong Xu

Text-to-image diffusion models have made significant progress in generating naturalistic images from textual inputs, and demonstrate the capacity to learn and represent complex visual-semantic relationships. While these diffusion models…

计算机视觉与模式识别 · 计算机科学 2024-11-18 Rushikesh Zawar , Shaurya Dewan , Prakanshul Saxena , Yingshan Chang , Andrew Luo , Yonatan Bisk

Text-to-image diffusion models generate images by gradually converting white Gaussian noise into a natural image. White Gaussian noise is well suited for producing diverse outputs from a single text prompt due to its absence of structure.…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Nadav Z. Cohen , Ofir Abramovich , Ariel Shamir

In this paper, we point out that suboptimal noise-data mapping leads to slow training of diffusion models. During diffusion training, current methods diffuse each image across the entire noise space, resulting in a mixture of all images at…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Yiheng Li , Heyang Jiang , Akio Kodaira , Masayoshi Tomizuka , Kurt Keutzer , Chenfeng Xu

Despite recent advancements in text-to-image models, achieving semantically accurate images in text-to-image diffusion models is a persistent challenge. While existing initial latent optimization methods have demonstrated impressive…

计算机视觉与模式识别 · 计算机科学 2024-11-27 Aravindan Sundaram , Ujjayan Pal , Abhimanyu Chauhan , Aishwarya Agarwal , Srikrishna Karanam

Text-to-image diffusion models have demonstrated remarkable capability in generating realistic images from arbitrary text prompts. However, they often produce inconsistent results for compositional prompts such as "two dogs" or "a penguin…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Shuangqi Li , Hieu Le , Jingyi Xu , Mathieu Salzmann

Recent advancements in text-guided diffusion models have unlocked powerful image manipulation capabilities. However, applying these methods to real images necessitates the inversion of the images into the domain of the pretrained diffusion…

计算机视觉与模式识别 · 计算机科学 2024-03-22 Daniel Garibi , Or Patashnik , Andrey Voynov , Hadar Averbuch-Elor , Daniel Cohen-Or

We are witnessing a revolution in conditional image synthesis with the recent success of large scale text-to-image generation methods. This success also opens up new opportunities in controlling the generation and editing process using…

计算机视觉与模式识别 · 计算机科学 2024-05-03 Burak Can Biner , Farrin Marouf Sofian , Umur Berkay Karakaş , Duygu Ceylan , Erkut Erdem , Aykut Erdem

Text-to-image diffusion has attracted vast attention due to its impressive image-generation capabilities. However, when it comes to human-centric text-to-image generation, particularly in the context of faces and hands, the results often…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Jie Zhu , Yixiong Chen , Mingyu Ding , Ping Luo , Leye Wang , Jingdong Wang

Diffusion models have gained increasing attention for their impressive generation abilities but currently struggle with rendering accurate and coherent text. To address this issue, we introduce TextDiffuser, focusing on generating images…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Jingye Chen , Yupan Huang , Tengchao Lv , Lei Cui , Qifeng Chen , Furu Wei

Diffusion models have emerged as a promising approach for text generation, with recent works falling into two main categories: discrete and continuous diffusion models. Discrete diffusion models apply token corruption independently using…

计算与语言 · 计算机科学 2025-05-29 Bocheng Li , Zhujin Gao , Linli Xu

Building on recent advances in image generation, we present a fully data-driven approach to rendering markup into images. The approach is based on diffusion models, which parameterize the distribution of data using a sequence of denoising…

机器学习 · 计算机科学 2022-10-12 Yuntian Deng , Noriyuki Kojima , Alexander M. Rush

Diffusion-based text-to-image personalization have achieved great success in generating subjects specified by users among various contexts. Even though, existing finetuning-based methods still suffer from model overfitting, which greatly…

计算机视觉与模式识别 · 计算机科学 2024-01-31 Henglei Lv , Jiayu Xiao , Liang Li , Qingming Huang