中文
相关论文

相关论文: Personalizing Text-to-Image Generation via Aesthet…

200 篇论文

Recent advances in text-to-image diffusion models have enabled the generation of diverse and high-quality images. While impressive, the images often fall short of depicting subtle details and are susceptible to errors due to ambiguity in…

计算机视觉与模式识别 · 计算机科学 2025-01-13 Idan Schwartz , Vésteinn Snæbjarnarson , Hila Chefer , Ryan Cotterell , Serge Belongie , Lior Wolf , Sagie Benaim

Diffusion models emerged as a leading approach in text-to-image generation, producing high-quality images from textual descriptions. However, attempting to achieve detailed control to get a desired image solely through text remains a…

计算机视觉与模式识别 · 计算机科学 2026-02-12 Pablo Domingo-Gregorio , Javier Ruiz-Hidalgo

While 2D diffusion models have achieved remarkable success in identity-preserving personalization, extending this capability to 3D assets remains a significant challenge due to the complexities of multi-view consistency and spatial control.…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Jinxin Ai , Matthias Nießner , Ziya Erkoç

The strength of modern generative models lies in their ability to be controlled through text-based prompts. Typical "hard" prompts are made from interpretable words and tokens, and must be hand-crafted by humans. There are also "soft"…

机器学习 · 计算机科学 2023-06-02 Yuxin Wen , Neel Jain , John Kirchenbauer , Micah Goldblum , Jonas Geiping , Tom Goldstein

Computing the gradient of an image is a common step in computer vision pipelines. The image gradient quantifies the magnitude and direction of edges in an image and is used in creating features for downstream machine learning tasks.…

计算机视觉与模式识别 · 计算机科学 2019-06-20 Shouvik Mani

Personalizing text-to-image diffusion models is crucial for adapting the pre-trained models to specific target concepts, enabling diverse image generation. However, fine-tuning with few images introduces an inherent trade-off between…

计算机视觉与模式识别 · 计算机科学 2025-08-04 Sunghyun Park , Seokeon Choi , Hyoungwoo Park , Sungrack Yun

Text-to-image diffusion models have shown remarkable capabilities of generating high-quality images closely aligned with textual inputs. However, the effectiveness of text guidance heavily relies on the CLIP text encoder, which is trained…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Zexi Jia , Chuanwei Huang , Hongyan Fei , Yeshuang Zhu , Zhiqiang Yuan , Jinchao Zhang , Jie Zhou

Customizing pre-trained text-to-image generation model has attracted massive research interest recently, due to its huge potential in real-world applications. Although existing methods are able to generate creative content for a novel…

计算机视觉与模式识别 · 计算机科学 2024-05-10 Yufan Zhou , Ruiyi Zhang , Jiuxiang Gu , Tong Sun

Large text-guided diffusion models, such as DALLE-2, are able to generate stunning photorealistic images given natural language descriptions. While such models are highly flexible, they struggle to understand the composition of certain…

计算机视觉与模式识别 · 计算机科学 2023-01-18 Nan Liu , Shuang Li , Yilun Du , Antonio Torralba , Joshua B. Tenenbaum

In creativity support and computational co-creativity contexts, the task of discovering appropriate prompts for use with text-to-image generative models remains difficult. In many cases the creator wishes to evoke a certain impression with…

人工智能 · 计算机科学 2023-02-21 Francisco Ibarrola , Rohan Lulham , Kazjon Grace

We present a novel algorithm for text-driven image-to-image translation based on a pretrained text-to-image diffusion model. Our method aims to generate a target image by selectively editing the regions of interest in a source image,…

计算机视觉与模式识别 · 计算机科学 2023-11-21 Hyunsoo Lee , Minsoo Kang , Bohyung Han

Designing complex 3D scenes has been a tedious, manual process requiring domain expertise. Emerging text-to-3D generative models show great promise for making this task more intuitive, but existing approaches are limited to object-level…

计算机视觉与模式识别 · 计算机科学 2023-03-24 Ryan Po , Gordon Wetzstein

Image generation has recently seen tremendous advances, with diffusion models allowing to synthesize convincing images for a large variety of text prompts. In this article, we propose DiffEdit, a method to take advantage of text-conditioned…

计算机视觉与模式识别 · 计算机科学 2022-10-21 Guillaume Couairon , Jakob Verbeek , Holger Schwenk , Matthieu Cord

While score based generative models, or diffusion models, have found success in image synthesis, they are often coupled with text data or image label to be able to manipulate and conditionally generate images. Even though manipulation of…

计算机视觉与模式识别 · 计算机科学 2023-02-07 Sandesh Ghimire , Armand Comas , Davin Hill , Aria Masoomi , Octavia Camps , Jennifer Dy

Recent text-to-image diffusion models can generate striking visuals from text prompts, but they often fail to maintain subject consistency across generations and contexts. One major limitation of current fine-tuning approaches is the…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Gordon Chen , Ziqi Huang , Cheston Tan , Ziwei Liu

Latent diffusion models excel at producing high-quality images from text. Yet, concerns appear about the lack of diversity in the generated imagery. To tackle this, we introduce Diverse Diffusion, a method for boosting image diversity…

计算机视觉与模式识别 · 计算机科学 2023-10-20 Mariia Zameshina , Olivier Teytaud , Laurent Najman

The excellent generative capabilities of text-to-image diffusion models suggest they learn informative representations of image-text data. However, what knowledge their representations capture is not fully understood, and they have not been…

计算机视觉与模式识别 · 计算机科学 2023-09-07 Kevin Clark , Priyank Jaini

Taking advantage of the many recent advances in deep learning, text-to-image generative models currently have the merit of attracting the general public attention. Two of these models, DALL-E 2 and Imagen, have demonstrated that highly…

计算机视觉与模式识别 · 计算机科学 2022-09-23 Robin Zbinden

For an artist or a graphic designer, the spatial layout of a scene is a critical design choice. However, existing text-to-image diffusion models provide limited support for incorporating spatial information. This paper introduces Composite…

计算机视觉与模式识别 · 计算机科学 2023-07-27 Vikram Jamwal , Ramaneswaran S

Large, text-conditioned generative diffusion models have recently gained a lot of attention for their impressive performance in generating high-fidelity images from text alone. However, achieving high-quality results is almost unfeasible in…

计算机视觉与模式识别 · 计算机科学 2023-06-01 Manuel Brack , Patrick Schramowski , Felix Friedrich , Dominik Hintersdorf , Kristian Kersting