中文
相关论文

相关论文: Improving Diffusion-Based Image Editing Faithfulne…

200 篇论文

Text-to-image diffusion models have recently received increasing interest for their astonishing ability to produce high-fidelity images from solely text inputs. Subsequent research efforts aim to exploit and apply their capabilities to real…

计算机视觉与模式识别 · 计算机科学 2024-06-27 Manuel Brack , Felix Friedrich , Katharina Kornmeier , Linoy Tsaban , Patrick Schramowski , Kristian Kersting , Apolinário Passos

Ensuring precise multimodal alignment between diffusion-generated images and input prompts has been a long-standing challenge. Earlier works finetune diffusion weight using high-quality preference data, which tends to be limited and…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Jiayi Guo , Chuanhao Yan , Xingqian Xu , Yulin Wang , Kai Wang , Gao Huang , Humphrey Shi

The colorization of grayscale images is a complex and subjective task with significant challenges. Despite recent progress in employing large-scale datasets with deep neural networks, difficulties with controllability and visual quality…

计算机视觉与模式识别 · 计算机科学 2023-12-08 Nir Zabari , Aharon Azulay , Alexey Gorkor , Tavi Halperin , Ohad Fried

We present Readout Guidance, a method for controlling text-to-image diffusion models with learned signals. Readout Guidance uses readout heads, lightweight networks trained to extract signals from the features of a pre-trained, frozen…

计算机视觉与模式识别 · 计算机科学 2024-04-04 Grace Luo , Trevor Darrell , Oliver Wang , Dan B Goldman , Aleksander Holynski

Centred on content modification and style preservation, Scene Text Editing (STE) remains a challenging task despite considerable progress in text-to-image synthesis and text-driven image manipulation recently. GAN-based STE methods…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Weichao Zeng , Yan Shu , Zhenhang Li , Dongbao Yang , Yu Zhou

Precise image editing with text-to-image models has attracted increasing interest due to their remarkable generative capabilities and user-friendly nature. However, such attempts face the pivotal challenge of misalignment between the…

计算机视觉与模式识别 · 计算机科学 2024-08-14 Wei Wu , Qingnan Fan , Shuai Qin , Hong Gu , Ruoyu Zhao , Antoni B. Chan

Despite the ability of existing large-scale text-to-image (T2I) models to generate high-quality images from detailed textual descriptions, they often lack the ability to precisely edit the generated or real images. In this paper, we propose…

计算机视觉与模式识别 · 计算机科学 2023-11-21 Chong Mou , Xintao Wang , Jiechong Song , Ying Shan , Jian Zhang

Recently, image editing based on Diffusion-in-Transformer models has undergone rapid development. However, existing editing methods often lack effective control over the degree of editing, limiting their ability to achieve more customized…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Xuanpu Zhang , Xuesong Niu , Ruidong Chen , Dan Song , Jianhao Zeng , Penghui Du , Haoxiang Cao , Kai Wu , An-an Liu

While Classifier-Free Guidance (CFG) has become standard for improving sample fidelity in conditional diffusion models, it can harm diversity and induce memorization by applying constant guidance regardless of whether a particular sample…

计算机视觉与模式识别 · 计算机科学 2025-10-10 Felix Koulischer , Florian Handke , Johannes Deleu , Thomas Demeester , Luca Ambrogioni

Recent works have explored text-guided image editing using diffusion models and generated edited images based on text prompts. However, the models struggle to accurately locate the regions to be edited and faithfully perform precise edits.…

计算机视觉与模式识别 · 计算机科学 2023-05-30 Qian Wang , Biao Zhang , Michael Birsak , Peter Wonka

Recent advancements in Text-to-Image (T2I) diffusion models have demonstrated impressive success in generating high-quality images with zero-shot generalization capabilities. Yet, current models struggle to closely adhere to prompt…

计算机视觉与模式识别 · 计算机科学 2024-01-31 Hyun Kang , Dohae Lee , Myungjin Shin , In-Kwon Lee

The rapid advancement of pretrained text-driven diffusion models has significantly enriched applications in image generation and editing. However, as the demand for personalized content editing increases, new challenges emerge especially…

计算机视觉与模式识别 · 计算机科学 2025-03-07 Rui Jiang , Xinghe Fu , Guangcong Zheng , Teng Li , Taiping Yao , Xi Li

Recent advancements in diffusion models have notably improved the perceptual quality of generated images in text-to-image synthesis tasks. However, diffusion models often struggle to produce images that accurately reflect the intended…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Yang Zhang , Teoh Tze Tzun , Lim Wei Hern , Tiviatis Sim , Kenji Kawaguchi

Recent text-to-image diffusion models can generate striking visuals from text prompts, but they often fail to maintain subject consistency across generations and contexts. One major limitation of current fine-tuning approaches is the…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Gordon Chen , Ziqi Huang , Cheston Tan , Ziwei Liu

With deeper exploration of diffusion model, developments in the field of image generation have triggered a boom in image creation. As the quality of base-model generated images continues to improve, so does the demand for further…

图形学 · 计算机科学 2025-04-21 Jia Wang , Jie Hu , Xiaoqi Ma , Hanghang Ma , Xiaoming Wei , Enhua Wu

Image data augmentation constitutes a critical methodology in modern computer vision tasks, since it can facilitate towards enhancing the diversity and quality of training datasets; thereby, improving the performance and robustness of…

We introduce SeedEdit, a diffusion model that is able to revise a given image with any text prompt. In our perspective, the key to such a task is to obtain an optimal balance between maintaining the original image, i.e. image…

计算机视觉与模式识别 · 计算机科学 2024-11-12 Yichun Shi , Peng Wang , Weilin Huang

With the rise of large, publicly-available text-to-image diffusion models, text-guided real image editing has garnered much research attention recently. Existing methods tend to either rely on some form of per-instance or per-task…

计算机视觉与模式识别 · 计算机科学 2022-11-16 Adham Elarabawy , Harish Kamath , Samuel Denton

Guidance techniques are commonly used in diffusion and flow models to improve image quality and input consistency for conditional generative tasks such as class-conditional and text-to-image generation. In particular, classifier-free…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Tariq Berrada Ifriqi , Adriana Romero-Soriano , Michal Drozdzal , Jakob Verbeek , Karteek Alahari

Recently large-scale language-image models (e.g., text-guided diffusion models) have considerably improved the image generation capabilities to generate photorealistic images in various domains. Based on this success, current image editing…

计算机视觉与模式识别 · 计算机科学 2023-05-09 Wenkai Dong , Song Xue , Xiaoyue Duan , Shumin Han