中文
相关论文

相关论文: SpotEdit: Selective Region Editing in Diffusion Tr…

200 篇论文

Large-scale text-to-image models have demonstrated amazing ability to synthesize diverse and high-fidelity images. However, these models are often violated by several limitations. Firstly, they require the user to provide precise and…

计算机视觉与模式识别 · 计算机科学 2023-05-09 Yupei Lin , Sen Zhang , Xiaojun Yang , Xiao Wang , Yukai Shi

Despite recent advances in UNet-based image editing, methods for shape-aware object editing in high-resolution images are still lacking. Compared to UNet, Diffusion Transformers (DiT) demonstrate superior capabilities to effectively capture…

计算机视觉与模式识别 · 计算机科学 2024-11-08 Kunyu Feng , Yue Ma , Bingyuan Wang , Chenyang Qi , Haozhe Chen , Qifeng Chen , Zeyu Wang

We present the first text-based image editing approach for object parts based on pre-trained diffusion models. Diffusion-based image editing approaches capitalized on the deep understanding of diffusion models of image semantics to perform…

计算机视觉与模式识别 · 计算机科学 2025-06-30 Aleksandar Cvejic , Abdelrahman Eldesokey , Peter Wonka

Sketch-guided image editing aims to achieve local fine-tuning of the image based on the sketch information provided by the user, while maintaining the original status of the unedited areas. Due to the high cost of acquiring human sketches,…

计算机视觉与模式识别 · 计算机科学 2023-11-15 Weihang Mao , Bo Han , Zihao Wang

Diffusion models have revolutionized the field of content synthesis and editing. Recent models have replaced the traditional UNet architecture with the Diffusion Transformer (DiT), and employed flow-matching for improved training and…

计算机视觉与模式识别 · 计算机科学 2025-09-10 Omri Avrahami , Or Patashnik , Ohad Fried , Egor Nemchinov , Kfir Aberman , Dani Lischinski , Daniel Cohen-Or

Diffusion models have revolutionized image generation and editing, producing state-of-the-art results in conditioned and unconditioned image synthesis. While current techniques enable user control over the degree of change in an image edit,…

计算机视觉与模式识别 · 计算机科学 2024-03-01 Eran Levin , Ohad Fried

Denoising diffusion models have emerged as a powerful tool for various image generation and editing tasks, facilitating the synthesis of visual content in an unconditional or input-conditional manner. The core idea behind them is learning…

计算机视觉与模式识别 · 计算机科学 2025-03-12 Yi Huang , Jiancheng Huang , Yifan Liu , Mingfu Yan , Jiaxi Lv , Jianzhuang Liu , Wei Xiong , He Zhang , Liangliang Cao , Shifeng Chen

Colour is one of the most perceptually salient yet least controllable attributes in image generation. Although recent diffusion models can modify object colours from user instructions, their results often deviate from the intended hue,…

计算机视觉与模式识别 · 计算机科学 2026-03-20 Yuqi Yang , Dongliang Chang , Yijia Ling , Ruoyi Du , Zhanyu Ma

Diffusion models have made significant advances in text-guided synthesis tasks. However, editing user-provided images remains challenging, as the high dimensional noise input space of diffusion models is not naturally suited for image…

计算机视觉与模式识别 · 计算机科学 2024-04-25 Jiteng Mu , Michaël Gharbi , Richard Zhang , Eli Shechtman , Nuno Vasconcelos , Xiaolong Wang , Taesung Park

The success of image generative models has enabled us to build methods that can edit images based on text or other user input. However, these methods are bespoke, imprecise, require additional information, or are limited to only 2D image…

计算机视觉与模式识别 · 计算机科学 2025-01-03 Rahul Sajnani , Jeroen Vanbaar , Jie Min , Kapil Katyal , Srinath Sridhar

Recent works have explored text-guided image editing using diffusion models and generated edited images based on text prompts. However, the models struggle to accurately locate the regions to be edited and faithfully perform precise edits.…

计算机视觉与模式识别 · 计算机科学 2023-05-30 Qian Wang , Biao Zhang , Michael Birsak , Peter Wonka

Large diffusion transformers (DiTs) follow global editing instructions well but consistently leak local edits into unrelated regions, because joint-attention architectures offer no explicit channel telling the network where to apply the…

计算机视觉与模式识别 · 计算机科学 2026-05-01 Honghao Cai , Xiangyuan Wang , Yunhao Bai , Haohua Chen , Tianze Zhou , Runqi Wang , Wei Zhu , Yibo Chen , Xu Tang , Yao Hu , Zhen Li

Text-guided image editing has recently experienced rapid development. However, simultaneously performing multiple editing actions on a single image, such as background replacement and specific subject attribute changes, while maintaining…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Pengzhi Li , QInxuan Huang , Yikang Ding , Zhiheng Li

Diffusion models have attained remarkable success in the domains of image generation and editing. It is widely recognized that employing larger inversion and denoising steps in diffusion model leads to improved image reconstruction quality.…

计算机视觉与模式识别 · 计算机科学 2024-01-05 Chen Hou , Guoqiang Wei , Zhibo Chen

Instruction-based image editing aims to modify specific image elements with natural language instructions. However, current models in this domain often struggle to accurately execute complex user instructions, as they are trained on…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Qifan Yu , Wei Chow , Zhongqi Yue , Kaihang Pan , Yang Wu , Xiaoyang Wan , Juncheng Li , Siliang Tang , Hanwang Zhang , Yueting Zhuang

Diffusion models have demonstrated remarkable capabilities in text-to-image and text-to-video generation, opening up possibilities for video editing based on textual input. However, the computational cost associated with sequential sampling…

计算机视觉与模式识别 · 计算机科学 2024-11-20 Youyuan Zhang , Xuan Ju , James J. Clark

A precise and user-friendly manipulation of image content while preserving image fidelity has always been crucial to the field of image editing. Thanks to the power of generative models, recent point-based image editing methods allow users…

计算机视觉与模式识别 · 计算机科学 2024-01-15 Minxing Luo , Wentao Cheng , Jian Yang

Text-to-Image (T2I) diffusion models have recently gained traction for their versatility and user-friendliness in 2D content generation and editing. However, training a diffusion model specifically for 3D scene editing is challenging due to…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Nazmul Karim , Hasan Iqbal , Umar Khalid , Jing Hua , Chen Chen

Instruction-based image editing aims to modify source content according to textual instructions. However, existing methods built upon flow matching often struggle to maintain consistency in non-edited regions due to denoising-induced…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Zongqing Li , Zhihui Liu , Yujie Xie , Shansiyuan Wu , Hongshen Lv , Songzhi Su

Diffusion models have demonstrated their ability to generate diverse and high-quality images, sparking considerable interest in their potential for real image editing applications. However, existing diffusion-based approaches for local…

计算机视觉与模式识别 · 计算机科学 2025-07-22 Wenjing Huang , Shikui Tu , Lei Xu