English

High-Resolution Image Editing via Multi-Stage Blended Diffusion

Computer Vision and Pattern Recognition 2022-10-25 v1 Machine Learning

Abstract

Diffusion models have shown great results in image generation and in image editing. However, current approaches are limited to low resolutions due to the computational cost of training diffusion models for high-resolution generation. We propose an approach that uses a pre-trained low-resolution diffusion model to edit images in the megapixel range. We first use Blended Diffusion to edit the image at a low resolution, and then upscale it in multiple stages, using a super-resolution model and Blended Diffusion. Using our approach, we achieve higher visual fidelity than by only applying off the shelf super-resolution methods to the output of the diffusion model. We also obtain better global consistency than directly using the diffusion model at a higher resolution.

Keywords

Cite

@article{arxiv.2210.12965,
  title  = {High-Resolution Image Editing via Multi-Stage Blended Diffusion},
  author = {Johannes Ackermann and Minjun Li},
  journal= {arXiv preprint arXiv:2210.12965},
  year   = {2022}
}

Comments

Machine Learning for Creativity and Design Workshop at NeurIPS 2022

R2 v1 2026-06-28T04:19:26.133Z