English
Related papers

Related papers: Painterly Image Harmonization using Diffusion Mode…

200 papers

Blind image restoration remains a significant challenge in low-level vision tasks. Recently, denoising diffusion models have shown remarkable performance in image synthesis. Guided diffusion models, leveraging the potent generative priors…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Jun Xiao , Zihang Lyu , Hao Xie , Cong Zhang , Yakun Ju , Changjian Shui , Kin-Man Lam

Diffusion models have recently emerged as powerful generative priors for solving inverse problems. However, training diffusion models in the pixel space are both data-intensive and computationally demanding, which restricts their…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Bowen Song , Soo Min Kwon , Zecheng Zhang , Xinyu Hu , Qing Qu , Liyue Shen

Free-form image inpainting is the task of reconstructing parts of an image specified by an arbitrary binary mask. In this task, it is typically desired to generalize model capabilities to unseen mask types, rather than learning certain mask…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Moein Heidari , Alireza Morsali , Tohid Abedini , Samin Heydarian

Recently large-scale language-image models (e.g., text-guided diffusion models) have considerably improved the image generation capabilities to generate photorealistic images in various domains. Based on this success, current image editing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Wenkai Dong , Song Xue , Xiaoyue Duan , Shumin Han

Ultrasound imaging is widely used in noninvasive medical diagnostics due to its efficiency, portability, and avoidance of ionizing radiation. However, its utility is limited by the quality of the signal. Signal-dependent speckle noise,…

Image and Video Processing · Electrical Eng. & Systems 2026-02-10 Soumee Guha , Scott T. Acton

Recent works on image harmonization solve the problem as a pixel-wise image translation task via large autoencoders. They have unsatisfactory performances and slow inference speeds when dealing with high-resolution images. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Zhanghan Ke , Chunyi Sun , Lei Zhu , Ke Xu , Rynson W. H. Lau

Style transfer aims to fuse the artistic representation of a style image with the structural information of a content image. Existing methods train specific networks or utilize pre-trained models to learn content and style features.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Ying Hu , Chenyi Zhuang , Pan Gao

Diffusion-based Image Editing has achieved significant success in recent years. However, it remains challenging to achieve high-quality image editing while maintaining the background similarity without sacrificing speed or memory…

Graphics · Computer Science 2025-09-03 Siyi Liu , Weiming Chen , Yushun Tang , Zhihai He

Pre-trained diffusion models have demonstrated remarkable proficiency in synthesizing images across a wide range of scenarios with customizable prompts, indicating their effective capacity to capture universal features. Motivated by this,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Yuxiang Ji , Boyong He , Chenyuan Qu , Zhuoyue Tan , Chuan Qin , Liaoni Wu

The goal of image harmonization is adjusting the foreground appearance in a composite image to make the whole image harmonious. To construct paired training images, existing datasets adopt different ways to adjust the illumination…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Li Niu , Junyan Cao , Wenyan Cong , Liqing Zhang

Recently, diffusion models have exhibited superior performance in the area of image inpainting. Inpainting methods based on diffusion models can usually generate realistic, high-quality image content for masked areas. However, due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Ruichen Wang , Junliang Zhang , Qingsong Xie , Chen Chen , Haonan Lu

Current multi-modal image fusion methods typically rely on task-specific models, leading to high training costs and limited scalability. While generative methods provide a unified modeling perspective, they often suffer from slow inference…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Huayi Zhu , Xiu Shu , Youqiang Xiong , Qiao Liu , Rui Chen , Di Yuan , Xiaojun Chang , Zhenyu He

Image interpolation based on diffusion models is promising in creating fresh and interesting images. Advanced interpolation methods mainly focus on spherical linear interpolation, where images are encoded into the noise space and then…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 PengFei Zheng , Yonggang Zhang , Zhen Fang , Tongliang Liu , Defu Lian , Bo Han

The fabrication of visual misinformation on the web and social media has increased exponentially with the advent of foundational text-to-image diffusion models. Namely, Stable Diffusion inpainters allow the synthesis of maliciously…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Geonho Son , Juhun Lee , Simon S. Woo

Multi-focus color image fusion refers to integrating multiple partially focused color images to create a single all-in-focus color image. However, existing methods struggle with complex real-world scenarios due to limitations in handling…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Weihua Yang , Yicong Zhou

We present a palette-based framework for color composition for visual applications. Color composition is a critical aspect of visual applications in art, design, and visualization. The color wheel is often used to explain pleasing color…

Graphics · Computer Science 2018-06-22 Jianchao Tan , Jose Echevarria , Yotam Gingold

Given an image of a natural scene, we are able to quickly decompose it into a set of components such as objects, lighting, shadows, and foreground. We can then envision a scene where we combine certain components with those from other…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Jocelin Su , Nan Liu , Yanbo Wang , Joshua B. Tenenbaum , Yilun Du

Large-scale diffusion-based generative models have led to breakthroughs in text-conditioned high-resolution image synthesis. Starting from random noise, such text-to-image diffusion models gradually synthesize images in an iterative fashion…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Yogesh Balaji , Seungjun Nah , Xun Huang , Arash Vahdat , Jiaming Song , Qinsheng Zhang , Karsten Kreis , Miika Aittala , Timo Aila , Samuli Laine , Bryan Catanzaro , Tero Karras , Ming-Yu Liu

Diffusion-based image compression methods have achieved notable progress, delivering high perceptual quality at low bitrates. However, their practical deployment is hindered by significant inference latency and heavy computational overhead,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yiwen Jia , Hao Wei , Yanhui Zhou , Chenyang Ge

Large-scale Text-to-Image (T2I) diffusion models have revolutionized image generation over the last few years. Although owning diverse and high-quality generation capabilities, translating these abilities to fine-grained image editing…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Chong Mou , Xintao Wang , Jiechong Song , Ying Shan , Jian Zhang