English
Related papers

Related papers: ScaleDiff: Higher-Resolution Image Synthesis via E…

200 papers

Comparing images captured by disparate sensors is a common challenge in remote sensing. This requires image translation -- converting imagery from one sensor domain to another while preserving the original content. Denoising Diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 João Gabriel Vinholi , Marco Chini , Anis Amziane , Renato Machado , Danilo Silva , Patrick Matgen

Imputation of missing images via source-to-target modality translation can improve diversity in medical imaging protocols. A pervasive approach for synthesizing target images involves one-shot mapping through generative adversarial networks…

Image and Video Processing · Electrical Eng. & Systems 2023-04-03 Muzaffer Özbey , Onat Dalmaz , Salman UH Dar , Hasan A Bedel , Şaban Özturk , Alper Güngör , Tolga Çukur

The emergence of text-to-image generation models has led to the recognition that image enhancement, performed as post-processing, would significantly improve the visual quality of the generated images. Exploring diffusion models to enhance…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Yang Luo , Yiheng Zhang , Zhaofan Qiu , Ting Yao , Zhineng Chen , Yu-Gang Jiang , Tao Mei

Diffusion models, as a type of generative model, have achieved impressive results in generating images and videos conditioned on textual conditions. However, the generation process of diffusion models involves denoising dozens of steps to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Hui Zhang , Zuxuan Wu , Zhen Xing , Jie Shao , Yu-Gang Jiang

Traditional point-based image editing methods rely on iterative latent optimization or geometric transformations, which are either inefficient in their processing or fail to capture the semantic relationships within the image. These methods…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Biao Yang , Muqi Huang , Yuhui Zhang , Yun Xiong , Kun Zhou , Xi Chen , Shiyang Zhou , Huishuai Bao , Chuan Li , Feng Shi , Hualei Liu

We present a one-shot text-to-image diffusion model that can generate high-resolution images from natural language descriptions. Our model employs a layered U-Net architecture that simultaneously synthesizes images at multiple resolution…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Emaad Khwaja , Abdullah Rashwan , Ting Chen , Oliver Wang , Suraj Kothawade , Yeqing Li

Large denoising diffusion models, such as Stable Diffusion, have been trained on billions of image-caption pairs to perform text-conditioned image generation. As a byproduct of this training, these models have acquired general knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Alexandros Graikos , Nebojsa Jojic , Dimitris Samaras

The Stable Diffusion Model (SDM) is a prevalent and effective model for text-to-image (T2I) and image-to-image (I2I) generation. Despite various attempts at sampler optimization, model distillation, and network quantification, these…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Jinchao Zhu , Yuxuan Wang , Siyuan Pan , Pengfei Wan , Di Zhang , Gao Huang

We introduce a diffusion-based cross-domain image translator in the absence of paired training data. Unlike GAN-based methods, our approach integrates diffusion models to learn the image translation process, allowing for more coverable…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Shilong Zou , Yuhang Huang , Renjiao Yi , Chenyang Zhu , Kai Xu

The performance of single image super-resolution depends heavily on how to generate and complement high-frequency details to low-resolution images. Recently, diffusion-based DDPM models exhibit great potential in generating high-quality…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Xingjian Wang , Li Chai , Jiming Chen

Diffusion models (DMs) are powerful generative models capable of producing high-fidelity images but are constrained by high computational costs due to iterative multi-step inference. While Neural Architecture Search (NAS) can optimize DMs,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Hongtao Huang , Xiaojun Chang , Lina Yao

Solving medical imaging data scarcity through semantic image generation has attracted growing attention in recent years. However, existing generative models mainly focus on synthesizing whole-organ or large-tissue structures, showing…

Image and Video Processing · Electrical Eng. & Systems 2025-12-19 Jiahao Xia , Yutao Hu , Yaolei Qi , Zhenliang Li , Wenqi Shao , Junjun He , Ying Fu , Longjiang Zhang , Guanyu Yang

Despite significant advancements in image customization with diffusion models, current methods still have several limitations: 1) unintended changes in non-target areas when regenerating the entire image; 2) guidance solely by a reference…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Pengzhi Li , Qiang Nie , Ying Chen , Xi Jiang , Kai Wu , Yuhuan Lin , Yong Liu , Jinlong Peng , Chengjie Wang , Feng Zheng

Recent video inpainting methods have achieved encouraging improvements by leveraging optical flow to guide pixel propagation from reference frames either in the image space or feature space. However, they would produce severe artifacts in…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Chaohao Xie , Kai Han , Kwan-Yee K. Wong

Based on recent advanced diffusion models, Text-to-image (T2I) generation models have demonstrated their capabilities to generate diverse and high-quality images. However, leveraging their potential for real-world content creation,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Sandra Zhang Ding , Jiafeng Mao , Kiyoharu Aizawa

Transforming large pre-trained low-resolution diffusion models to cater to higher-resolution demands, i.e., diffusion extrapolation, significantly improves diffusion adaptability. We propose tuning-free CutDiffusion, aimed at simplifying…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Mingbao Lin , Zhihang Lin , Wengyi Zhan , Liujuan Cao , Rongrong Ji

Medical image segmentation suffers from data scarcity, particularly in polyp detection where annotation requires specialized expertise. We present SynDiff, a framework combining text-guided synthetic data generation with efficient…

Image and Video Processing · Electrical Eng. & Systems 2025-07-22 Muhammad Aqeel , Maham Nazir , Zanxi Ruan , Francesco Setti

In this work, we explore an untapped signal in diffusion model inference. While all previous methods generate images independently at inference, we instead ask if samples can be generated collaboratively. We propose Group Diffusion,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Sicheng Mo , Thao Nguyen , Richard Zhang , Nick Kolkin , Siddharth Srinivasan Iyer , Eli Shechtman , Krishna Kumar Singh , Yong Jae Lee , Bolei Zhou , Yuheng Li

Diffusion and flow matching models have achieved remarkable success in text-to-image generation. However, these models typically rely on the predetermined denoising schedules for all prompts. The multi-step reverse diffusion process can be…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Zilyu Ye , Zhiyang Chen , Tiancheng Li , Zemin Huang , Weijian Luo , Guo-Jun Qi

Current perceptive models heavily depend on resource-intensive datasets, prompting the need for innovative solutions. Leveraging recent advances in diffusion models, synthetic data, by constructing image inputs from various annotations,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Yibo Wang , Ruiyuan Gao , Kai Chen , Kaiqiang Zhou , Yingjie Cai , Lanqing Hong , Zhenguo Li , Lihui Jiang , Dit-Yan Yeung , Qiang Xu , Kai Zhang