English
Related papers

Related papers: ScaleDiff: Higher-Resolution Image Synthesis via E…

200 papers

Image classification serves as the cornerstone of computer vision, traditionally achieved through discriminative models based on deep neural networks. Recent advancements have introduced classification methods derived from generative…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Chunxiao Li , Xiaoxiao Wang , Boming Miao , Chuanlong Xie , Zizhe Wang , Yao Zhu

Instead of performing text-conditioned denoising in the image domain, latent diffusion models (LDMs) operate in latent space of a variational autoencoder (VAE), enabling more efficient processing at reduced computational costs. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Jason Becker , Chris Wendler , Peter Baylies , Robert West , Christian Wressnegger

This work aims to improve the efficiency of text-to-image diffusion models. While diffusion models use computationally expensive UNet-based denoising operations in every generation step, we identify that not all operations are equally…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Amirhossein Habibian , Amir Ghodrati , Noor Fathima , Guillaume Sautiere , Risheek Garrepalli , Fatih Porikli , Jens Petersen

Diffusion models have recently achieved significant success in various image manipulation tasks, including image super-resolution and perceptual quality enhancement. Pretrained text-to-image models, such as Stable Diffusion, have exhibited…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Sanchar Palit , Subhasis Chaudhuri , Biplab Banerjee

Most real-world networks are noisy and incomplete samples from an unknown target distribution. Refining them by correcting corruptions or inferring unobserved regions typically improves downstream performance. Inspired by the impressive…

Denosing diffusion model, as a generative model, has received a lot of attention in the field of image generation recently, thanks to its powerful generation capability. However, diffusion models have not yet received sufficient research in…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 ZiHan Cao , ShiQi Cao , Xiao Wu , JunMing Hou , Ran Ran , Liang-Jian Deng

Recently, diffusion models (DMs) have made significant strides in high-quality image generation. However, the multi-step denoising process often results in considerable computational overhead, impeding deployment on resource-constrained…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yu-Shan Tai , An-Yeu , Wu

The pose-guided person image generation task requires synthesizing photorealistic images of humans in arbitrary poses. The existing approaches use generative adversarial networks that do not necessarily maintain realistic textures or need…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Ankan Kumar Bhunia , Salman Khan , Hisham Cholakkal , Rao Muhammad Anwer , Jorma Laaksonen , Mubarak Shah , Fahad Shahbaz Khan

In this paper, we present the Directly Denoising Diffusion Model (DDDM): a simple and generic approach for generating realistic images with few-step sampling, while multistep sampling is still preserved for better performance. DDDMs require…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Dan Zhang , Jingjing Wang , Feng Luo

We present an end-to-end Transformer based Latent Diffusion model for image synthesis. On the ImageNet class conditioned generation task we show that a Transformer based Latent Diffusion model achieves a 14.1FID which is comparable to the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Princy Chahal

Diffusion models (DMs) have become the new trend of generative models and have demonstrated a powerful ability of conditional synthesis. Among those, text-to-image diffusion models pre-trained on large-scale image-text pairs are highly…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Wenliang Zhao , Yongming Rao , Zuyan Liu , Benlin Liu , Jie Zhou , Jiwen Lu

Diffusion models are the de facto approach for generating high-quality images and videos, but learning high-dimensional models remains a formidable task due to computational and optimization challenges. Existing methods often resort to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Jiatao Gu , Shuangfei Zhai , Yizhe Zhang , Josh Susskind , Navdeep Jaitly

Diffusion models achieve great success in generating diverse and high-fidelity images, yet their widespread application, especially in real-time scenarios, is hampered by their inherently slow generation speed. The slow generation stems…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Shengkun Tang , Yaqing Wang , Caiwen Ding , Yi Liang , Yao Li , Dongkuan Xu

Recent advancements in image synthesis are fueled by the advent of large-scale diffusion models. Yet, integrating realistic object visualizations seamlessly into new or existing backgrounds without extensive training remains a challenge.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Phillip Mueller , Jannik Wiese , Ioan Craciun , Lars Mikelsons

Diffusion models has emerged as a powerful framework for tasks like image controllable generation and dense prediction. However, existing models often struggle to capture underlying semantics (e.g., edges, textures, shapes) and effectively…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Zhong Ji , Weilong Cao , Yan Zhang , Yanwei Pang , Jungong Han , Xuelong Li

Despite the success of generating high-quality images given any text prompts by diffusion-based generative models, prior works directly generate the entire images, but cannot provide object-wise manipulation capability. To support wider…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Runhui Huang , Kaixin Cai , Jianhua Han , Xiaodan Liang , Renjing Pei , Guansong Lu , Songcen Xu , Wei Zhang , Hang Xu

In this paper, we introduce a novel deep neural network suitable for multi-scale analysis and propose efficient model-agnostic methods that help the network extract information from high-frequency domains to reconstruct clearer images. Our…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Hyungmin Roh , Myungjoo Kang

Image generative models, particularly diffusion-based models, have surged in popularity due to their remarkable ability to synthesize highly realistic images. However, since these models are data-driven, they inherit biases from the…

Machine Learning · Computer Science 2025-03-18 Lin-Chun Huang , Ching Chieh Tsao , Fang-Yi Su , Jung-Hsien Chiang

Natural images are continuous, yet most generative models synthesize them on discrete grids, limiting resolution-flexible generation. Continuous neural fields enable resolution-free rendering, but prior methods introduce continuity only at…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Yanhao Ge , Shanyan Guan , Weihao Wang , Ying Tai , Mingyu You

Existing methods for restoring degraded human-centric images often struggle with insufficient fidelity, particularly in human body restoration (HBR). Recent diffusion-based restoration methods commonly adapt pre-trained text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Jue Gong , Zihan Zhou , Jingkai Wang , Shu Li , Libo Liu , Jianliang Lan , Yulun Zhang