English
Related papers

Related papers: RepLDM: Reprogramming Pretrained Latent Diffusion …

200 papers

Diffusion models (DMs) have shown promising results on single-image super-resolution and other image-to-image translation tasks. Benefiting from more computational resources and longer inference times, they are able to yield more realistic…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Yuanting Fan , Chengxu Liu , Nengzhong Yin , Changlong Gao , Xueming Qian

Existing methods for restoring degraded human-centric images often struggle with insufficient fidelity, particularly in human body restoration (HBR). Recent diffusion-based restoration methods commonly adapt pre-trained text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Jue Gong , Zihan Zhou , Jingkai Wang , Shu Li , Libo Liu , Jianliang Lan , Yulun Zhang

By embedding discrete representations into a continuous latent space, we can leverage continuous-space latent diffusion models to handle generative modeling of discrete data. However, despite their initial success, most latent diffusion…

Machine Learning · Computer Science 2025-04-02 Bac Nguyen , Chieh-Hsin Lai , Yuhta Takida , Naoki Murata , Toshimitsu Uesaka , Stefano Ermon , Yuki Mitsufuji

Although diffusion models have achieved remarkable progress in multi-modal magnetic resonance imaging (MRI) translation tasks, existing methods still tend to suffer from anatomical inconsistencies or degraded texture details when handling…

Image and Video Processing · Electrical Eng. & Systems 2026-03-16 Jianqiang Lin , Zhiqiang Shen , Peng Cao , Jinzhu Yang , Osmar R. Zaiane , Xiaoli Liu

Prior material creation methods had limitations in producing diverse results mainly because reconstruction-based methods relied on real-world measurements and generation-based methods were trained on relatively small material datasets. To…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Linxuan Xin , Zheng Zhang , Jinfu Wei , Wei Gao , Duan Gao

Consistency Models (CMs) have significantly accelerated the sampling process in diffusion models, yielding impressive results in synthesizing high-resolution images. To explore and extend these advancements to point-cloud-based 3D shape…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Bi'an Du , Wei Hu , Renjie Liao

We present a new latent model of natural images that can be learned on large-scale datasets. The learning process provides a latent embedding for every image in the training dataset, as well as a deep convolutional network that maps the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 ShahRukh Athar , Evgeny Burnaev , Victor Lempitsky

Large-scale text-to-image models have demonstrated amazing ability to synthesize diverse and high-fidelity images. However, these models are often violated by several limitations. Firstly, they require the user to provide precise and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Yupei Lin , Sen Zhang , Xiaojun Yang , Xiao Wang , Yukai Shi

Recovering degraded low-resolution text images is challenging, especially for Chinese text images with complex strokes and severe degradation in real-world scenarios. Ensuring both text fidelity and style realness is crucial for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Yuzhe Zhang , Jiawei Zhang , Hao Li , Zhouxia Wang , Luwei Hou , Dongqing Zou , Liheng Bian

Flood prediction is critical for emergency planning and response to mitigate human and economic losses. Traditional physics-based hydrodynamic models generate high-resolution flood maps using numerical methods requiring fine-grid…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Sun Han Neo , Sachith Seneviratne , Herath Mudiyanselage Viraj Vidura Herath , Abhishek Saha , Sanka Rasnayaka , Lucy Amanda Marshall

Diffusion models are proficient at generating high-quality images. They are however effective only when operating at the resolution used during training. Inference at a scaled resolution leads to repetitive patterns and structural…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Haosen Yang , Adrian Bulat , Isma Hadji , Hai X. Pham , Xiatian Zhu , Georgios Tzimiropoulos , Brais Martinez

Computational imaging methods increasingly rely on powerful generative diffusion models to tackle challenging image restoration tasks. In particular, state-of-the-art zero-shot image inverse solvers leverage distilled text-to-image latent…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Alessio Spagnoletti , Andrés Almansa , Marcelo Pereyra

Large-scale pre-training tasks like image classification, captioning, or self-supervised techniques do not incentivize learning the semantic boundaries of objects. However, recent generative foundation models built using text-based latent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Koutilya Pnvr , Bharat Singh , Pallabi Ghosh , Behjat Siddiquie , David Jacobs

Text-conditioned image generation models have recently achieved astonishing results in image quality and text alignment and are consequently employed in a fast-growing number of applications. Since they are highly data-driven, relying on…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Patrick Schramowski , Manuel Brack , Björn Deiseroth , Kristian Kersting

Latent Diffusion Models (LDMs) are generally trained at fixed resolutions, limiting their capability when scaling up to high-resolution images. While training-based approaches address this limitation by training on high-resolution datasets,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Sangmin Han , Jinho Jeong , Jinwoo Kim , Seon Joo Kim

Diffusion Probabilistic Models (DPMs) suffer from inefficient inference due to their slow sampling and high memory consumption, which limits their applicability to various medical imaging applications. In this work, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Fahim Ahmed Zaman , Mathews Jacob , Amanda Chang , Kan Liu , Milan Sonka , Xiaodong Wu

Latest diffusion-based methods for many image restoration tasks outperform traditional models, but they encounter the long-time inference problem. To tackle it, this paper proposes a Wavelet-Based Diffusion Model (WaveDM). WaveDM learns the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Yi Huang , Jiancheng Huang , Jianzhuang Liu , Mingfu Yan , Yu Dong , Jiaxi Lv , Chaoqi Chen , Shifeng Chen

Large-scale training of latent diffusion models (LDMs) has enabled unprecedented quality in image generation. However, the key components of the best performing LDM training recipes are oftentimes not available to the research community,…

We propose residual denoising diffusion models (RDDM), a novel dual diffusion process that decouples the traditional single denoising diffusion process into residual diffusion and noise diffusion. This dual diffusion framework expands the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Jiawei Liu , Qiang Wang , Huijie Fan , Yinong Wang , Yandong Tang , Liangqiong Qu

Diffusion models have recently been investigated as powerful generative solvers for image dehazing, owing to their remarkable capability to model the data distribution. However, the massive computational burden imposed by the retraining of…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Zizheng Yang , Hu Yu , Bing Li , Jinghao Zhang , Jie Huang , Feng Zhao