English
Related papers

Related papers: RepLDM: Reprogramming Pretrained Latent Diffusion …

200 papers

Recently, research on denoising diffusion models has expanded its application to the field of image restoration. Traditional diffusion-based image restoration methods utilize degraded images as conditional input to effectively guide the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Zhenning Shi , Haoshuai Zheng , Chen Xu , Changsheng Dong , Bin Pan , Xueshuo Xie , Along He , Tao Li , Huazhu Fu

We introduce Efficient Motion Diffusion Model (EMDM) for fast and high-quality human motion generation. Current state-of-the-art generative diffusion models have produced impressive results but struggle to achieve fast generation without…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Wenyang Zhou , Zhiyang Dou , Zeyu Cao , Zhouyingcheng Liao , Jingbo Wang , Wenjia Wang , Yuan Liu , Taku Komura , Wenping Wang , Lingjie Liu

Large-scale diffusion models have achieved remarkable success in generating high-quality images from textual descriptions, gaining popularity across various applications. However, the generation of layered content, such as transparent…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Yusuf Dalva , Yijun Li , Qing Liu , Nanxuan Zhao , Jianming Zhang , Zhe Lin , Pinar Yanardag

We investigate the utility of diffusion generative models to efficiently synthesise datasets that effectively train deep learning models for image analysis. Specifically, we propose novel $\Gamma$-distribution Latent Denoising Diffusion…

Image and Video Processing · Electrical Eng. & Systems 2024-10-01 David Stojanovski , Mariana da Silva , Pablo Lamata , Arian Beqiri , Alberto Gomez

We introduce R2LDM, an innovative approach for generating dense and accurate 4D radar point clouds, guided by corresponding LiDAR point clouds. Instead of utilizing range images or bird's eye view (BEV) images, we represent both LiDAR and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Boyuan Zheng , Shouyi Lu , Renbo Huang , Minqing Huang , Fan Lu , Wei Tian , Guirong Zhuo , Lu Xiong

Recent advancements in diffusion models have significantly improved performance in super-resolution (SR) tasks. However, previous research often overlooks the fundamental differences between SR and general image generation. General image…

Image and Video Processing · Electrical Eng. & Systems 2024-10-31 Hanlin Wu , Jiangwei Mo , Xiaohui Sun , Jie Ma

Reparameterized diffusion models (RDMs) have recently matched autoregressive methods in protein generation, motivating their use for challenging tasks such as designing membrane proteins, which possess interleaved soluble and transmembrane…

Biomolecules · Quantitative Biology 2025-09-30 Shrey Goel , Peregrine M. Schray , Yinuo Zhang , Sophia Vincoff , Huong T. Kratochvil , Pranam Chatterjee

High Dynamic Range (HDR) generation remains challenging for generative models, which are largely limited to low dynamic range outputs. Recent diffusionbased approaches approximate HDR by generating multiple exposure-conditioned samples,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Pedram Fekri , WenChen Li , William Chen , Peter Altamirano

Latent diffusion models (LDMs) have demonstrated remarkable generative capabilities across various low-level vision tasks. However, their potential for point cloud completion remains underexplored due to the unstructured and irregular…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Zijun Li , Hongyu Yan , Shijie Li , Kunming Luo , Li Lu , Xulei Yang , Weisi Lin

Diffusion models (DMs) have recently been introduced in image deblurring and exhibited promising performance, particularly in terms of details reconstruction. However, the diffusion model requires a large number of inference iterations to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Zheng Chen , Yulun Zhang , Ding Liu , Bin Xia , Jinjin Gu , Linghe Kong , Xin Yuan

We introduce a novel generative framework for functions by integrating Implicit Neural Representations (INRs) and Transformer-based hypernetworks into latent variable models. Unlike prior approaches that rely on MLP-based hypernetworks with…

Machine Learning · Computer Science 2025-11-04 Ignacio Peis , Batuhan Koyuncu , Isabel Valera , Jes Frellsen

Diffusion models have emerged as powerful tools for solving inverse problems due to their exceptional ability to model complex prior distributions. However, existing methods predominantly assume known forward operators (i.e., non-blind),…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Weimin Bai , Siyi Chen , Wenzheng Chen , He Sun

Latent diffusion models (LDMs) achieve state-of-the-art image synthesis, yet their reconstruction-style denoising objective provides only indirect semantic supervision: high-level semantics emerge slowly, requiring longer training and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Giorgos Petsangourakis , Christos Sgouropoulos , Bill Psomas , Theodoros Giannakopoulos , Giorgos Sfikas , Ioannis Kakogeorgiou

Latent Consistency Models (LCMs) have achieved impressive performance in accelerating text-to-image generative tasks, producing high-quality images with minimal inference steps. LCMs are distilled from pre-trained latent diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Simian Luo , Yiqin Tan , Suraj Patil , Daniel Gu , Patrick von Platen , Apolinário Passos , Longbo Huang , Jian Li , Hang Zhao

Large-scale generative models have achieved remarkable advancements in various visual tasks, yet their application to shadow removal in images remains challenging. These models often generate diverse, realistic details without adequate…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Xinjie Li , Yang Zhao , Dong Wang , Yuan Chen , Li Cao , Xiaoping Liu

This work aims to improve the applicability of diffusion models in realistic image restoration. Specifically, we enhance the diffusion model in several aspects such as network architecture, noise level, denoising steps, training image size,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Ziwei Luo , Fredrik K. Gustafsson , Zheng Zhao , Jens Sjölund , Thomas B. Schön

Deep learning has significantly advanced PET image re-construction, achieving remarkable improvements in image quality through direct training on sinogram or image data. Traditional methods often utilize masks for inpainting tasks, but…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Bin Huang , Binzhong He , Yanhan Chen , Zhili Liu , Xinyue Wang , Binxuan Li , Qiegen Liu

We introduce Lavender, a simple supervised fine-tuning (SFT) method that boosts the performance of advanced vision-language models (VLMs) by leveraging state-of-the-art image generation models such as Stable Diffusion. Specifically,…

Machine Learning · Computer Science 2025-05-27 Chen Jin , Ryutaro Tanno , Amrutha Saseendran , Tom Diethe , Philip Teare

We introduce the Pyramid Diffusion Model (PDM), a novel architecture designed for ultra-high-resolution image synthesis. PDM utilizes a pyramid latent representation, providing a broader design space that enables more flexible, structured,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Jiajie Yang

Text-to-image diffusion models exhibit remarkable generative capabilities, but lack precise control over object counts and spatial arrangements. This work introduces a two-stage system to address these compositional limitations. The first…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Jan-Hendrik Koch , Jonas Krumme , Konrad Gadzicki