English
Related papers

Related papers: Decoupling Complexity from Scale in Latent Diffusi…

200 papers

Diffusion models (DMs) have revolutionized generative learning. They utilize a diffusion process to encode data into a simple Gaussian distribution. However, encoding a complex, potentially multimodal data distribution into a single…

Machine Learning · Computer Science 2024-07-04 Yilun Xu , Gabriele Corso , Tommi Jaakkola , Arash Vahdat , Karsten Kreis

Distilling latent diffusion models (LDMs) into ones that are fast to sample from is attracting growing research interest. However, the majority of existing methods face two critical challenges: (1) They hinge on long training using a huge…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Qingsong Xie , Zhenyi Liao , Zhijie Deng , Chen chen , Haonan Lu

Latent Diffusion models (LDMs) have achieved remarkable results in synthesizing high-resolution images. However, the iterative sampling process is computationally intensive and leads to slow generation. Inspired by Consistency Models (song…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Simian Luo , Yiqin Tan , Longbo Huang , Jian Li , Hang Zhao

High Dynamic Range (HDR) generation remains challenging for generative models, which are largely limited to low dynamic range outputs. Recent diffusionbased approaches approximate HDR by generating multiple exposure-conditioned samples,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Pedram Fekri , WenChen Li , William Chen , Peter Altamirano

Latent diffusion models (LDMs) power state-of-the-art high-resolution generative image models. LDMs learn the data distribution in the latent space of an autoencoder (AE) and produce images by mapping the generated latents into RGB image…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Tariq Berrada , Pietro Astolfi , Melissa Hall , Marton Havasi , Yohann Benchetrit , Adriana Romero-Soriano , Karteek Alahari , Michal Drozdzal , Jakob Verbeek

Fashion content generation is an emerging area at the intersection of artificial intelligence and creative design, with applications ranging from virtual try-on to culturally diverse design prototyping. Existing methods often struggle with…

Computation and Language · Computer Science 2025-01-28 Spencer Ramsey , Amina Grant , Jeffrey Lee

Diffusion models (DMs) are one of the most widely used generative models for producing high quality images. However, a flurry of recent papers points out that DMs are least private forms of image generators, by extracting a significant…

Machine Learning · Statistics 2025-03-06 Michael F. Liu , Saiyue Lyu , Margarita Vinaroz , Mijung Park

Consistency Models (CMs) have significantly accelerated the sampling process in diffusion models, yielding impressive results in synthesizing high-resolution images. To explore and extend these advancements to point-cloud-based 3D shape…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Bi'an Du , Wei Hu , Renjie Liao

Recently, with the tremendous success of diffusion models in the field of text-to-image (T2I) generation, increasing attention has been directed toward their potential in text-to-video (T2V) applications. However, the computational demands…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Wenfeng Lin , Jiangchuan Wei , Boyuan Liu , Yichen Zhang , Shiyue Yan , Mingyu Guo

Text-conditioned diffusion models have emerged as a promising tool for neural video generation. However, current models still struggle with intricate spatiotemporal prompts and often generate restricted or incorrect motion. To address these…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Long Lian , Baifeng Shi , Adam Yala , Trevor Darrell , Boyi Li

Computed Tomography (CT) is a widely utilized imaging modality in clinical settings. Using densely acquired rotational X-ray arrays, CT can capture 3D spatial features. However, it is confronted with challenged such as significant time…

Image and Video Processing · Electrical Eng. & Systems 2025-07-16 Duoyou Chen , Yunqing Chen , Can Zhang , Zhou Wang , Cheng Chen , Ruoxiu Xiao

Latent diffusion models (LDMs) have achieved remarkable success in a variety of image tasks, yet achieving fine-grained, disentangled control over global structures versus fine details remains challenging. This paper explores…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Chao Huang , Susan Liang , Yunlong Tang , Jing Bi , Li Ma , Yapeng Tian , Chenliang Xu

We present LT3SD, a novel latent diffusion model for large-scale 3D scene generation. Recent advances in diffusion models have shown impressive results in 3D object generation, but are limited in spatial extent and quality when extended to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Quan Meng , Lei Li , Matthias Nießner , Angela Dai

Consistency models have demonstrated powerful capability in efficient image generation and allowed synthesis within a few sampling steps, alleviating the high computational cost in diffusion models. However, the consistency model in the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Xiang Wang , Shiwei Zhang , Han Zhang , Yu Liu , Yingya Zhang , Changxin Gao , Nong Sang

The field of generative models has recently witnessed significant progress, with diffusion models showing remarkable performance in image generation. In light of this success, there is a growing interest in exploring the application of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Ariel Lapid , Idan Achituve , Lior Bracha , Ethan Fetaya

While latent diffusion models (LDMs), such as Stable Diffusion, are designed for high-resolution (HR) image generation, they often struggle with significant structural distortions when generating images at resolutions higher than their…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Boyuan Cao , Jiaxin Ye , Yujie Wei , Hongming Shan

Visual diffusion models achieve remarkable progress, yet they are typically trained at limited resolutions due to the lack of high-resolution data and constrained computation resources, hampering their ability to generate high-fidelity…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Haonan Qiu , Shiwei Zhang , Yujie Wei , Ruihang Chu , Hangjie Yuan , Xiang Wang , Yingya Zhang , Ziwei Liu

In this paper, we present an effective data augmentation framework leveraging the Large Language Model (LLM) and Diffusion Model (DM) to tackle the challenges inherent in data-scarce scenarios. Recently, DMs have opened up the possibility…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Kyuheon Jung , Yongdeuk Seo , Seongwoo Cho , Jaeyoung Kim , Hyun-seok Min , Sungchul Choi

Autonomous driving demands high-quality LiDAR data, yet the cost of physical LiDAR sensors presents a significant scaling-up challenge. While recent efforts have explored deep generative models to address this issue, they often consume…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Qianjiang Hu , Zhimin Zhang , Wei Hu

Discrete diffusion models have emerged as a powerful class of models and a promising route to fast language generation, but practical implementations typically rely on factored reverse transitions ignoring cross-token dependencies and…

Machine Learning · Computer Science 2026-05-14 Dario Shariatian , Alain Durmus , Umut Simsekli , Stefano Peluchetti