English
Related papers

Related papers: Matryoshka Diffusion Models

200 papers

In this paper, we introduce a denoising diffusion algorithm to discover microstructures with nonlinear fine-tuned properties. Denoising diffusion probabilistic models are generative models that use diffusion-based dynamics to gradually…

Machine Learning · Computer Science 2023-06-14 Nikolaos N. Vlassis , WaiChing Sun

By embedding discrete representations into a continuous latent space, we can leverage continuous-space latent diffusion models to handle generative modeling of discrete data. However, despite their initial success, most latent diffusion…

Machine Learning · Computer Science 2025-04-02 Bac Nguyen , Chieh-Hsin Lai , Yuhta Takida , Naoki Murata , Toshimitsu Uesaka , Stefano Ermon , Yuki Mitsufuji

Complex degradations like noise, blur, and low resolution are typical challenges in real world image fusion tasks, limiting the performance and practicality of existing methods. End to end neural network based approaches are generally…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Yu Shi , Yu Liu , Zhong-Cheng Wu , Juan Cheng , Huafeng Li , Xun Chen

Diffusion models, such as Stable Diffusion, have shown incredible performance on text-to-image generation. Since text-to-image generation often requires models to generate visual concepts with fine-grained details and attributes specified…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Xuehai He , Weixi Feng , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

The multi-step sampling mechanism, a key feature of visual diffusion models, has significant potential to replicate the success of OpenAI's Strawberry in enhancing performance by increasing the inference computational cost. Sufficient prior…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Shitong Shao , Zikai Zhou , Lichen Bai , Haoyi Xiong , Zeke Xie

Generative diffusion models have achieved remarkable success in producing high-quality images. However, these models typically operate in continuous intensity spaces, diffusing independently across pixels and color channels. As a result,…

Graphics · Computer Science 2025-05-20 Javier E. Santos , Agnese Marcato , Roman Colman , Nicholas Lubbers , Yen Ting Lin

Visual synthesis has recently seen significant leaps in performance, largely due to breakthroughs in generative models. Diffusion models have been a key enabler, as they excel in image diversity. However, this comes at the cost of slow…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Johannes Schusterbauer , Ming Gui , Pingchuan Ma , Nick Stracke , Stefan A. Baumann , Vincent Tao Hu , Björn Ommer

Diffusion models face a fundamental trade-off between generation quality and computational efficiency. Latent Diffusion Models (LDMs) offer an efficient solution but suffer from potential information loss and non-end-to-end training. In…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Zhennan Chen , Junwei Zhu , Xu Chen , Jiangning Zhang , Xiaobin Hu , Hanzhen Zhao , Chengjie Wang , Jian Yang , Ying Tai

Previous efforts have managed to generate production-ready 3D assets from text or images. However, these methods primarily employ NeRF or 3D Gaussian representations, which are not adept at producing smooth, high-quality geometries required…

Graphics · Computer Science 2024-10-15 Rengan Xie , Wenting Zheng , Kai Huang , Yizheng Chen , Qi Wang , Qi Ye , Wei Chen , Yuchi Huo

Diffusion models (DMs) excel in unconditional generation, as well as on applications such as image editing and restoration. The success of DMs lies in the iterative nature of diffusion: diffusion breaks down the complex process of mapping…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Beomsu Kim , Jaemin Kim , Jeongsol Kim , Jong Chul Ye

Masked diffusion models (MDM) are powerful generative models for discrete data that generate samples by progressively unmasking tokens in a sequence. Each token can take one of two states: masked or unmasked. We observe that token sequences…

Machine Learning · Computer Science 2025-10-23 Chen-Hao Chao , Wei-Fang Sun , Hanwen Liang , Chun-Yi Lee , Rahul G. Krishnan

Diffusion models (DMs) generate remarkable high quality images via the stochastic denoising process, which unfortunately incurs high sampling time. Post-quantizing the trained diffusion models in fixed bit-widths, e.g., 4 bits on weights…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Rocco Manz Maruzzelli , Basile Lewandowski , Lydia Y. Chen

Dataset distillation aims to distill the knowledge of a large-scale real dataset into small yet informative synthetic data such that a model trained on it performs as well as a model trained on the full dataset. Despite recent progress,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Ahmad Sajedi , Samir Khaki , Lucy Z. Liu , Ehsan Amjadian , Yuri A. Lawryshyn , Konstantinos N. Plataniotis

While latent diffusion models (LDMs), such as Stable Diffusion, are designed for high-resolution (HR) image generation, they often struggle with significant structural distortions when generating images at resolutions higher than their…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Boyuan Cao , Jiaxin Ye , Yujie Wei , Hongming Shan

Diffusion models are widely used in applications ranging from image generation to inverse problems. However, training diffusion models typically requires clean ground-truth images, which are unavailable in many applications. We introduce…

Image and Video Processing · Electrical Eng. & Systems 2025-05-20 Chicago Y. Park , Shirin Shoushtari , Hongyu An , Ulugbek S. Kamilov

Diffusion models show promise for dynamic scene deblurring; however, existing studies often fail to leverage the intrinsic nature of the blurring process within diffusion models, limiting their full potential. To address it, we present a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Jin-Ting He , Fu-Jen Tsai , Yan-Tsung Peng , Min-Hung Chen , Chia-Wen Lin , Yen-Yu Lin

We present Bayesian Diffusion Models (BDM), a prediction algorithm that performs effective Bayesian inference by tightly coupling the top-down (prior) information with the bottom-up (data-driven) procedure via joint diffusion processes. We…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Haiyang Xu , Yu Lei , Zeyuan Chen , Xiang Zhang , Yue Zhao , Yilin Wang , Zhuowen Tu

Denoising diffusion probabilistic models (DDPMs) have been proven capable of synthesizing high-quality images with remarkable diversity when trained on large amounts of data. Typical diffusion models and modern large-scale conditional…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Jingyuan Zhu , Huimin Ma , Jiansheng Chen , Jian Yuan

Denoising diffusion models have recently achieved state-of-the-art performance in many image-generation tasks. They do, however, require a large amount of computational resources. This limits their application to medical tasks, where we…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Florentin Bieder , Julia Wolleb , Alicia Durrer , Robin Sandkühler , Philippe C. Cattin

Diffusion model has emerged as the \emph{de-facto} model for image generation, yet the heavy training overhead hinders its broader adoption in the research community. We observe that diffusion models are commonly trained to learn all…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Jiachen Lei , Qinglong Wang , Peng Cheng , Zhongjie Ba , Zhan Qin , Zhibo Wang , Zhenguang Liu , Kui Ren