English
Related papers

Related papers: Make a Cheap Scaling: A Self-Cascade Diffusion Mod…

200 papers

Diffusion models have significantly advanced the field of generative modeling. However, training a diffusion model is computationally expensive, creating a pressing need to adapt off-the-shelf diffusion models for downstream generation…

Machine Learning · Computer Science 2024-06-07 Jincheng Zhong , Xingzhuo Guo , Jiaxiang Dong , Mingsheng Long

Fine-tuning advanced diffusion models for high-quality image stylization usually requires large training datasets and substantial computational resources, hindering their practical applicability. We propose Ada-Adapter, a novel framework…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Jia Liu , Changlin Li , Qirui Sun , Jiahui Ming , Chen Fang , Jue Wang , Bing Zeng , Shuaicheng Liu

Diffusion models excel at producing high-quality images; however, scaling to higher resolutions, such as 4K, often results in over-smoothed content, structural distortions, and repetitive patterns. To this end, we introduce ResMaster, a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Shuwei Shi , Wenbo Li , Yuechen Zhang , Jingwen He , Biao Gong , Yinqiang Zheng

Diffusion transformer (DiT) models have achieved remarkable success in image generation, thanks for their exceptional generative capabilities and scalability. Nonetheless, the iterative nature of diffusion models (DMs) results in high…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Zhiyuan Chen , Keyi Li , Yifan Jia , Le Ye , Yufei Ma

Diffusion models have revolutionized image and video generation, achieving unprecedented visual quality. However, their reliance on transformer architectures incurs prohibitively high computational costs, particularly when extending…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Justin Cui , Jie Wu , Ming Li , Tao Yang , Xiaojie Li , Rui Wang , Andrew Bai , Yuanhao Ban , Cho-Jui Hsieh

Diffusion models have been increasingly used as strong generative priors for solving inverse problems such as super-resolution in medical imaging. However, these approaches typically utilize a diffusion prior trained at a single scale,…

Image and Video Processing · Electrical Eng. & Systems 2026-02-02 Darshan Thaker , Mahmoud Mostapha , Radu Miron , Shihan Qiu , Mariappan Nadar

Diffusion models have gradually gained prominence in the field of image synthesis, showcasing remarkable generative capabilities. Nevertheless, the slow inference and complex networks, resulting from redundancy at both temporal and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Xuewen Liu , Zhikai Li , Qingyi Gu

Diffusion models have become the go-to method for many generative tasks, particularly for image-to-image generation tasks such as super-resolution and inpainting. Current diffusion-based methods do not provide statistical guarantees…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Eliahu Horwitz , Yedid Hoshen

Video generation has recently emerged as a central task in the field of generative AI. However, the substantial computational cost inherent in video synthesis makes model distillation a critical technique for efficient deployment. Despite…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yuyang You , Yongzhi Li , Jiahui Li , Yadong Mu , Quan Chen , Peng Jiang

Large pretrained diffusion models have demonstrated impressive generation capabilities and have been adapted to various downstream tasks. However, unlike Large Language Models (LLMs) that can learn multiple tasks in a single model based on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Ming Tao , Bing-Kun Bao , Yaowei Wang , Changsheng Xu

Diffusion models demonstrate outstanding performance in image generation, but their multi-step inference mechanism requires immense computational cost. Previous works accelerate inference by leveraging layer or token cache techniques to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Haowei Zhu , Ji Liu , Ziqiong Liu , Dong Li , Junhai Yong , Bin Wang , Emad Barsoum

Visual synthesis has recently seen significant leaps in performance, largely due to breakthroughs in generative models. Diffusion models have been a key enabler, as they excel in image diversity. However, this comes at the cost of slow…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Johannes Schusterbauer , Ming Gui , Pingchuan Ma , Nick Stracke , Stefan A. Baumann , Vincent Tao Hu , Björn Ommer

In this work, we rethink the approach to video super-resolution by introducing a method based on the Diffusion Posterior Sampling framework, combined with an unconditional video diffusion transformer operating in latent space. The video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Zhihao Zhan , Wang Pang , Xiang Zhu , Yechao Bai

Diffusion models have recently gained unprecedented attention in the field of image synthesis due to their remarkable generative capabilities. Notwithstanding their prowess, these models often incur substantial computational costs,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Xinyin Ma , Gongfan Fang , Xinchao Wang

Latent diffusion models have become the popular choice for scaling up diffusion models for high resolution image synthesis. Compared to pixel-space models that are trained end-to-end, latent models are perceived to be more efficient and to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Emiel Hoogeboom , Thomas Mensink , Jonathan Heek , Kay Lamerigts , Ruiqi Gao , Tim Salimans

Achieving optimal performance of video diffusion transformers within given data and compute budget is crucial due to their high training costs. This necessitates precisely determining the optimal model size and training hyperparameters…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Yuanyang Yin , Yaqi Zhao , Mingwu Zheng , Ke Lin , Jiarong Ou , Rui Chen , Victor Shea-Jay Huang , Jiahao Wang , Xin Tao , Pengfei Wan , Di Zhang , Baoqun Yin , Wentao Zhang , Kun Gai

Diffusion models learn strong image priors that can be leveraged to solve inverse problems like medical image reconstruction. However, for real-world applications such as 3D Computed Tomography (CT) imaging, directly training diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Taewon Yang , Jason Hu , Jeffrey A. Fessler , Liyue Shen

Diffusion models are powerful, but they require a lot of time and data to train. We propose Patch Diffusion, a generic patch-wise training framework, to significantly reduce the training time costs while improving data efficiency, which…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Zhendong Wang , Yifan Jiang , Huangjie Zheng , Peihao Wang , Pengcheng He , Zhangyang Wang , Weizhu Chen , Mingyuan Zhou

We propose a new finetuning method to provide pre-trained large language models (LMs) the ability to scale test-time compute through the diffusion framework. By increasing the number of diffusion steps, we show our finetuned models achieve…

Computation and Language · Computer Science 2025-06-04 Edoardo Cetin , Tianyu Zhao , Yujin Tang

By decomposing the image formation process into a sequential application of denoising autoencoders, diffusion models (DMs) achieve state-of-the-art synthesis results on image data and beyond. Additionally, their formulation allows for a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Robin Rombach , Andreas Blattmann , Dominik Lorenz , Patrick Esser , Björn Ommer