English
Related papers

Related papers: SADA: Stability-guided Adaptive Diffusion Accelera…

200 papers

Encoding frequency stability constraints in the operation problem is challenging due to its complex dynamics. Recently, data-driven approaches have been proposed to learn the stability criteria offline with the trained model embedded as a…

Systems and Control · Electrical Eng. & Systems 2024-07-23 Wangkun Xu , Qian Chen , Pudong Ge , Zhongda Chu , Fei Teng

Diffusion models have recently demonstrated an impressive ability to address inverse problems in an unsupervised manner. While existing methods primarily focus on modifying the posterior sampling process, the potential of the forward…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Gongye Liu , Haoze Sun , Jiayi Li , Fei Yin , Yujiu Yang

We provide the first polynomial-time convergence guarantees for the probability flow ODE implementation (together with a corrector step) of score-based generative modeling. Our analysis is carried out in the wake of recent results obtaining…

Machine Learning · Computer Science 2023-05-22 Sitan Chen , Sinho Chewi , Holden Lee , Yuanzhi Li , Jianfeng Lu , Adil Salim

Deep learning models in computational pathology often fail to generalize across cohorts and institutions due to domain shift. Existing approaches either fail to leverage unlabeled data from the target domain or rely on image-to-image…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Tengyue Zhang , Ruiwen Ding , Luoting Zhuang , Yuxiao Wu , Erika F. Rodriguez , William Hsu

In diffusion models, samples are generated through an iterative refinement process, requiring hundreds of sequential model evaluations. Several recent methods have introduced approximations (fewer discretization steps or distillation) to…

Machine Learning · Computer Science 2024-12-12 Nikil Roashan Selvam , Amil Merchant , Stefano Ermon

Diffusion large language models (dLLMs) offer a promising paradigm for parallel text generation, but in practice they face an accuracy-parallelism trade-off, where increasing tokens per forward (TPF) often degrades generation quality.…

Computation and Language · Computer Science 2026-05-12 Haoyang Zhou , Li Kong , Shijie Ren , Xiting Wang , Shuang Liang , Guowei Wang , Zhenxuan Pan

Diffusion models like Stable Diffusion (SD) drive a vibrant open-source ecosystem including fully fine-tuned checkpoints and parameter-efficient adapters such as LoRA, LyCORIS, and ControlNet. However, these adaptation components are…

Machine Learning · Computer Science 2025-12-04 Zhidong Gao , Zimeng Pan , Yuhang Yao , Chenyue Xie , Wei Wei

Sampling from Diffusion Models can alternatively be seen as solving differential equations, where there is a challenge in balancing speed and image visual quality. ODE-based samplers offer rapid sampling time but reach a performance limit,…

Machine Learning · Computer Science 2025-02-28 Qinpeng Cui , Xinyi Zhang , Qiqi Bao , Qingmin Liao

Research on unsupervised domain adaptation (UDA) for semantic segmentation of remote sensing images has been extensively conducted. However, research on how to achieve domain adaptation in practical scenarios where source domain data is…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Wenjie Liu , Hongmin Liu , Lixin Zhang , Bin Fan

Unsupervised Domain Adaptation (UDA) aims to bridge the gap between a source domain, where labelled data are available, and a target domain only represented with unlabelled data. If domain invariant representations have dramatically…

Machine Learning · Computer Science 2020-12-04 Victor Bouvier , Philippe Very , Clément Chastagnol , Myriam Tami , Céline Hudelot

Training diffusion models is always a computation-intensive task. In this paper, we introduce a novel speed-up method for diffusion model training, called, which is based on a closer look at time steps. Our key findings are: i) Time steps…

Machine Learning · Computer Science 2025-03-26 Kai Wang , Mingjia Shi , Yukun Zhou , Zekai Li , Zhihang Yuan , Yuzhang Shang , Xiaojiang Peng , Hanwang Zhang , Yang You

Acceleration is a celebrated cornerstone of convex optimization, enabling gradient-based algorithms to converge sublinearly in the condition number. A major open question is whether an analogous acceleration phenomenon is possible for…

Probability · Mathematics 2026-04-01 Jason M. Altschuler , Sinho Chewi , Matthew S. Zhang

Diffusion-based image super-resolution (SR) methods have shown promise in reconstructing high-resolution images with fine details from low-resolution counterparts. However, these approaches typically require tens or even hundreds of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Xiao He , Huaao Tang , Zhijun Tu , Junchao Zhang , Kun Cheng , Hanting Chen , Yong Guo , Mingrui Zhu , Nannan Wang , Xinbo Gao , Jie Hu

Unsupervised domain adaptation (UDA) has achieved unprecedented success in improving the cross-domain robustness of object detection models. However, existing UDA methods largely ignore the instantaneous data distribution during model…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Zongxian Li , Qixiang Ye , Chong Zhang , Jingjing Liu , Shijian Lu , Yonghong Tian

Diffusion models generate high-quality images but require dozens of forward passes. We introduce Distribution Matching Distillation (DMD), a procedure to transform a diffusion model into a one-step image generator with minimal impact on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Tianwei Yin , Michaël Gharbi , Richard Zhang , Eli Shechtman , Fredo Durand , William T. Freeman , Taesung Park

This paper presents a comprehensive study on the unified module for accelerating stable-diffusion processes, specifically focusing on the lcm-lora module. Stable-diffusion processes play a crucial role in various scientific and engineering…

Machine Learning · Computer Science 2024-03-26 Ayush Thakur , Rashmi Vashisth

In this work, we propose a novel framework to enable diffusion models to adapt their generation quality based on real-time network bandwidth constraints. Traditional diffusion models produce high-fidelity images by performing a fixed number…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Xi Zhang , Hanwei Zhu , Yan Zhong , Jiamang Wang , Weisi Lin

Diffusion models have demonstrated exceptional efficacy in various generative applications. While existing models focus on minimizing a weighted sum of denoising score matching losses for data distribution modeling, their training primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Ling Yang , Haotian Qian , Zhilong Zhang , Jingwei Liu , Bin Cui

Diffusion-based or flow-based models have achieved significant progress in video synthesis but require multiple iterative sampling steps, which incurs substantial computational overhead. While many distillation methods that are solely based…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Yanxiao Sun , Jiafu Wu , Yun Cao , Chengming Xu , Yabiao Wang , Weijian Cao , Donghao Luo , Chengjie Wang , Yanwei Fu

Sparse-Linear Attention (SLA) combines sparse and linear attention to accelerate diffusion models and has shown strong performance in video generation. However, (i) SLA relies on a heuristic split that assigns computations to the sparse or…

Machine Learning · Computer Science 2026-02-16 Jintao Zhang , Haoxu Wang , Kai Jiang , Kaiwen Zheng , Youhe Jiang , Ion Stoica , Jianfei Chen , Jun Zhu , Joseph E. Gonzalez