English
Related papers

Related papers: STRIDE: Training-Free Diversity Guidance via PCA-D…

200 papers

Reinforcement learning with stochastic optimal control offers a promising framework for diffusion fine-tuning, where a pre-trained diffusion model is optimized to generate paths that lead to a reward-tilted distribution. While these…

Machine Learning · Computer Science 2025-09-30 Sophia Tang , Yuchen Zhu , Molei Tao , Pranam Chatterjee

Recently, the Diffusion Probabilistic Model (DPM)-based methods have achieved substantial success in the field of medical image segmentation. However, most of these methods fail to enable the diffusion model to learn edge features and…

Image and Video Processing · Electrical Eng. & Systems 2024-06-21 Tingwei Liu , Miao Zhang , Leiye Liu , Jialong Zhong , Shuyao Wang , Yongri Piao , Huchuan Lu

Image enhancement finds wide-ranging applications in real-world scenarios due to complex environments and the inherent limitations of imaging devices. Recent diffusion-based methods yield promising outcomes but necessitate prolonged and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Yixuan Zhu , Haolin Wang , Ao Li , Wenliang Zhao , Yansong Tang , Jingxuan Niu , Lei Chen , Jie Zhou , Jiwen Lu

Attention-based models have revolutionized AI, but the quadratic cost of self-attention incurs severe computational and memory overhead. Sparse attention methods alleviate this by skipping low-relevance token pairs. However, current…

Hardware Architecture · Computer Science 2026-01-13 Huizheng Wang , Hongbin Wang , Zichuan Wang , Zhiheng Yue , Yang Wang , Chao Li , Yang Hu , Shouyi Yin

Image generation can solve insufficient labeled data issues in defect detection. Most defect generation methods are only trained on a single product without considering the consistencies among multiple products, leading to poor quality and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Qingfeng Shi , Jing Wei , Fei Shen , Zhengtao Zhang

Diffusion Transformers (DiTs) have achieved state-of-the-art performance in generative modeling, yet their high computational cost hinders real-time deployment. While feature caching offers a promising training-free acceleration solution by…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Fanpu Cao , Yaofo Chen , Zeng You , Wei Luo

Diffusion models have achieved remarkable success in generating high-resolution, realistic images across diverse natural distributions. However, their performance heavily relies on high-quality training data, making it challenging to learn…

Machine Learning · Computer Science 2025-05-22 Tianyu Chen , Yasi Zhang , Zhendong Wang , Ying Nian Wu , Oscar Leong , Mingyuan Zhou

While diffusion distillation has enabled one-step generation through methods like Variational Score Distillation, adapting distilled models to emerging new controls -- such as novel structural constraints or latest user preferences --…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Yihong Luo , Tianyang Hu , Yifan Song , Jiacheng Sun , Zhenguo Li , Jing Tang

Current diffusion-based super-resolution (SR) approaches achieve commendable performance at the cost of high inference overhead. Therefore, distillation techniques are utilized to accelerate the multi-step teacher model into one-step…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Weiyi You , Mingyang Zhang , Leheng Zhang , Xingyu Zhou , Kexuan Shi , Shuhang Gu

Music editing primarily entails the modification of instrument tracks or remixing in the whole, which offers a novel reinterpretation of the original piece through a series of operations. These music processing methods hold immense…

Sound · Computer Science 2023-12-13 Bing Han , Junyu Dai , Weituo Hao , Xinyan He , Dong Guo , Jitong Chen , Yuxuan Wang , Yanmin Qian , Xuchen Song

Aligning Diffusion models has achieved remarkable breakthroughs in generating high-quality, human preference-aligned images. Existing techniques, such as supervised fine-tuning (SFT) and DPO-style preference optimization, have become…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Zening Sun , Zhengpeng Xie , Lichen Bai , Shitong Shao , Shuo Yang , Zeke Xie

We present an ultra-efficient post-training method for shortcutting large-scale pre-trained flow matching diffusion models into efficient few-step samplers, enabled by novel velocity field self-distillation. While shortcutting in flow…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Xu Cai , Yang Wu , Qianli Chen , Haoran Wu , Lichuan Xiang , Hongkai Wen

Training diffusion models is always a computation-intensive task. In this paper, we introduce a novel speed-up method for diffusion model training, called, which is based on a closer look at time steps. Our key findings are: i) Time steps…

Machine Learning · Computer Science 2025-03-26 Kai Wang , Mingjia Shi , Yukun Zhou , Zekai Li , Zhihang Yuan , Yuzhang Shang , Xiaojiang Peng , Hanwang Zhang , Yang You

This paper presents SANA-Sprint, an efficient diffusion model for ultra-fast text-to-image (T2I) generation. SANA-Sprint is built on a pre-trained foundation model and augmented with hybrid distillation, dramatically reducing inference…

Graphics · Computer Science 2025-09-30 Junsong Chen , Shuchen Xue , Yuyang Zhao , Jincheng Yu , Sayak Paul , Junyu Chen , Han Cai , Song Han , Enze Xie

Inverse design problems are common in engineering and materials science. The forward direction, i.e., computing output quantities from design parameters, typically requires running a numerical simulation, such as a FEM, as an intermediate…

Machine Learning · Computer Science 2026-02-18 Jens U. Kreber , Christian Weißenfels , Joerg Stueckler

Recent advancements in diffusion models have revolutionized video generation, enabling the creation of high-quality, temporally consistent videos. However, generating high frame-rate (FPS) videos remains a significant challenge due to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Geunmin Hwang , Hyun-kyu Ko , Younghyun Kim , Seungryong Lee , Eunbyung Park

Diffusion Models have emerged as a leading class of generative models, yet their iterative sampling process remains computationally expensive. Timestep distillation is a promising technique to accelerate generation, but it often requires…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Guanjie Chen , Shirui Huang , Kai Liu , Jianchen Zhu , Xiaoye Qu , Peng Chen , Yu Cheng , Yifu Sun

Solving inverse problems without any training involves using a pretrained generative model and making appropriate modifications to the generation process to avoid finetuning of the generative model. While recent methods have explored the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Ashwini Pokle , Matthew J. Muckley , Ricky T. Q. Chen , Brian Karrer

Score-based diffusion models learn to reverse a stochastic differential equation that maps data to noise. However, for complex tasks, numerical error can compound and result in highly unnatural samples. Previous work mitigates this drift…

Machine Learning · Statistics 2023-06-12 Aaron Lou , Stefano Ermon

This paper addresses the challenge of achieving high-quality and fast image generation that aligns with complex human preferences. While recent advancements in diffusion models and distillation have enabled rapid generation, the effective…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Yihong Luo , Tianyang Hu , Weijian Luo , Kenji Kawaguchi , Jing Tang