English
Related papers

Related papers: Uni-Instruct: One-step Diffusion Model through Uni…

200 papers

Diffusion models have achieved remarkable generation quality, but they suffer from significant inference cost due to their reliance on multiple sequential denoising steps, motivating recent efforts to distill this inference process into a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Zihan Yang , Shuyuan Tu , Licheng Zhang , Qi Dai , Yu-Gang Jiang , Zuxuan Wu

Class-incremental learning aims to learn new classes in an incremental fashion without forgetting the previously learned ones. Several research works have shown how additional data can be used by incremental models to help mitigate…

Machine Learning · Computer Science 2023-10-11 Quentin Jodelet , Xin Liu , Yin Jun Phua , Tsuyoshi Murata

We introduce InfiFusion, an efficient training pipeline designed to integrate multiple domain-specialized Large Language Models (LLMs) into a single pivot model, effectively harnessing the strengths of each source model. Traditional fusion…

Computation and Language · Computer Science 2025-02-18 Zhaoyi Yan , Yiming Zhang , Baoyi He , Yuhao Fu , Qi Zhou , Zhijie Sang , Chunlin Ji , Shengyu Zhang , Fei Wu , Hongxia Yang

While recent diffusion-based generative image codecs have shown impressive performance, their iterative sampling process introduces unpleasing latency. In this work, we revisit the design of a diffusion-based codec and argue that multi-step…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Naifu Xue , Zhaoyang Jia , Jiahao Li , Bin Li , Yuan Zhang , Yan Lu

The landscape of high-performance image generation models is currently shifting from the inefficient multi-step ones to the efficient few-step counterparts (e.g, Z-Image-Turbo and FLUX.2-klein). However, these models present significant…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Dengyang Jiang , Xin Jin , Dongyang Liu , Zanyi Wang , Mingzhe Zheng , Ruoyi Du , Xiangpeng Yang , Qilong Wu , Zhen Li , Peng Gao , Harry Yang , Steven Hoi

Diffusion models excel at generative modeling (e.g., text-to-image) but sampling requires multiple denoising network passes, limiting practicality. Efforts such as progressive distillation or consistency distillation have shown promise by…

Machine Learning · Computer Science 2025-04-01 Risheek Garrepalli , Shweta Mahajan , Munawar Hayat , Fatih Porikli

Diffusion models have shown remarkable success across generative tasks, yet their high computational demands challenge deployment on resource-limited platforms. This paper investigates a critical question for compute-optimal diffusion model…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Zhenbang Du , Yonggan Fu , Lifu Wang , Jiayi Qian , Xiao Luo , Yingyan , Lin

We propose Score-of-Mixture Training (SMT), a novel framework for training one-step generative models by minimizing a class of divergences called the $\alpha$-skew Jensen--Shannon divergence. At its core, SMT estimates the score of mixture…

Machine Learning · Computer Science 2025-07-16 Tejas Jayashankar , J. Jon Ryu , Gregory Wornell

Diffusion models have recently achieved remarkable performance in image super-resolution (SR), but their high computational cost limits practical deployment in remote sensing applications. To address this issue, we propose SlimDiffSR, a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Ce Wang , Zhenyu Hu , Wanjie Sun

The slow inference process of image diffusion models significantly degrades interactive user experiences. To address this, we introduce Diffusion Preview, a novel paradigm employing rapid, low-step sampling to generate preliminary outputs…

Machine Learning · Computer Science 2026-04-08 Fu-Yun Wang , Hao Zhou , Liangzhe Yuan , Sanghyun Woo , Boqing Gong , Bohyung Han , Ming-Hsuan Yang , Han Zhang , Yukun Zhu , Ting Liu , Long Zhao

Diffusion distillation methods aim to compress the diffusion models into efficient one-step generators while trying to preserve quality. Among them, Distribution Matching Distillation (DMD) offers a suitable framework for training…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Denis Rakitin , Ivan Shchekotov , Dmitry Vetrov

Recently, text-to-image denoising diffusion probabilistic models (DDPMs) have demonstrated impressive image generation capabilities and have also been successfully applied to image inpainting. However, in practice, users often require more…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Shiyuan Yang , Xiaodong Chen , Jing Liao

As multimodal data proliferates across diverse real-world applications, leveraging heterogeneous information such as texts and timestamps for accurate time series forecasting (TSF) has become a critical challenge. While diffusion models…

Machine Learning · Computer Science 2025-12-09 Da Zhang , Bingyu Li , Zhuyuan Zhao , Junyu Gao , Feiping Nie , Xuelong Li

Recent advances in diffusion and flow-based generative models have demonstrated remarkable success in image restoration tasks, achieving superior perceptual quality compared to traditional deep learning approaches. However, these methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yuanzhi Zhu , Ruiqing Wang , Shilin Lu , Junnan Li , Hanshu Yan , Kai Zhang

Diffusion models have achieved outstanding performance in unsupervised industrial anomaly detection (uIAD) by learning a manifold of normal data under the common assumption that off-manifold anomalies are harder to generate, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Boan Zhang , Wen Li , Guanhua Yu , Xiyang Liu , Wenchao Chen , Long Tian

Image enhancement finds wide-ranging applications in real-world scenarios due to complex environments and the inherent limitations of imaging devices. Recent diffusion-based methods yield promising outcomes but necessitate prolonged and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Yixuan Zhu , Haolin Wang , Ao Li , Wenliang Zhao , Yansong Tang , Jingxuan Niu , Lei Chen , Jie Zhou , Jiwen Lu

Text-to-3D generation has shown rapid progress in recent days with the advent of score distillation, a methodology of using pretrained text-to-2D diffusion models to optimize neural radiance field (NeRF) in the zero-shot setting. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Junyoung Seo , Wooseok Jang , Min-Seop Kwak , Hyeonsu Kim , Jaehoon Ko , Junho Kim , Jin-Hwa Kim , Jiyoung Lee , Seungryong Kim

Although diffusion model has shown great potential for generating higher quality images than GANs, slow sampling speed hinders its wide application in practice. Progressive distillation is thus proposed for fast sampling by progressively…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Wujie Sun , Defang Chen , Can Wang , Deshi Ye , Yan Feng , Chun Chen

Recent hybrid video generation models combine autoregressive temporal dynamics with diffusion-based spatial denoising, but their sequential, iterative nature leads to error accumulation and long inference times. In this work, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Yongqi Yang , Huayang Huang , Xu Peng , Xiaobin Hu , Donghao Luo , Jiangning Zhang , Chengjie Wang , Yu Wu

The machine learning community is increasingly recognizing the importance of fostering trust and safety in modern generative AI (GenAI) models. We posit machine unlearning (MU) as a crucial foundation for developing safe, secure, and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Tianqi Chen , Shujian Zhang , Mingyuan Zhou