中文
相关论文

相关论文: Image-Free Timestep Distillation via Continuous-Ti…

200 篇论文

Dataset distillation enables efficient training by distilling the information of large-scale datasets into significantly smaller synthetic datasets. Diffusion based paradigms have emerged in recent years, offering novel perspectives for…

计算机视觉与模式识别 · 计算机科学 2026-05-06 Qichao Wang , Yunhong Lu , Hengyuan Cao , Junyi Zhang , Min Zhang

Few-step video generation has been significantly advanced by consistency distillation. However, the performance of consistency-distilled models often degrades as more sampling steps are allocated at test time, limiting their effectiveness…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Yuchao Gu , Guian Fang , Yuxin Jiang , Weijia Mao , Song Han , Han Cai , Mike Zheng Shou

Dataset Distillation (DD) seeks to create a condensed dataset that, when used to train a model, enables the model to achieve performance similar to that of a model trained on the entire original dataset. It relieves the model training from…

计算机视觉与模式识别 · 计算机科学 2024-10-18 Chuhao Zhou , Chenxi Jiang , Yi Xie , Haozhi Cao , Jianfei Yang

Text-to-image (T2I) generation with Stable Diffusion models (SDMs) involves high computing demands due to billion-scale parameters. To enhance efficiency, recent studies have reduced sampling steps and applied network quantization while…

机器学习 · 计算机科学 2024-12-03 Bo-Kyeong Kim , Hyoung-Kyu Song , Thibault Castells , Shinkook Choi

Diffusion models have recently advanced photorealistic human synthesis, although practical talking-head generation (THG) remains constrained by high inference latency, temporal instability such as flicker and identity drift, and imperfect…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Soumya Mazumdar , Vineet Kumar Rakesh

The recently introduced Consistency models pose an efficient alternative to diffusion algorithms, enabling rapid and good quality image synthesis. These methods overcome the slowness of diffusion models by directly mapping noise to data,…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Shelly Golan , Roy Ganz , Michael Elad

Consistent distillation methods have evolved into effective techniques that significantly accelerate the sampling process of diffusion models. Although existing methods have achieved remarkable results, the selection of target timesteps…

计算机视觉与模式识别 · 计算机科学 2025-09-17 Qi Wang , Shuliang Zhu , Jinjia Zhou

Neural Text-to-Speech (TTS) systems find broad applications in voice assistants, e-learning, and audiobook creation. The pursuit of modern models, like Diffusion Models (DMs), holds promise for achieving high-fidelity, real-time speech…

声音 · 计算机科学 2024-04-02 Xiang Li , Fan Bu , Ambuj Mehrish , Yingting Li , Jiale Han , Bo Cheng , Soujanya Poria

Distilled diffusion models generate images in far fewer timesteps but suffer from reduced sample diversity when generating multiple outputs from the same prompt. To understand this phenomenon, we first investigate whether distillation…

图形学 · 计算机科学 2025-11-11 Rohit Gandikota , David Bau

Diffusion-based real-world image super-resolution (Real-ISR) methods have demonstrated impressive performance.To achieve efficient Real-ISR, many works employ Variational Score Distillation (VSD) to distill pre-trained stable-diffusion (SD)…

图像与视频处理 · 电气工程与系统科学 2026-03-03 Tianyi Zhang , Zheng-Peng Duan , Peng-Tao Jiang , Bo Li , Ming-Ming Cheng , Chun-Le Guo , Chongyi Li

Recent diffusion and flow matching models have demonstrated strong capabilities in image generation and editing by progressively removing noise through iterative sampling. While this enables flexible inversion for semantic-preserving edits,…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Yasong Dai , Zeeshan Hayder , David Ahmedt-Aristizabal , Hongdong Li

Time Series foundation models (TSFMs) deliver strong forecasting performance through large-scale pretraining, but their large parameter sizes make deployment costly. While knowledge distillation offers a natural and effective approach for…

机器学习 · 计算机科学 2026-01-21 Yuqi Li , Kuiye Ding , Chuanguang Yang , Szu-Yu Chen , Yingli Tian

Distribution Matching Distillation (DMD) is a promising score distillation technique that compresses pre-trained teacher diffusion models into efficient one-step or multi-step student generators. Nevertheless, its reliance on the reverse…

计算机视觉与模式识别 · 计算机科学 2025-07-25 Yanzuo Lu , Yuxi Ren , Xin Xia , Shanchuan Lin , Xing Wang , Xuefeng Xiao , Andy J. Ma , Xiaohua Xie , Jian-Huang Lai

Text recognition methods are gaining rapid development. Some advanced techniques, e.g., powerful modules, language models, and un- and semi-supervised learning schemes, consecutively push the performance on public benchmarks forward.…

计算机视觉与模式识别 · 计算机科学 2024-01-01 Ziyin Zhang , Ning Lu , Minghui Liao , Yongshuai Huang , Cheng Li , Min Wang , Wei Peng

Recent advances in continuous generative models, including multi-step approaches like diffusion and flow-matching (typically requiring 8-1000 sampling steps) and few-step methods such as consistency models (typically 1-8 steps), have…

机器学习 · 计算机科学 2025-05-21 Peng Sun , Yi Jiang , Tao Lin

A fundamental dilemma in generative modeling persists: iterative diffusion models achieve outstanding fidelity, but at a significant computational cost, while efficient few-step alternatives are constrained by a hard quality ceiling. This…

机器学习 · 计算机科学 2025-09-05 Zidong Wang , Yiyuan Zhang , Xiaoyu Yue , Xiangyu Yue , Yangguang Li , Wanli Ouyang , Lei Bai

Correlation filter (CF) has recently exhibited promising performance in visual object tracking for unmanned aerial vehicle (UAV). Such online learning method heavily depends on the quality of the training-set, yet complicated aerial…

计算机视觉与模式识别 · 计算机科学 2020-03-12 Fan Li , Changhong Fu , Fuling Lin , Yiming Li , Peng Lu

Despite achieving state-of-the-art generation quality, diffusion models are hindered by the substantial computational burden of their iterative sampling process. While feature caching techniques achieve effective acceleration at higher step…

计算机视觉与模式识别 · 计算机科学 2026-03-04 Benlei Cui , Shaoxuan He , Bukun Huang , Zhizeng Ye , Yunyun Sun , Longtao Huang , Hui Xue , Yang Yang , Jingqun Tang , Zhou Zhao , Haiwen Hong

Diffusion Probability Models (DPMs) have made impressive advancements in various machine learning domains. However, achieving high-quality synthetic samples typically involves performing a large number of sampling steps, which impedes the…

机器学习 · 计算机科学 2024-12-16 Shitong Shao , Xu Dai , Lujun Li , Huanran Chen , Yang Hu , Shouyi Yin

Consistency distillation is a prevalent way for accelerating diffusion models adopted in consistency (trajectory) models, in which a student model is trained to traverse backward on the probability flow (PF) ordinary differential equation…

机器学习 · 计算机科学 2025-05-01 Kaiwen Zheng , Guande He , Jianfei Chen , Fan Bao , Jun Zhu