English
Related papers

Related papers: Collaborative-Distilled Diffusion Models (CDDM) fo…

200 papers

Joint pedestrian trajectory prediction has long grappled with the inherent unpredictability of human behaviors. Recent investigations employing variants of conditional diffusion models in trajectory prediction have exhibited notable…

Robotics · Computer Science 2024-09-05 Haotian Lin , Yixiao Wang , Mingxiao Huo , Chensheng Peng , Zhiyuan Liu , Masayoshi Tomizuka

Trajectory prediction is essential for autonomous driving, enabling vehicles to anticipate the motion of surrounding agents to support safe planning. However, most existing predictors assume fixed-length histories and suffer substantial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Mingyu Fan , Yi Liu , Hao Zhou , Deheng Qian , Mohammad Haziq Khan , Matthias Raetsch

Discrete flow matching generates text by iteratively transforming noise tokens into coherent language, but may require hundreds of forward passes. Distillation uses the multi-step trajectory to train a student to reproduce the process in a…

Machine Learning · Computer Science 2026-05-11 Amin Karimi Monsefi , Dominic Culver , Nikhil Bhendawade , Manuel R. Ciosici , Yizhe Zhang , Irina Belousova

Diffusion distillation models effectively accelerate reverse sampling by compressing the process into fewer steps. However, these models still exhibit a performance gap compared to their pre-trained diffusion model counterparts, exacerbated…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Geon Yeong Park , Sang Wan Lee , Jong Chul Ye

This work introduces Variational Diffusion Distillation (VDD), a novel method that distills denoising diffusion policies into Mixtures of Experts (MoE) through variational inference. Diffusion Models are the current state-of-the-art in…

Machine Learning · Computer Science 2024-10-22 Hongyi Zhou , Denis Blessing , Ge Li , Onur Celik , Xiaogang Jia , Gerhard Neumann , Rudolf Lioutikov

Predicting pedestrian motion trajectories is critical for the path planning and motion control of autonomous vehicles. Recent diffusion-based models have shown promising results in capturing the inherent stochasticity of pedestrian behavior…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Yu Liu , Zhijie Liu , Xiao Ren , You-Fu Li , He Kong

Discrete diffusion models have emerged as powerful tools for high-quality data generation. Despite their success in discrete spaces, such as text generation tasks, the acceleration of discrete diffusion models remains under-explored. In…

Machine Learning · Computer Science 2024-12-09 Zixiang Chen , Huizhuo Yuan , Yongqian Li , Yiwen Kou , Junkai Zhang , Quanquan Gu

Video prediction is a useful function for autonomous driving, enabling intelligent vehicles to reliably anticipate how driving scenes will evolve and thereby supporting reasoning and safer planning. However, existing models are constrained…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Ke Li , Tianjia Yang , Kaidi Liang , Xianbiao Hu , Ruwen Qin

Diffusion models exhibit excellent sample quality, but existing guidance methods often require additional model training or are limited to specific tasks. We revisit guidance in diffusion models from the perspective of variational inference…

Machine Learning · Computer Science 2025-05-27 Kushagra Pandey , Farrin Marouf Sofian , Felix Draxler , Theofanis Karaletsos , Stephan Mandt

Diffusion models (DMs) have become the dominant paradigm of generative modeling in a variety of domains by learning stochastic processes from noise to data. Recently, diffusion denoising bridge models (DDBMs), a new formulation of…

Machine Learning · Computer Science 2024-11-01 Guande He , Kaiwen Zheng , Jianfei Chen , Fan Bao , Jun Zhu

Flow-based 3D generation models typically require dozens of sampling steps during inference. Though few-step distillation methods, particularly Consistency Models (CMs), have achieved substantial advancements in accelerating 2D diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Zanwei Zhou , Taoran Yi , Jiemin Fang , Chen Yang , Lingxi Xie , Xinggang Wang , Wei Shen , Qi Tian

Modeling physical systems in a generative manner offers several advantages, including the ability to handle partial observations, generate diverse solutions, and address both forward and inverse problems. Recently, diffusion models have…

Machine Learning · Computer Science 2025-05-29 Yi Zhang , Difan Zou

Accurate prediction of human or vehicle trajectories with good diversity that captures their stochastic nature is an essential task for many applications. However, many trajectory prediction models produce unreasonable trajectory samples…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Qingze , Liu , Danrui Li , Samuel S. Sohn , Sejong Yoon , Mubbasir Kapadia , Vladimir Pavlovic

Recently, a series of diffusion-aware distillation algorithms have emerged to alleviate the computational overhead associated with the multi-step inference process of Diffusion Models (DMs). Current distillation techniques often dichotomize…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Yuxi Ren , Xin Xia , Yanzuo Lu , Jiacheng Zhang , Jie Wu , Pan Xie , Xing Wang , Xuefeng Xiao

Distribution Matching Distillation (DMD) distills score-based generative models into efficient one-step generators, without requiring a one-to-one correspondence with the sampling trajectories of their teachers. Yet, the limited capacity of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Xiangyu Fan , Zesong Qiu , Zhuguanyu Wu , Fanzhou Wang , Zhiqian Lin , Tianxiang Ren , Dahua Lin , Ruihao Gong , Lei Yang

Ensuring safe interactions between autonomous vehicles (AVs) and human drivers in mixed traffic systems remains a major challenge, particularly in complex, high-risk scenarios. This paper presents a cognition-decision framework that…

Artificial Intelligence · Computer Science 2025-03-18 Heye Huang , Zheng Li , Hao Cheng , Haoran Wang , Junkai Jiang , Xiaopeng Li , Arkady Zgonnikov

Learning diffusion bridge models is easy; making them fast and practical is an art. Diffusion bridge models (DBMs) are a promising extension of diffusion models for applications in image-to-image translation. However, like many modern…

Machine Learning · Computer Science 2025-08-19 Nikita Gushchin , David Li , Daniil Selikhanovych , Evgeny Burnaev , Dmitry Baranchuk , Alexander Korotin

It remains very challenging to build a pedestrian detection system for real world applications, which demand for both accuracy and speed. This work presents a novel hierarchical knowledge distillation framework to learn a lightweight…

Computer Vision and Pattern Recognition · Computer Science 2019-09-23 Rui Chen , Haizhou Ai , Chong Shang , Long Chen , Zijie Zhuang

Sampling from diffusion probabilistic models (DPMs) can be viewed as a piecewise distribution transformation, which generally requires hundreds or thousands of steps of the inverse diffusion trajectory to get a high-quality image. Recent…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Zezeng Li , ShengHao Li , Zhanpeng Wang , Na Lei , Zhongxuan Luo , Xianfeng Gu

While diffusion models can learn complex distributions, sampling requires a computationally expensive iterative process. Existing distillation methods enable efficient sampling, but have notable limitations, such as performance degradation…

Machine Learning · Computer Science 2024-12-09 Sirui Xie , Zhisheng Xiao , Diederik P Kingma , Tingbo Hou , Ying Nian Wu , Kevin Patrick Murphy , Tim Salimans , Ben Poole , Ruiqi Gao