English
Related papers

Related papers: Collaborative-Distilled Diffusion Models (CDDM) fo…

200 papers

Dataset distillation seeks to condense datasets into smaller but highly representative synthetic samples. While diffusion models now lead all generative benchmarks, current distillation methods avoid them and rely instead on GANs or…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Brian B. Moser , Federico Raue , Sebastian Palacio , Stanislav Frolov , Andreas Dengel

Human motion prediction is a cornerstone of human-robot collaboration (HRC), as robots need to infer the future movements of human workers based on past motion cues to proactively plan their motion, ensuring safety in close collaboration…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Sibo Tian , Minghui Zheng , Xiao Liang

Dataset Distillation (DD) seeks to create a condensed dataset that, when used to train a model, enables the model to achieve performance similar to that of a model trained on the entire original dataset. It relieves the model training from…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Chuhao Zhou , Chenxi Jiang , Yi Xie , Haozhi Cao , Jianfei Yang

Diffusion models have recently emerged as powerful tools for missing data imputation by modeling the joint distribution of observed and unobserved variables. However, existing methods, typically based on stochastic denoising diffusion…

Artificial Intelligence · Computer Science 2025-08-06 Youran Zhou , Mohamed Reda Bouadjenek , Sunil Aryal

The ability to predict the future trajectories of traffic participants is crucial for the safe and efficient operation of autonomous vehicles. In this paper, a diffusion-based generative model for multi-agent trajectory prediction is…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Theodor Westny , Björn Olofsson , Erik Frisk

Diffusion Language Models (DLMs) offer a promising parallel generation paradigm but suffer from slow inference due to numerous refinement steps and the inability to use standard KV caching. We introduce CDLM (Consistency Diffusion Language…

Machine Learning · Computer Science 2026-02-23 Minseo Kim , Chenfeng Xu , Coleman Hooper , Harman Singh , Ben Athiwaratkun , Ce Zhang , Kurt Keutzer , Amir Gholami

Dense visual prediction tasks, such as detection and segmentation, are crucial for time-critical applications (e.g., autonomous driving and video surveillance). While deep models achieve strong performance, their efficiency remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Qizhen Lan , Qing Tian

Diffusion models have recently emerged as effective generative frameworks for trajectory optimization, capable of producing high-quality and diverse solutions. However, training these models in a purely data-driven manner without explicit…

Robotics · Computer Science 2025-04-02 Anjian Li , Ryne Beeson

DEtection TRansformer (DETR) becomes a dominant paradigm, mainly due to its common architecture with high accuracy and no post-processing. However, DETR suffers from unstable training dynamics. It consumes more data and epochs to converge…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Shengjian Wu , Li Sun , Qingli Li

Diffusion distillation methods aim to compress the diffusion models into efficient one-step generators while trying to preserve quality. Among them, Distribution Matching Distillation (DMD) offers a suitable framework for training…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Denis Rakitin , Ivan Shchekotov , Dmitry Vetrov

Spatio-temporal time series are widely used in real-world applications, including traffic prediction and weather forecasting. They are sequences of observations over extensive periods and multiple locations, naturally represented as…

Machine Learning · Computer Science 2026-03-12 Taehyung Kwon , Yeonje Choi , Yeongho Kim , Kijung Shin

Training deep learning methods on small time series datasets that also include corrupted samples is challenging. Diffusion models have shown to be effective to generate realistic and synthetic data, and correct corrupted samples through…

Machine Learning · Computer Science 2025-09-17 Julian Ripper , Ousama Esbel , Rafael Fietzek , Max Mühlhäuser , Thomas Kreutz

While deep neural networks (NN) significantly advance image compressed sensing (CS) by improving reconstruction quality, the necessity of training current CS NNs from scratch constrains their effectiveness and hampers rapid deployment.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Bin Chen , Zhenyu Zhang , Weiqi Li , Chen Zhao , Jiwen Yu , Shijie Zhao , Jie Chen , Jian Zhang

Scene information plays a crucial role in trajectory forecasting systems for autonomous driving by providing semantic clues and constraints on potential future paths of traffic agents. Prevalent trajectory prediction techniques often take…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Yuning Wang , Pu Zhang , Lei Bai , Jianru Xue

Diffusion models (DMs) have been adopted across diverse fields with its remarkable abilities in capturing intricate data distributions. In this paper, we propose a Fast Diffusion Model (FDM) to significantly speed up DMs from a stochastic…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Zike Wu , Pan Zhou , Kenji Kawaguchi , Hanwang Zhang

Real-world object detection models should be cheap and accurate. Knowledge distillation (KD) can boost the accuracy of a small, cheap detection model by leveraging useful information from a larger teacher model. However, a key challenge is…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Chenhongyi Yang , Mateusz Ochal , Amos Storkey , Elliot J. Crowley

Dataset distillation has emerged as an effective strategy, significantly reducing training costs and facilitating more efficient model deployment. Recent advances have leveraged generative models to distill datasets by capturing the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Jeffrey A. Chan-Santiago , Praveen Tirupattur , Gaurav Kumar Nayak , Gaowen Liu , Mubarak Shah

Autonomous driving systems rely on panoptic perception to jointly handle object detection, drivable area segmentation, and lane line segmentation. Although multi-task learning is an effective way to integrate these tasks, its increasing…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Jiayuan Wang , Q. M. Jonathan Wu , Ning Zhang , Katsuya Suto , Lei Zhong

Knowledge distillation methods have recently shown to be a promising direction to speedup the synthesis of large-scale diffusion models by requiring only a few inference steps. While several powerful distillation methods were recently…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Nikita Starodubcev , Artem Fedorov , Artem Babenko , Dmitry Baranchuk

Dataset distillation enables the training of deep neural networks with comparable performance in significantly reduced time by compressing large datasets into small and representative ones. Although the introduction of generative models has…

Machine Learning · Computer Science 2025-05-27 Mingzhuo Li , Guang Li , Jiafeng Mao , Takahiro Ogawa , Miki Haseyama