English
Related papers

Related papers: Video Dataset Condensation with Diffusion Models

200 papers

Dataset distillation aims to learn a small synthetic dataset that preserves most of the information from the original dataset. Dataset distillation can be formulated as a bi-level meta-learning problem where the outer loop optimizes the…

Machine Learning · Computer Science 2022-10-25 Yongchao Zhou , Ehsan Nezhadarya , Jimmy Ba

Large convolutional neural network models have recently demonstrated impressive performance on video attention prediction. Conventionally, these models are with intensive computation and large memory. To address these issues, we design an…

Computer Vision and Pattern Recognition · Computer Science 2020-01-03 Kui Fu , Peipei Shi , Yafei Song , Shiming Ge , Xiangju Lu , Jia Li

Diffusion models have achieved remarkable performance on a wide range of generative tasks, yet training them from scratch is notoriously resource-intensive, typically requiring millions of training images and many GPU days. Motivated by a…

Machine Learning · Computer Science 2026-03-16 Rui Huang , Shitong Shao , Zikai Zhou , Pukun Zhao , Hangyu Guo , Tian Ye , Lichen Bai , Shuo Yang , Zeke Xie

Dataset distillation is an advanced technique aimed at compressing datasets into significantly smaller counterparts, while preserving formidable training performance. Significant efforts have been devoted to promote evaluation accuracy…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Yifan Wu , Jiawei Du , Ping Liu , Yuewei Lin , Wei Xu , Wenqing Cheng

Dataset distillation extracts a small set of synthetic training samples from a large dataset with the goal of achieving competitive performance on test data when trained on this sample. In this work, we tackle dataset distillation at its…

Machine Learning · Computer Science 2023-11-14 Yunzhen Feng , Ramakrishna Vedantam , Julia Kempe

Consistency models have demonstrated powerful capability in efficient image generation and allowed synthesis within a few sampling steps, alleviating the high computational cost in diffusion models. However, the consistency model in the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Xiang Wang , Shiwei Zhang , Han Zhang , Yu Liu , Yingya Zhang , Changxin Gao , Nong Sang

Dataset condensation is a newborn technique that generates a small dataset that can be used in training deep neural networks to lower training costs. The objective of dataset condensation is to ensure that the model trained with the…

Machine Learning · Computer Science 2024-10-24 Jianrong Ding , Zhanyu Liu , Guanjie Zheng , Haiming Jin , Linghe Kong

Diffusion models have achieved impressive performance in video generation, but their iterative denoising process remains computationally expensive due to the large number of tokens processed at each timestep. Recently, progressive…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Shikang Zheng , Jingkai Huang , Jiacheng Liu , Guantao Chen , Lixuan , Yuqi Lin , Peiliang Cai , Linfeng Zhang

Dataset distillation (DD) aims to generate a compact yet informative dataset that achieves performance comparable to the original dataset, thereby reducing demands on storage and computational resources. Although diffusion models have made…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Yawen Zou , Guang Li , Zi Wang , Chunzhi Gu , Chao Zhang

Multimodal dataset distillation aims to construct compact synthetic datasets that enable efficient compression and knowledge transfer from large-scale image-text data. However, existing approaches often fail to capture the complex,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Shengbin Guo , Hang Zhao , Senqiao Yang , Chenyang Jiang , Yuhang Cheng , Xiangru Peng , Rui Shao , Zhuotao Tian

Dataset distillation aims at synthesizing a dataset by a small number of artificially generated data items, which, when used as training data, reproduce or approximate a machine learning (ML) model as if it were trained on the entire…

Machine Learning · Computer Science 2024-03-27 Radu-Andrei Rosu , Mihaela-Elena Breaban , Henri Luchian

Dataset Distillation aims to synthesize compact datasets that can approximate the training efficacy of large-scale real datasets, offering an efficient solution to the increasing computational demands of modern deep learning. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Chenru Wang , Yunyi Chen , Zijun Yang , Joey Tianyi Zhou , Chi Zhang

4D radar super-resolution, which aims to reconstruct sparse and noisy point clouds into dense and geometrically consistent representations, is a foundational problem in autonomous perception. However, existing methods often suffer from high…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Minqing Huang , Shouyi Lu , Boyuan Zheng , Ziyao Li , Xiao Tang , Guirong Zhuo

We present Stable Video Diffusion - a latent video diffusion model for high-resolution, state-of-the-art text-to-video and image-to-video generation. Recently, latent diffusion models trained for 2D image synthesis have been turned into…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Andreas Blattmann , Tim Dockhorn , Sumith Kulal , Daniel Mendelevitch , Maciej Kilian , Dominik Lorenz , Yam Levi , Zion English , Vikram Voleti , Adam Letts , Varun Jampani , Robin Rombach

Dataset distillation (DD) has witnessed significant progress in creating small datasets that encapsulate rich information from large original ones. Particularly, methods based on generative priors show promising performance, while…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Jianyang Gu , Haonan Wang , Ruoxi Jia , Saeed Vahidian , Vyacheslav Kungurtsev , Wei Jiang , Yiran Chen

We present a scalable framework designed to craft efficient lightweight models for video object detection utilizing self-training and knowledge distillation techniques. We scrutinize methodologies for the ideal selection of training images…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Dani Manjah , Davide Cacciarelli , Christophe De Vleeschouwer , Benoit Macq

Dataset Distillation (DD) seeks to create a condensed dataset that, when used to train a model, enables the model to achieve performance similar to that of a model trained on the entire original dataset. It relieves the model training from…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Chuhao Zhou , Chenxi Jiang , Yi Xie , Haozhi Cao , Jianfei Yang

Recent works in dataset distillation seek to minimize training expenses by generating a condensed synthetic dataset that encapsulates the information present in a larger real dataset. These approaches ultimately aim to attain test accuracy…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Samir Khaki , Ahmad Sajedi , Kai Wang , Lucy Z. Liu , Yuri A. Lawryshyn , Konstantinos N. Plataniotis

To alleviate the reliance of deep neural networks on large-scale datasets, dataset distillation aims to generate compact, high-quality synthetic datasets that can achieve comparable performance to the original dataset. The integration of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Mingzhuo Li , Guang Li , Jiafeng Mao , Linfeng Ye , Takahiro Ogawa , Miki Haseyama

Data heterogeneity presents significant challenges for federated learning (FL). Recently, dataset distillation techniques have been introduced, and performed at the client level, to attempt to mitigate some of these challenges. In this…

Machine Learning · Computer Science 2023-12-05 Yuqi Jia , Saeed Vahidian , Jingwei Sun , Jianyi Zhang , Vyacheslav Kungurtsev , Neil Zhenqiang Gong , Yiran Chen