English
Related papers

Related papers: Efficient Dataset Distillation via Minimax Diffusi…

200 papers

In this paper, we address the problem of generative dataset distillation that utilizes generative models to synthesize images. The generator may produce any number of images under a preserved evaluation time. In this work, we leverage the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Junqiao Fan , Yunjiao Zhou , Min Chang Jordan Ren , Jianfei Yang

Dataset distillation provides an effective approach to reduce memory and computational costs by optimizing a compact dataset that achieves performance comparable to the full original. However, for large-scale datasets and complex deep…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Xinhao Zhong , Shuoyang Sun , Xulin Gu , Zhaoyang Xu , Yaowei Wang , Min Zhang , Bin Chen

Dataset distillation enables the training of deep neural networks with comparable performance in significantly reduced time by compressing large datasets into small and representative ones. Although the introduction of generative models has…

Machine Learning · Computer Science 2025-05-27 Mingzhuo Li , Guang Li , Jiafeng Mao , Takahiro Ogawa , Miki Haseyama

In this paper, we propose a new dataset distillation method that considers balancing global structure and local details when distilling the information from a large dataset into a generative model. Dataset distillation has been proposed to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Longzhen Li , Guang Li , Ren Togo , Keisuke Maeda , Takahiro Ogawa , Miki Haseyama

While deep learning techniques have proven successful in image-related tasks, the exponentially increased data storage and computation costs become a significant challenge. Dataset distillation addresses these challenges by synthesizing…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Zhe Li , Weitong Zhang , Sarah Cechnicka , Bernhard Kainz

This paper presents our method for the generative track of The First Dataset Distillation Challenge at ECCV 2024. Since the diffusion model has become the mainstay of generative models because of its high-quality generative effects, we…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Duo Su , Junjie Hou , Guang Li , Ren Togo , Rui Song , Takahiro Ogawa , Miki Haseyama

As deep learning models grow in complexity and the volume of training data increases, reducing storage and computational costs becomes increasingly important. Dataset distillation addresses this challenge by synthesizing a compact set of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Zhe Li , Sarah Cechnicka , Cheng Ouyang , Katharina Breininger , Peter Schüffler , Bernhard Kainz

The extensive amounts of data required for training deep neural networks pose significant challenges on storage and transmission fronts. Dataset distillation has emerged as a promising technique to condense the information of massive…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Ali Abbasi , Ashkan Shahbazi , Hamed Pirsiavash , Soheil Kolouri

Dataset distillation is the technique of synthesizing smaller condensed datasets from large original datasets while retaining necessary information to persist the effect. In this paper, we approach the dataset distillation problem from a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Mingyang Chen , Bo Huang , Junda Lu , Bing Li , Yi Wang , Minhao Cheng , Wei Wang

What does a neural network learn when training from a task-specific dataset? Synthesizing this knowledge is the central idea behind Dataset Distillation, which recent work has shown can be used to compress large datasets into a small set of…

Machine Learning · Computer Science 2024-03-05 Tian Qin , Zhiwei Deng , David Alvarez-Melis

Dataset distillation (DD) aims to generate a compact yet informative dataset that achieves performance comparable to the original dataset, thereby reducing demands on storage and computational resources. Although diffusion models have made…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Yawen Zou , Guang Li , Zi Wang , Chunzhi Gu , Chao Zhang

Dataset distillation reduces the network training cost by synthesizing small and informative datasets from large-scale ones. Despite the success of the recent dataset distillation algorithms, three drawbacks still limit their wider…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Kai Wang , Jianyang Gu , Daquan Zhou , Zheng Zhu , Wei Jiang , Yang You

With the rapid scaling of neural networks, data storage and communication demands have intensified. Dataset distillation has emerged as a promising solution, condensing information from extensive datasets into a compact set of synthetic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Ali Abbasi , Shima Imani , Chenyang An , Gayathri Mahalingam , Harsh Shrivastava , Maurice Diesendruck , Hamed Pirsiavash , Pramod Sharma , Soheil Kolouri

The high cost and accessibility problem associated with large datasets hinder the development of large-scale visual recognition systems. Dataset Distillation addresses these problems by synthesizing compact surrogate datasets for efficient…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Tongfei Liu , Yufan Liu , Bing Li , Weiming Hu

Dataset distillation seeks to synthesize a highly compact dataset that achieves performance comparable to the original dataset on downstream tasks. For the classification task that use pre-trained self-supervised models as backbones,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Qianxin Xia , Jiawei Du , Xin Zhang , Yuhan Zhang , Jielei Wang , Guoming Lu

In recent years, the rapid expansion of dataset sizes and the increasing complexity of deep learning models have significantly escalated the demand for computational resources, both for data storage and model training. Dataset distillation…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Zhe Li , Hadrien Reynaud , Mischa Dombrowski , Sarah Cechnicka , Franciskus Xaverius Erick , Bernhard Kainz

Training machine learning models on massive datasets is expensive and time-consuming. Dataset distillation addresses this by creating a small synthetic dataset that achieves the same performance as the full dataset. Recent methods use…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Jeffrey A. Chan-Santiago , Mubarak Shah

Dataset distillation has emerged as an effective strategy, significantly reducing training costs and facilitating more efficient model deployment. Recent advances have leveraged generative models to distill datasets by capturing the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Jeffrey A. Chan-Santiago , Praveen Tirupattur , Gaurav Kumar Nayak , Gaowen Liu , Mubarak Shah

To alleviate the reliance of deep neural networks on large-scale datasets, dataset distillation aims to generate compact, high-quality synthetic datasets that can achieve comparable performance to the original dataset. The integration of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Mingzhuo Li , Guang Li , Jiafeng Mao , Linfeng Ye , Takahiro Ogawa , Miki Haseyama

Generative models, particularly diffusion models, have made significant success in data synthesis across various modalities, including images, videos, and 3D assets. However, current diffusion models are computationally intensive, often…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yuanzhi Zhu , Hanshu Yan , Huan Yang , Kai Zhang , Junnan Li
‹ Prev 1 2 3 10 Next ›