English
Related papers

Related papers: A Study in Dataset Distillation for Image Super-Re…

200 papers

Modern machine learning models heavily rely on large datasets that often include sensitive and private information, raising serious privacy concerns. Differentially private (DP) data generation offers a solution by creating synthetic…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Runkai Zheng , Vishnu Asutosh Dasu , Yinong Oliver Wang , Haohan Wang , Fernando De la Torre

Dataset distillation (DD) allows datasets to be distilled to fractions of their original size while preserving the rich distributional information, so that models trained on the distilled datasets can achieve a comparable accuracy while…

Machine Learning · Computer Science 2025-04-08 Eric Xue , Yijiang Li , Haoyang Liu , Peiran Wang , Yifan Shen , Haohan Wang

In recent years, the rapid expansion of dataset sizes and the increasing complexity of deep learning models have significantly escalated the demand for computational resources, both for data storage and model training. Dataset distillation…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Zhe Li , Hadrien Reynaud , Mischa Dombrowski , Sarah Cechnicka , Franciskus Xaverius Erick , Bernhard Kainz

Deep learning based Image Super-Resolution (ISR) relies on large training datasets to optimize model generalization; this requires substantial computational and storage resources during training. While dataset condensation (DC) has shown…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Tianhao Peng , Ho Man Kwan , Yuxuan Jiang , Ge Gao , Fan Zhang , Xiaozhong Xu , Shan Liu , David Bull

Dataset distillation has emerged as a strategy to compress real-world datasets for efficient training. However, it struggles with large-scale and high-resolution datasets, limiting its practicality. This paper introduces a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Youbing Hu , Yun Cheng , Olga Saukh , Firat Ozdemir , Anqi Lu , Zhiqiang Cao , Zhijun Li

Dataset distillation has become a popular method for compressing large datasets into smaller, more efficient representations while preserving critical information for model training. Data features are broadly categorized into two types:…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Minh-Tuan Tran , Trung Le , Xuan-May Le , Thanh-Toan Do , Dinh Phung

Data sharing in the medical image analysis field has potential yet remains underappreciated. The aim is often to share datasets efficiently with other sites to train models effectively. One possible solution is to avoid transferring the…

Image and Video Processing · Electrical Eng. & Systems 2025-02-25 Muyang Li , Can Cui , Quan Liu , Ruining Deng , Tianyuan Yao , Marilyn Lionts , Yuankai Huo

Dataset distillation enables the training of deep neural networks with comparable performance in significantly reduced time by compressing large datasets into small and representative ones. Although the introduction of generative models has…

Machine Learning · Computer Science 2025-05-27 Mingzhuo Li , Guang Li , Jiafeng Mao , Takahiro Ogawa , Miki Haseyama

Standard single-image super-resolution creates paired training data from high-resolution images through fixed downsampling kernels. However, real-world super-resolution (RWSR) faces unknown degradations in the low-resolution inputs, all the…

Image and Video Processing · Electrical Eng. & Systems 2024-07-11 Yuehan Zhang , Seungjun Lee , Angela Yao

In recent years, dataset distillation has provided a reliable solution for data compression, where models trained on the resulting smaller synthetic datasets achieve performance comparable to those trained on the original datasets. To…

Dataset distillation (DD) aims to generate a compact yet informative dataset that achieves performance comparable to the original dataset, thereby reducing demands on storage and computational resources. Although diffusion models have made…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Yawen Zou , Guang Li , Zi Wang , Chunzhi Gu , Chao Zhang

Dataset distillation (DD) aims to compress large-scale datasets into compact synthetic sets while preserving training efficacy. However, existing studies mainly focus on image classification, leaving dense prediction tasks such as semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Wenjie Zheng , Haoji Hu , Jiali Lu , Xingze Zou , Jing Wang

Dataset distillation (DD) is an increasingly important technique that focuses on constructing a synthetic dataset capable of capturing the core information in training data to achieve comparable performance in models trained on the latter.…

Machine Learning · Computer Science 2024-09-04 Vyacheslav Kungurtsev , Yuanfang Peng , Jianyang Gu , Saeed Vahidian , Anthony Quinn , Fadwa Idlahcen , Yiran Chen

The extensive amounts of data required for training deep neural networks pose significant challenges on storage and transmission fronts. Dataset distillation has emerged as a promising technique to condense the information of massive…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Ali Abbasi , Ashkan Shahbazi , Hamed Pirsiavash , Soheil Kolouri

Dataset distillation aims to condense large datasets into a small number of synthetic examples that can be used as drop-in replacements when training new models. It has applications to interpretability, neural architecture search, privacy,…

Machine Learning · Computer Science 2024-06-24 Andrei Lupu , Chris Lu , Jarek Liesen , Robert Tjarko Lange , Jakob Foerster

Utilizing a large-scale dataset is essential for training high-performance deep learning models, but it also comes with substantial computation and storage costs. To overcome these challenges, dataset distillation has emerged as a promising…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Donghyeok Shin , HeeSun Bae , Gyuwon Sim , Wanmo Kang , Il-Chul Moon

Dataset distillation aims to compress a training dataset by creating a small number of informative synthetic samples such that neural networks trained on them perform as well as those trained on the original training dataset. Current text…

Computation and Language · Computer Science 2024-04-02 Aru Maekawa , Satoshi Kosugi , Kotaro Funakoshi , Manabu Okumura

Deep neural networks have achieved impressive performance across a wide range of tasks, but this success often comes with substantial computational and storage costs due to large-scale training data. Dataset distillation addresses this…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Mingzhuo Li , Guang Li , Linfeng Ye , Jiafeng Mao , Takahiro Ogawa , Konstantinos N. Plataniotis , Miki Haseyama

Super-resolution (SR) aims to reconstruct high-resolution (HR) images from their low-resolution (LR) counterparts, often relying on effective downsampling to generate diverse and realistic training pairs. In this work, we propose a…

Image and Video Processing · Electrical Eng. & Systems 2025-03-18 Sohwi Kim , Tae-Kyun Kim

Dataset Distillation (DD) is designed to generate condensed representations of extensive image datasets, enhancing training efficiency. Despite recent advances, there remains considerable potential for improvement, particularly in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Bowen Yuan , Zijian Wang , Mahsa Baktashmotlagh , Yadan Luo , Zi Huang