English
Related papers

Related papers: Sequential Subset Matching for Dataset Distillatio…

200 papers

Deep learning has grown tremendously over recent years, yielding state-of-the-art results in various fields. However, training such models requires huge amounts of data, increasing the computational time and cost. To address this, dataset…

Machine Learning · Computer Science 2023-07-18 Murad Tukan , Alaa Maalouf , Margarita Osadchy

Histopathology can help clinicians make accurate diagnoses, determine disease prognosis, and plan appropriate treatment strategies. As deep learning techniques prove successful in the medical domain, the primary challenges become limited…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Zhe Li , Bernhard Kainz

Dataset Distillation is used to create a concise, yet informative, synthetic dataset that can replace the original dataset for training purposes. Some leading methods in this domain prioritize long-range matching, involving the unrolling of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Dai Liu , Jindong Gu , Hu Cao , Carsten Trinitis , Martin Schulz

Huge amount of data is the key of the success of deep learning, however, redundant information impairs the generalization ability of the model and increases the burden of calculation. Dataset Distillation (DD) compresses the original…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Hangyang Kong , Wenbo Zhou , Xuxiang He , Xiaotong Tu , Xinghao Ding

Dataset distillation, which condenses large-scale datasets into compact synthetic representations, has emerged as a critical solution for training modern deep learning models efficiently. While prior surveys focus on developments before…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Ping Liu , Jiawei Du

Dataset distillation aims to compress information from a large-scale original dataset to a new compact dataset while striving to preserve the utmost degree of the original data informational essence. Previous studies have predominantly…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Muxin Zhou , Zeyuan Yin , Shitong Shao , Zhiqiang Shen

Dataset distillation is an effective technique for reducing the cost and complexity of model training while maintaining performance by compressing large datasets into smaller, more efficient versions. In this paper, we present a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Longzhen Li , Guang Li , Ren Togo , Keisuke Maeda , Takahiro Ogawa , Miki Haseyama

Dataset distillation aims to synthesize small datasets with little information loss from original large-scale ones for reducing storage and training costs. Recent state-of-the-art methods mainly constrain the sample synthesis process by…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Yanqing Liu , Jianyang Gu , Kai Wang , Zheng Zhu , Wei Jiang , Yang You

The sharp increase in data-related expenses has motivated research into condensing datasets while retaining the most informative features. Dataset distillation has thus recently come to the fore. This paradigm generates synthetic datasets…

Machine Learning · Computer Science 2024-11-20 Jiawei Du , Xin Zhang , Juncheng Hu , Wenxin Huang , Joey Tianyi Zhou

Dataset distillation or condensation aims to generate a smaller but representative subset from a large dataset, which allows a model to be trained more efficiently, meanwhile evaluating on the original testing data distribution to achieve…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Zeyuan Yin , Zhiqiang Shen

Dataset distillation has emerged as a strategy to overcome the hurdles associated with large datasets by learning a compact set of synthetic data that retains essential information from the original dataset. While distilled data can be used…

Machine Learning · Computer Science 2024-07-23 William Yang , Ye Zhu , Zhiwei Deng , Olga Russakovsky

Dataset distillation provides an effective approach to reduce memory and computational costs by optimizing a compact dataset that achieves performance comparable to the full original. However, for large-scale datasets and complex deep…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Xinhao Zhong , Shuoyang Sun , Xulin Gu , Zhaoyang Xu , Yaowei Wang , Min Zhang , Bin Chen

Recently, deep learning technology has been successfully introduced into Automatic Modulation Recognition (AMR) tasks. However, the success of deep learning is all attributed to the training on large-scale datasets. Such a large amount of…

Machine Learning · Computer Science 2024-08-07 Dongwei Xu , Jiajun Chen , Yao Lu , Tianhao Xia , Qi Xuan , Wei Wang , Yun Lin , Xiaoniu Yang

Deep neural networks have achieved impressive performance across a wide range of tasks, but this success often comes with substantial computational and storage costs due to large-scale training data. Dataset distillation addresses this…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Mingzhuo Li , Guang Li , Linfeng Ye , Jiafeng Mao , Takahiro Ogawa , Konstantinos N. Plataniotis , Miki Haseyama

The great success of machine learning with massive amounts of data comes at a price of huge computation costs and storage for training and tuning. Recent studies on dataset condensation attempt to reduce the dependence on such massive data…

Machine Learning · Computer Science 2022-06-03 Jang-Hyun Kim , Jinuk Kim , Seong Joon Oh , Sangdoo Yun , Hwanjun Song , Joonhyun Jeong , Jung-Woo Ha , Hyun Oh Song

What does a neural network learn when training from a task-specific dataset? Synthesizing this knowledge is the central idea behind Dataset Distillation, which recent work has shown can be used to compress large datasets into a small set of…

Machine Learning · Computer Science 2024-03-05 Tian Qin , Zhiwei Deng , David Alvarez-Melis

The popularity of deep learning has led to the curation of a vast number of massive and multifarious datasets. Despite having close-to-human performance on individual tasks, training parameter-hungry models on large datasets poses…

Machine Learning · Computer Science 2023-09-27 Noveen Sachdeva , Julian McAuley

Deep neural networks (DNNs) have exhibited remarkable success in the field of histopathology image analysis. On the other hand, the contemporary trend of employing large models and extensive datasets has underscored the significance of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Cong Cong , Shiyu Xuan , Sidong Liu , Maurice Pagnucco , Shiliang Zhang , Yang Song

Dataset distillation enables the training of deep neural networks with comparable performance in significantly reduced time by compressing large datasets into small and representative ones. Although the introduction of generative models has…

Machine Learning · Computer Science 2025-05-27 Mingzhuo Li , Guang Li , Jiafeng Mao , Takahiro Ogawa , Miki Haseyama

As the state-of-the-art machine learning methods in many fields rely on larger datasets, storing datasets and training models on them become significantly more expensive. This paper proposes a training set synthesis technique for…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Bo Zhao , Konda Reddy Mopuri , Hakan Bilen