English
Related papers

Related papers: M3D: Dataset Condensation by Minimizing Maximum Me…

200 papers

Model-based deep learning has achieved astounding successes due in part to the availability of large-scale real-world data. However, processing such massive amounts of data comes at a considerable cost in terms of computations, storage,…

Machine Learning · Computer Science 2023-03-28 Jiawei Du , Yidi Jiang , Vincent Y. F. Tan , Joey Tianyi Zhou , Haizhou Li

Dataset distillation or condensation refers to compressing a large-scale dataset into a much smaller one, enabling models trained on this synthetic dataset to generalize effectively on real data. Tackling this challenge, as defined, relies…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Ruonan Yu , Songhua Liu , Jingwen Ye , Xinchao Wang

Multimodal Dataset Distillation (MDD) seeks to condense large-scale image-text datasets into compact surrogates while retaining their effectiveness for cross-modal learning. Despite recent progress, existing MDD approaches often suffer from…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Xin Zhang , Ziruo Zhang , Jiawei Du , Zuozhu Liu , Joey Tianyi Zhou

Existing distribution compression methods reduce the number of observations in a dataset by minimising the Maximum Mean Discrepancy (MMD) between original and compressed sets, but modern datasets are often large in both sample size and…

Machine Learning · Statistics 2026-01-28 Dominic Broadbent , Nick Whiteley , Robert Allison , Tom Lovett

Abstract. The advancement of deep learning has coincided with the proliferation of both models and available data. The surge in dataset sizes and the subsequent surge in computational requirements have led to the development of the Dataset…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Jun-Yeong Moon , Jung Uk Kim , Gyeong-Moon Park

Deep learning based Image Super-Resolution (ISR) relies on large training datasets to optimize model generalization; this requires substantial computational and storage resources during training. While dataset condensation (DC) has shown…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Tianhao Peng , Ho Man Kwan , Yuxuan Jiang , Ge Gao , Fan Zhang , Xiaozhong Xu , Shan Liu , David Bull

Dataset distillation (DD) aims to minimize the time and memory consumption needed for training deep neural networks on large datasets, by creating a smaller synthetic dataset that has similar performance to that of the full real dataset.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Xinhao Zhong , Bin Chen , Hao Fang , Xulin Gu , Shu-Tao Xia , En-Hui Yang

Dataset distillation seeks to condense datasets into smaller but highly representative synthetic samples. While diffusion models now lead all generative benchmarks, current distillation methods avoid them and rely instead on GANs or…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Brian B. Moser , Federico Raue , Sebastian Palacio , Stanislav Frolov , Andreas Dengel

Dataset condensation aims at reducing the network training effort through condensing a cumbersome training set into a compact synthetic one. State-of-the-art approaches largely rely on learning the synthetic data by matching the gradients…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Kai Wang , Bo Zhao , Xiangyu Peng , Zheng Zhu , Shuo Yang , Shuo Wang , Guan Huang , Hakan Bilen , Xinchao Wang , Yang You

Dataset distillation reduces the network training cost by synthesizing small and informative datasets from large-scale ones. Despite the success of the recent dataset distillation algorithms, three drawbacks still limit their wider…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Kai Wang , Jianyang Gu , Daquan Zhou , Zheng Zhu , Wei Jiang , Yang You

Dataset distillation aims to generate compact synthetic datasets that enable models trained on them to achieve performance comparable to those trained on full real datasets, while substantially reducing storage and computational costs.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Xinhao Zhong , Shuoyang Sun , Xulin Gu , Chenyang Zhu , Bin Chen , Yaowei Wang

Although larger datasets are crucial for training large deep models, the rapid growth of dataset size has brought a significant challenge in terms of considerable training costs, which even results in prohibitive computational expenses.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Sheng-Feng Yu , Jia-Jiun Yao , Wei-Chen Chiu

Dataset distillation (DD) is an increasingly important technique that focuses on constructing a synthetic dataset capable of capturing the core information in training data to achieve comparable performance in models trained on the latter.…

Machine Learning · Computer Science 2024-09-04 Vyacheslav Kungurtsev , Yuanfang Peng , Jianyang Gu , Saeed Vahidian , Anthony Quinn , Fadwa Idlahcen , Yiran Chen

Recent advances in dataset distillation have led to solutions in two main directions. The conventional batch-to-batch matching mechanism is ideal for small-scale datasets and includes bi-level optimization methods on models and syntheses,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Zhiqiang Shen , Ammar Sherif , Zeyuan Yin , Shitong Shao

Dataset distillation enables efficient training by distilling the information of large-scale datasets into significantly smaller synthetic datasets. Diffusion based paradigms have emerged in recent years, offering novel perspectives for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Qichao Wang , Yunhong Lu , Hengyuan Cao , Junyi Zhang , Min Zhang

Dataset distillation seeks to synthesize a compact distilled dataset, enabling models trained on it to achieve performance comparable to models trained on the full dataset. Recent methods for large-scale datasets focus on matching global…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Xiao Cui , Yulei Qin , Wengang Zhou , Hongsheng Li , Houqiang Li

Obtaining accurate 3D object poses is vital for numerous computer vision applications, such as 3D reconstruction and scene understanding. However, annotating real-world objects is time-consuming and challenging. While synthetically…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Jiahao Yang , Wufei Ma , Angtian Wang , Xiaoding Yuan , Alan Yuille , Adam Kortylewski

Modern computational science and engineering applications are being improved by the advances in scientific machine learning. Data-driven methods such as Dynamic Mode Decomposition (DMD) can extract coherent structures from spatio-temporal…

Graphics · Computer Science 2022-08-17 Gabriel F. Barros , Malú Grave , José J. Camata , Alvaro L. G. A. Coutinho

Dataset Distillation (DD), a newly emerging field, aims at generating much smaller but efficient synthetic training datasets from large ones. Existing DD methods based on gradient matching achieve leading performance; however, they are…

Machine Learning · Computer Science 2023-04-18 Lei Zhang , Jie Zhang , Bowen Lei , Subhabrata Mukherjee , Xiang Pan , Bo Zhao , Caiwen Ding , Yao Li , Dongkuan Xu

Multi-object tracking (MOT) is a fundamental task in computer vision with critical applications in autonomous driving and robotics. Multimodal MOT that integrates visible light and thermal infrared information is particularly essential for…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Weiran Li , Yeqiang Liu , Yijie Wei , Mina Han , Qiannan Guo , Zhenbo Li