中文
相关论文

相关论文: On Divergence Measures for Bayesian Pseudocoresets

200 篇论文

Dataset distillation (DD) aims to generate a compact yet informative dataset that achieves performance comparable to the original dataset, thereby reducing demands on storage and computational resources. Although diffusion models have made…

计算机视觉与模式识别 · 计算机科学 2026-02-19 Yawen Zou , Guang Li , Zi Wang , Chunzhi Gu , Chao Zhang

Dataset Distillation (DD) aims to distill knowledge from extensive datasets into more compact ones while preserving performance on the test set, thereby reducing storage costs and training expenses. However, existing methods often suffer…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Zheng Zhou , Hongbo Zhao , Guangliang Cheng , Xiangtai Li , Shuchang Lyu , Wenquan Feng , Qi Zhao

Researchers have long tried to minimize training costs in deep learning while maintaining strong generalization across diverse datasets. Emerging research on dataset distillation aims to reduce training costs by creating a small synthetic…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Ahmad Sajedi , Samir Khaki , Ehsan Amjadian , Lucy Z. Liu , Yuri A. Lawryshyn , Konstantinos N. Plataniotis

The aim of dataset distillation is to encode the rich features of an original dataset into a tiny dataset. It is a promising approach to accelerate neural network training and related studies. Different approaches have been proposed to…

Dataset Distillation is the task of synthesizing small datasets from large ones while still retaining comparable predictive accuracy to the original uncompressed dataset. Despite significant empirical progress in recent years, there is…

机器学习 · 计算机科学 2023-05-24 Alaa Maalouf , Murad Tukan , Noel Loo , Ramin Hasani , Mathias Lechner , Daniela Rus

Histopathology can help clinicians make accurate diagnoses, determine disease prognosis, and plan appropriate treatment strategies. As deep learning techniques prove successful in the medical domain, the primary challenges become limited…

计算机视觉与模式识别 · 计算机科学 2024-07-11 Zhe Li , Bernhard Kainz

Dataset distillation (DD) allows datasets to be distilled to fractions of their original size while preserving the rich distributional information, so that models trained on the distilled datasets can achieve a comparable accuracy while…

机器学习 · 计算机科学 2025-04-08 Eric Xue , Yijiang Li , Haoyang Liu , Peiran Wang , Yifan Shen , Haohan Wang

With the rapid scaling of neural networks, data storage and communication demands have intensified. Dataset distillation has emerged as a promising solution, condensing information from extensive datasets into a compact set of synthetic…

计算机视觉与模式识别 · 计算机科学 2024-12-09 Ali Abbasi , Shima Imani , Chenyang An , Gayathri Mahalingam , Harsh Shrivastava , Maurice Diesendruck , Hamed Pirsiavash , Pramod Sharma , Soheil Kolouri

Dataset distillation enables the training of deep neural networks with comparable performance in significantly reduced time by compressing large datasets into small and representative ones. Although the introduction of generative models has…

机器学习 · 计算机科学 2025-05-27 Mingzhuo Li , Guang Li , Jiafeng Mao , Takahiro Ogawa , Miki Haseyama

Dataset distillation synthesizes a small set of images from a large-scale real dataset such that synthetic and real images share similar behavioral properties (e.g, distributions of gradients or features) during a training process. Through…

计算机视觉与模式识别 · 计算机科学 2024-07-12 Byunggwan Son , Youngmin Oh , Donghyeon Baek , Bumsub Ham

Dataset Condensation aims to condense a large dataset into a smaller one while maintaining its ability to train a well-performing model, thus reducing the storage cost and training effort in deep learning applications. However, conventional…

机器学习 · 计算机科学 2023-07-20 Ganlong Zhao , Guanbin Li , Yipeng Qin , Yizhou Yu

Dataset distillation aims to compress information from a large-scale original dataset to a new compact dataset while striving to preserve the utmost degree of the original data informational essence. Previous studies have predominantly…

计算机视觉与模式识别 · 计算机科学 2024-04-12 Muxin Zhou , Zeyuan Yin , Shitong Shao , Zhiqiang Shen

It is essential but challenging to share medical image datasets due to privacy issues, which prohibit building foundation models and knowledge transfer. In this paper, we propose a novel dataset distillation method to condense the original…

计算机视觉与模式识别 · 计算机科学 2024-03-21 Zhen Yu , Yang Liu , Qingchao Chen

We introduce a distortion measure for images, Wasserstein distortion, that simultaneously generalizes pixel-level fidelity on the one hand and realism or perceptual quality on the other. We show how Wasserstein distortion reduces to a pure…

信息论 · 计算机科学 2024-04-01 Yang Qiu , Aaron B. Wagner , Johannes Ballé , Lucas Theis

Dataset distillation (DD) is an increasingly important technique that focuses on constructing a synthetic dataset capable of capturing the core information in training data to achieve comparable performance in models trained on the latter.…

Generating synthetic data, with or without differential privacy, has attracted significant attention as a potential solution to the dilemma between making data easily available, and the privacy of data subjects. Several works have shown…

统计方法学 · 统计学 2023-11-01 Ossi Räisä , Joonas Jälkö , Antti Honkela

Optimization constrained by high-fidelity computational models has potential for transformative impact. However, such optimization is frequently unattainable in practice due to the complexity and computational intensity of the model. An…

数值分析 · 数学 2024-06-04 Joseph Hart , Bart van Bloemen Waanders

To address the computational and storage challenges posed by large-scale datasets in deep learning, dataset distillation has been proposed to synthesize a compact dataset that replaces the original while maintaining comparable model…

机器学习 · 计算机科学 2025-10-20 Wenyuan Li , Guang Li , Keisuke Maeda , Takahiro Ogawa , Miki Haseyama

The estimation of small probabilities of failure from computer simulations is a classical problem in engineering, and the Subset Simulation algorithm proposed by Au & Beck (Prob. Eng. Mech., 2001) has become one of the most popular method…

统计计算 · 统计学 2012-07-10 Ling Li , Julien Bect , Emmanuel Vazquez

To alleviate the reliance of deep neural networks on large-scale datasets, dataset distillation aims to generate compact, high-quality synthetic datasets that can achieve comparable performance to the original dataset. The integration of…

计算机视觉与模式识别 · 计算机科学 2025-07-18 Mingzhuo Li , Guang Li , Jiafeng Mao , Linfeng Ye , Takahiro Ogawa , Miki Haseyama