English
Related papers

Related papers: D3S2: Diffusion-Guided Dataset Distillation for Se…

200 papers

Training state-of-the-art (SOTA) deep models often requires extensive data, resulting in substantial training and storage costs. To address these challenges, dataset condensation has been developed to learn a small synthetic set that…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Hansong Zhang , Shikun Li , Pengju Wang , Dan Zeng , Shiming Ge

Dataset distillation compresses the original data into compact synthetic datasets, reducing training time and storage while retaining model performance, enabling deployment under limited resources. Although recent decoupling-based…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Muhammad J. Alahmadi , Peng Gao , Feiyi Wang , Dongkuan Xu

We introduce Posterior Distillation Sampling (PDS), a novel optimization method for parametric image editing based on diffusion models. Existing optimization-based methods, which leverage the powerful 2D prior of diffusion models to handle…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Juil Koo , Chanho Park , Minhyuk Sung

With the exponential increase in image data, training an image restoration model is laborious. Dataset distillation is a potential solution to this problem, yet current distillation techniques are a blank canvas in the field of image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Zhuoran Zheng , Xin Su , Chen Wu , Xiuyi Jia

Dataset distillation offers a lightweight synthetic dataset for fast network training with promising test accuracy. To imitate the performance of the original dataset, most approaches employ bi-level optimization and the distillation space…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Duo Su , Junjie Hou , Weizhi Gao , Yingjie Tian , Bowen Tang

Dataset distillation (DD) has emerged as a powerful paradigm for dataset compression, enabling the synthesis of compact surrogate datasets that approximate the training utility of large-scale ones. While significant progress has been…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Xulin Gu , Xinhao Zhong , Zhixing Wei , Yimin Zhou , Shuoyang Sun , Bin Chen , Hongpeng Wang , Yuan Luo

Dataset distillation (DD) condenses large datasets into compact yet informative substitutes, preserving performance comparable to the original dataset while reducing storage, transmission costs, and computational consumption. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Yawen Zou , Guang Li , Duo Su , Zi Wang , Jun Yu , Chao Zhang

Deploying high-performing 3D medical image segmenters (e.g., nnU-Net) is often limited by memory footprint and inference latency. Compression is therefore necessary, but compact 3D encoders tend to lose fine structural cues (small lesions…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Mengchen Fan , Baocheng Geng , Xi Xiao , Tianyang Wang , Siyuan Mei , Pulin Che , Xiaoqian Jiang , Qizhen Lan

In this paper, we address the problem of high performance and computationally efficient content-based video retrieval in large-scale datasets. Current methods typically propose either: (i) fine-grained approaches employing spatio-temporal…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Giorgos Kordopatis-Zilos , Christos Tzelepis , Symeon Papadopoulos , Ioannis Kompatsiaris , Ioannis Patras

Dataset distillation has emerged as a strategy to compress real-world datasets for efficient training. However, it struggles with large-scale and high-resolution datasets, limiting its practicality. This paper introduces a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Youbing Hu , Yun Cheng , Olga Saukh , Firat Ozdemir , Anqi Lu , Zhiqiang Cao , Zhijun Li

Dataset distillation synthesizes a small dataset such that a model trained on this set approximates the performance of the original dataset. Recent studies on dataset distillation focused primarily on the design of the optimization process,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Shiguang Wang , Zhongyu Zhang , Jian Cheng

Dataset distillation aims to create a compact dataset that retains essential information while maintaining model performance. Diffusion models (DMs) have shown promise for this task but struggle in low images-per-class (IPC) settings, where…

Machine Learning · Computer Science 2025-07-08 Linfeng Ye , Shayan Mohajer Hamidi , Guang Li , Takahiro Ogawa , Miki Haseyama , Konstantinos N. Plataniotis

Cross-Domain Few-Shot Semantic Segmentation (CD-FSS) seeks to segment unknown classes in unseen domains using only a few annotated examples. This setting is inherently challenging: source and target domains exhibit substantial distribution…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Pasquale De Marinis , Pieter M. Blok , Uzay Kaymak , Rogier Brussee , Gennaro Vessio , Giovanna Castellano

Foundation models have significantly enhanced 2D task performance, and recent works like Bridge3D have successfully applied these models to improve 3D scene understanding through knowledge distillation, marking considerable advancements.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Zhimin Chen , Liang Yang , Yingwei Li , Longlong Jing , Bing Li

Dataset Distillation (DD) synthesizes a compact synthetic dataset that preserves the training utility of a full dataset. However, its standard formulation assumes that test data follow the same distribution as training data, an assumption…

Machine Learning · Computer Science 2026-05-20 Minyoung Oh , Najeong Chae , Jae-Young Sim

Dataset distillation is the technique of synthesizing smaller condensed datasets from large original datasets while retaining necessary information to persist the effect. In this paper, we approach the dataset distillation problem from a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Mingyang Chen , Bo Huang , Junda Lu , Bing Li , Yi Wang , Minhao Cheng , Wei Wang

Dataset condensation always faces a constitutive trade-off: balancing performance and fidelity under extreme compression. Existing methods struggle with two bottlenecks: image-level selection methods (Coreset Selection, Dataset…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Huyu Wu , Duo Su , Junjie Hou , Guang Li

4D radar super-resolution, which aims to reconstruct sparse and noisy point clouds into dense and geometrically consistent representations, is a foundational problem in autonomous perception. However, existing methods often suffer from high…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Minqing Huang , Shouyi Lu , Boyuan Zheng , Ziyao Li , Xiao Tang , Guirong Zhuo

Reasoning segmentation enables open-set object segmentation via implicit text queries, therefore serving as a foundation for embodied agents that should operate autonomously in real-world environments. However, existing methods for…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yiqing Shen , Mathias Unberath

Recent approaches have shown promises distilling diffusion models into efficient one-step generators. Among them, Distribution Matching Distillation (DMD) produces one-step generators that match their teacher in distribution, without…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Tianwei Yin , Michaël Gharbi , Taesung Park , Richard Zhang , Eli Shechtman , Fredo Durand , William T. Freeman