English
Related papers

Related papers: DMGD: Train-Free Dataset Distillation with Semanti…

200 papers

Diffusion models have revolutionized generative tasks through high-fidelity outputs, yet flow matching (FM) offers faster inference and empirical performance gains. However, current foundation FM models are computationally prohibitive for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Johannes Schusterbauer , Ming Gui , Frank Fundel , Björn Ommer

Recent advances in conditional image generation from diffusion models have shown great potential in achieving impressive image quality while preserving the constraints introduced by the user. In particular, ControlNet enables precise…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Hannah Kniesel , Pedro Hermosilla , Timo Ropinski

Adding additional control to pretrained diffusion models has become an increasingly popular research area, with extensive applications in computer vision, reinforcement learning, and AI for science. Recently, several studies have proposed…

Machine Learning · Computer Science 2024-05-30 Yifei Shen , Xinyang Jiang , Yezhen Wang , Yifan Yang , Dongqi Han , Dongsheng Li

Recent advancements in dataset distillation have demonstrated the significant benefits of employing soft labels generated by pre-trained teacher models. In this paper, we introduce a novel perspective by emphasizing the full utilization of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Xinyi Shang , Peng Sun , Tao Lin

Dataset distillation (DD) has witnessed significant progress in creating small datasets that encapsulate rich information from large original ones. Particularly, methods based on generative priors show promising performance, while…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Jianyang Gu , Haonan Wang , Ruoxi Jia , Saeed Vahidian , Vyacheslav Kungurtsev , Wei Jiang , Yiran Chen

Deep neural networks (DNNs) have achieved significant success in numerous applications. The remarkable performance of DNNs is largely attributed to the availability of massive, high-quality training datasets. However, processing such…

Sound · Computer Science 2024-07-23 Wenbo Jiang , Rui Zhang , Hongwei Li , Xiaoyuan Liu , Haomiao Yang , Shui Yu

Lidar point cloud synthesis based on generative models offers a promising solution to augment deep learning pipelines, particularly when real-world data is scarce or lacks diversity. By enabling flexible object manipulation, this synthesis…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Zhengkang Xiang , Zizhao Li , Amir Khodabandeh , Kourosh Khoshelham

Dataset distillation (DD) aims to minimize the time and memory consumption needed for training deep neural networks on large datasets, by creating a smaller synthetic dataset that has similar performance to that of the full real dataset.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Xinhao Zhong , Bin Chen , Hao Fang , Xulin Gu , Shu-Tao Xia , En-Hui Yang

Recent advancements have explored text-to-image diffusion models for synthesizing out-of-distribution (OOD) samples, substantially enhancing the performance of OOD detection. However, existing approaches typically rely on perturbing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Xin Gao , Jiyao Liu , Guanghao Li , Yueming Lyu , Jianxiong Gao , Weichen Yu , Ningsheng Xu , Liang Wang , Caifeng Shan , Ziwei Liu , Chenyang Si

Dataset distillation synthesizes a small dataset such that a model trained on this set approximates the performance of the original dataset. Recent studies on dataset distillation focused primarily on the design of the optimization process,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Shiguang Wang , Zhongyu Zhang , Jian Cheng

Deep neural networks have achieved impressive performance across a wide range of tasks, but this success often comes with substantial computational and storage costs due to large-scale training data. Dataset distillation addresses this…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Mingzhuo Li , Guang Li , Linfeng Ye , Jiafeng Mao , Takahiro Ogawa , Konstantinos N. Plataniotis , Miki Haseyama

Dataset distillation aims to compress a training dataset by creating a small number of informative synthetic samples such that neural networks trained on them perform as well as those trained on the original training dataset. Current text…

Computation and Language · Computer Science 2024-04-02 Aru Maekawa , Satoshi Kosugi , Kotaro Funakoshi , Manabu Okumura

Histopathology can help clinicians make accurate diagnoses, determine disease prognosis, and plan appropriate treatment strategies. As deep learning techniques prove successful in the medical domain, the primary challenges become limited…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Zhe Li , Bernhard Kainz

Diffusion models produce high-quality text-to-image results, but their iterative denoising is computationally expensive.Distribution Matching Distillation (DMD) emerges as a promising path to few-step distillation, but suffers from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Haoyu Li , Tingyan Wen , Lin Qi , Zhe Wu , Yihuang Chen , Xing Zhou , Lifei Zhu , Xueqian Wang , Kai Zhang

With the increasing popularity of deep learning on edge devices, compressing large neural networks to meet the hardware requirements of resource-constrained devices became a significant research direction. Numerous compression methodologies…

Machine Learning · Computer Science 2022-01-11 Kuluhan Binici , Nam Trung Pham , Tulika Mitra , Karianto Leman

This paper presents Model-guidance (MG), a novel objective for training diffusion model that addresses and removes of the commonly used Classifier-free guidance (CFG). Our innovative approach transcends the standard modeling of solely data…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Zhicong Tang , Jianmin Bao , Dong Chen , Baining Guo

As Artificial Intelligence models, such as Large Video-Language models (VLMs), grow in size, their deployment in real-world applications becomes increasingly challenging due to hardware limitations and computational costs. To address this,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Timothy Wei , Hsien Xin Peng , Elaine Xu , Bryan Zhao , Lei Ding , Diji Yang

In this paper, we propose difficulty-guided sampling (DGS) to bridge the target gap between the distillation objective and the downstream task, therefore improving the performance of dataset distillation. Deep neural networks achieve…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Mingzhuo Li , Guang Li , Linfeng Ye , Jiafeng Mao , Takahiro Ogawa , Konstantinos N. Plataniotis , Miki Haseyama

Dataset distillation aims to create a compact dataset that retains essential information while maintaining model performance. Diffusion models (DMs) have shown promise for this task but struggle in low images-per-class (IPC) settings, where…

Machine Learning · Computer Science 2025-07-08 Linfeng Ye , Shayan Mohajer Hamidi , Guang Li , Takahiro Ogawa , Miki Haseyama , Konstantinos N. Plataniotis

Diffusion models have emerged as a formidable tool for training-free conditional generation.However, a key hurdle in inference-time guidance techniques is the need for compute-heavy backpropagation through the diffusion network for…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Nithin Gopalakrishnan Nair , Vishal M Patel