English
Related papers

Related papers: Spectral Gradient Surgery for Domain-Generalizable…

200 papers

Dataset distillation aims to find a synthetic training set such that training on the synthetic data achieves similar performance to training on real data, with orders of magnitude less computational requirements. Existing methods can be…

Machine Learning · Computer Science 2026-02-09 Hong Ye Tan , Emma Slade

As deep learning models grow in complexity and the volume of training data increases, reducing storage and computational costs becomes increasingly important. Dataset distillation addresses this challenge by synthesizing a compact set of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Zhe Li , Sarah Cechnicka , Cheng Ouyang , Katharina Breininger , Peter Schüffler , Bernhard Kainz

The collaborative classification of dual-frequency PolSAR images is a meaningful but also challenging research. The effect of regional consistency on classification information learning and the rational use of dual-frequency data are two…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Xinyue Xin , Ming Li , Yan Wu , Xiang Li , Peng Zhang , Dazhi Xu

Dataset distillation (DD) aims to generate a compact yet informative dataset that achieves performance comparable to the original dataset, thereby reducing demands on storage and computational resources. Although diffusion models have made…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Yawen Zou , Guang Li , Zi Wang , Chunzhi Gu , Chao Zhang

Dataset Distillation (DD), a newly emerging field, aims at generating much smaller but efficient synthetic training datasets from large ones. Existing DD methods based on gradient matching achieve leading performance; however, they are…

Machine Learning · Computer Science 2023-04-18 Lei Zhang , Jie Zhang , Bowen Lei , Subhabrata Mukherjee , Xiang Pan , Bo Zhao , Caiwen Ding , Yao Li , Dongkuan Xu

Dataset distillation (DD) entails creating a refined, compact distilled dataset from a large-scale dataset to facilitate efficient training. A significant challenge in DD is the dependency between the distilled dataset and the neural…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Yunlong Zhao , Xiaoheng Deng , Xiu Su , Hongyan Xu , Xiuxing Li , Yijing Liu , Shan You

Dataset distillation (DD) generates small synthetic datasets that can efficiently train deep networks with a limited amount of memory and compute. Despite the success of DD methods for supervised learning, DD for self-supervised…

Machine Learning · Computer Science 2025-04-02 Siddharth Joshi , Jiayi Ni , Baharan Mirzasoleiman

Domain Generalized Semantic Segmentation (DGSS) seeks to utilize source domain data exclusively to enhance the generalization of semantic segmentation across unknown target domains. Prevailing studies predominantly concentrate on feature…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Hongwei Niu , Linhuang Xie , Jianghang Lin , Shengchuan Zhang

Semantic segmentation requires a holistic understanding of the physical world, as it assigns semantic labels to spatially continuous and structurally coherent objects rather than to isolated pixels. However, existing data-free knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Hongxuan Sun , Tao Wu

Huge amount of data is the key of the success of deep learning, however, redundant information impairs the generalization ability of the model and increases the burden of calculation. Dataset Distillation (DD) compresses the original…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Hangyang Kong , Wenbo Zhou , Xuxiang He , Xiaotong Tu , Xinghao Ding

Deep neural networks (DNNs) have exhibited remarkable success in the field of histopathology image analysis. On the other hand, the contemporary trend of employing large models and extensive datasets has underscored the significance of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Cong Cong , Shiyu Xuan , Sidong Liu , Maurice Pagnucco , Shiliang Zhang , Yang Song

Recently, deep learning technology has been successfully introduced into Automatic Modulation Recognition (AMR) tasks. However, the success of deep learning is all attributed to the training on large-scale datasets. Such a large amount of…

Machine Learning · Computer Science 2024-08-07 Dongwei Xu , Jiajun Chen , Yao Lu , Tianhao Xia , Qi Xuan , Wei Wang , Yun Lin , Xiaoniu Yang

Distribution Matching Distillation (DMD) is a widely used paradigm for accelerating inference in few-step video diffusion models. However, DMD-style video distillation faces two coupled challenges: the fake score must track a continuously…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Zhuguanyu Wu , Ruihao Gong , Yang Yong , Yushi Huang , Xiangyu Fan , Lei Yang , Dahua Lin , Xianglong Liu

Dataset distillation synthesizes a small dataset such that a model trained on this set approximates the performance of the original dataset. Recent studies on dataset distillation focused primarily on the design of the optimization process,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Shiguang Wang , Zhongyu Zhang , Jian Cheng

Histopathology can help clinicians make accurate diagnoses, determine disease prognosis, and plan appropriate treatment strategies. As deep learning techniques prove successful in the medical domain, the primary challenges become limited…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Zhe Li , Bernhard Kainz

Score Distillation Sampling (SDS) has emerged as a prominent method for text-to-3D generation by leveraging the strengths of 2D diffusion models. However, SDS is limited to generation tasks and lacks the capability to edit existing 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Xingyu Miao , Haoran Duan , Yang Long , Jungong Han

Although larger datasets are crucial for training large deep models, the rapid growth of dataset size has brought a significant challenge in terms of considerable training costs, which even results in prohibitive computational expenses.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Sheng-Feng Yu , Jia-Jiun Yao , Wei-Chen Chiu

A fundamental challenge for machine learning models is generalizing to out-of-distribution (OOD) data, in part due to spurious correlations. To tackle this challenge, we first formalize the OOD generalization problem as constrained…

Machine Learning · Computer Science 2022-10-20 Hanlin Zhang , Yi-Fan Zhang , Weiyang Liu , Adrian Weller , Bernhard Schölkopf , Eric P. Xing

The rapid progress of generative models such as GANs and diffusion models has led to the widespread proliferation of AI-generated images, raising concerns about misinformation, privacy violations, and trust erosion in digital media.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Jiazhen Yan , Ziqiang Li , Fan Wang , Boyu Wang , Ziwen He , Zhangjie Fu

Dataset Distillation (DD) is a promising technique to synthesize a smaller dataset that preserves essential information from the original dataset. This synthetic dataset can serve as a substitute for the original large-scale one, and help…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yao Lu , Jianyang Gu , Xuguang Chen , Saeed Vahidian , Qi Xuan