English
Related papers

Related papers: DiRe: Diversity-promoting Regularization for Datas…

200 papers

Despite significant progress has been made in image deraining, we note that most existing methods are often developed for only specific types of rain degradation and fail to generalize across diverse real-world rainy scenes. How to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Qianfeng Yang , Qiyuan Guan , Xiang Chen , Jiyu Jin , Guiyue Jin , Jiangxin Dong

Dataset distillation aims to condense large datasets into a small number of synthetic examples that can be used as drop-in replacements when training new models. It has applications to interpretability, neural architecture search, privacy,…

Machine Learning · Computer Science 2024-06-24 Andrei Lupu , Chris Lu , Jarek Liesen , Robert Tjarko Lange , Jakob Foerster

Dataset Distillation (DD) seeks to create a condensed dataset that, when used to train a model, enables the model to achieve performance similar to that of a model trained on the entire original dataset. It relieves the model training from…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Chuhao Zhou , Chenxi Jiang , Yi Xie , Haozhi Cao , Jianfei Yang

Domain generalization studies the problem of training a model with samples from several domains (or distributions) and then testing the model with samples from a new, unseen domain. In this paper, we propose a novel approach for domain…

Computer Vision and Pattern Recognition · Computer Science 2023-09-25 Zeyi Huang , Andy Zhou , Zijian Lin , Mu Cai , Haohan Wang , Yong Jae Lee

Due to the lack of a large-scale reflection removal dataset with diverse real-world scenes, many existing reflection removal methods are trained on synthetic data plus a small amount of real-world data, which makes it difficult to evaluate…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Chenyang Lei , Xuhua Huang , Chenyang Qi , Yankun Zhao , Wenxiu Sun , Qiong Yan , Qifeng Chen

Real-world image restoration is hampered by diverse degradations stemming from varying capture conditions, capture devices and post-processing pipelines. Existing works make improvements through simulating those degradations and leveraging…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Mo Zhou , Keren Ye , Mauricio Delbracio , Peyman Milanfar , Vishal M. Patel , Hossein Talebi

Dataset Distillation (DD) aims to distill knowledge from extensive datasets into more compact ones while preserving performance on the test set, thereby reducing storage costs and training expenses. However, existing methods often suffer…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Zheng Zhou , Hongbo Zhao , Guangliang Cheng , Xiangtai Li , Shuchang Lyu , Wenquan Feng , Qi Zhao

Autonomous systems (AS) often use Deep Neural Network (DNN) classifiers to allow them to operate in complex, high-dimensional, non-linear, and dynamically changing environments. Due to the complexity of these environments, DNN classifiers…

Machine Learning · Computer Science 2024-08-16 Abanoub Ghobrial , Xuan Zheng , Darryl Hond , Hamid Asgari , Kerstin Eder

Dataset distillation (DD) has emerged as a promising approach to compress datasets and speed up model training. However, the underlying connections among various DD methods remain largely unexplored. In this paper, we introduce UniDD, a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Deyu Bo , Songhua Liu , Xinchao Wang

Convolutional Neural Networks (CNNs) excel in many visual tasks but remain susceptible to adversarial attacks-imperceptible perturbations that degrade performance. Prior research reveals that brain-inspired regularizers, derived from neural…

Machine Learning · Computer Science 2026-02-16 Elie Attias , Cengiz Pehlevan , Dina Obeid

Condensed datasets offer a compact representation of larger datasets, but training models directly on them or using them to enhance model performance through knowledge distillation (KD) can result in suboptimal outcomes due to limited…

Machine Learning · Computer Science 2025-11-11 Kuluhan Binici , Shivam Aggarwal , Cihan Acar , Nam Trung Pham , Karianto Leman , Gim Hee Lee , Tulika Mitra

Dataset distillation has demonstrated remarkable effectiveness in high-compression scenarios for image datasets. While video datasets inherently contain greater redundancy, existing video dataset distillation methods primarily focus on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Ning Li , Antai Andy Liu , Jingran Zhang , Justin Cui

Medical image annotation is constrained by privacy concerns and labor-intensive labeling, significantly limiting the performance and generalization of segmentation models. While mask-controllable diffusion models excel in synthesis, they…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Kunpeng Qiu , Zhiying Zhou , Yongxin Guo

Dataset distillation has emerged as an effective strategy, significantly reducing training costs and facilitating more efficient model deployment. Recent advances have leveraged generative models to distill datasets by capturing the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Jeffrey A. Chan-Santiago , Praveen Tirupattur , Gaurav Kumar Nayak , Gaowen Liu , Mubarak Shah

In active learning, the focus is mainly on the selection strategy of unlabeled data for enhancing the generalization capability of the next learning cycle. For this, various uncertainty measurement methods have been proposed. On the other…

Computer Vision and Pattern Recognition · Computer Science 2020-11-06 SeulGi Hong , Heonjin Ha , Junmo Kim , Min-Kook Choi

Fine-tuning Stable Diffusion enables subject-driven image synthesis by adapting the model to generate images containing specific subjects. However, existing fine-tuning methods suffer from two key issues: underfitting, where the model fails…

Graphics · Computer Science 2025-06-10 Yao Ni , Song Wen , Piotr Koniusz , Anoop Cherian

Recommender systems have demonstrated significant impact across diverse domains, yet ensuring the reproducibility of experimental findings remains a persistent challenge. A primary obstacle lies in the fragmented and often opaque data…

Studies on generalization performance of machine learning algorithms under the scope of information theory suggest that compressed representations can guarantee good generalization, inspiring many compression-based regularization methods.…

Machine Learning · Computer Science 2019-10-16 Antoine Saporta , Yifu Chen , Michael Blot , Matthieu Cord

Diffusion transformer (DiT) architectures show great potential for real-world image super-resolution (Real-ISR). However, their computationally expensive iterative sampling necessitates one-step distillation. Existing one-step distillation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Jingkai Wang , Yixin Tang , Jue Gong , Jiatong Li , Shu Li , Libo Liu , Jianliang Lan , Yutong Liu , Yulun Zhang

Dataset distillation extracts a small set of synthetic training samples from a large dataset with the goal of achieving competitive performance on test data when trained on this sample. In this work, we tackle dataset distillation at its…

Machine Learning · Computer Science 2023-11-14 Yunzhen Feng , Ramakrishna Vedantam , Julia Kempe