English
Related papers

Related papers: Label-Consistent Dataset Distillation with Detecto…

200 papers

Dataset distillation has demonstrated strong performance on simple datasets like CIFAR, MNIST, and TinyImageNet but struggles to achieve similar results in more complex scenarios. In this paper, we propose EDF (emphasizes the discriminative…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Kai Wang , Zekai Li , Zhi-Qi Cheng , Samir Khaki , Ahmad Sajedi , Ramakrishna Vedantam , Konstantinos N Plataniotis , Alexander Hauptmann , Yang You

Model-based deep learning has achieved astounding successes due in part to the availability of large-scale real-world data. However, processing such massive amounts of data comes at a considerable cost in terms of computations, storage,…

Machine Learning · Computer Science 2023-03-28 Jiawei Du , Yidi Jiang , Vincent Y. F. Tan , Joey Tianyi Zhou , Haizhou Li

Dataset distillation compresses a large training set into a small synthetic set that preserves downstream training utility. While most existing methods target training networks from scratch, modern visual transfer learning often uses frozen…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Bincheng Peng , Guang Li , Ping Liu , Takahiro Ogawa , Miki Haseyama

Blind super-resolution methods based on stable diffusion showcase formidable generative capabilities in reconstructing clear high-resolution images with intricate details from low-resolution inputs. However, their practical applicability is…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Rui Xie , Chen Zhao , Kai Zhang , Zhenyu Zhang , Jun Zhou , Jian Yang , Ying Tai

Recent language models have shown remarkable performance on natural language understanding (NLU) tasks. However, they are often sub-optimal when faced with ambiguous samples that can be interpreted in multiple ways, over-confidently…

Computation and Language · Computer Science 2024-06-17 Hancheol Park , Soyeong Jeong , Sukmin Cho , Jong C. Park

While generative diffusion models excel in producing high-quality images, they can also be misused to mimic authorized images, posing a significant threat to AI systems. Efforts have been made to add calibrated perturbations to protect…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Haotian Xue , Chumeng Liang , Xiaoyu Wu , Yongxin Chen

4D radar super-resolution, which aims to reconstruct sparse and noisy point clouds into dense and geometrically consistent representations, is a foundational problem in autonomous perception. However, existing methods often suffer from high…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Minqing Huang , Shouyi Lu , Boyuan Zheng , Ziyao Li , Xiao Tang , Guirong Zhuo

Semi-supervised regression (SSR), which aims to predict continuous scores for samples while reducing the reliance on large-scale labeled data, has recently attracted considerable attention across various applications, including computer…

Machine Learning · Computer Science 2026-05-28 Ye Su , Hezhe Qiao , Wei Huang , Lin Chen

This study tackles the challenge of efficiently classifying streaming data in envi-ronments with limited memory and computational resources. It delves into the application of data distillation as an innovative approach to improve the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Rwad Khatib , Yehudit Aperstein

Classifier-free guided diffusion models have recently been shown to be highly effective at high-resolution image generation, and they have been widely used in large-scale diffusion frameworks including DALLE-2, Stable Diffusion and Imagen.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Chenlin Meng , Robin Rombach , Ruiqi Gao , Diederik P. Kingma , Stefano Ermon , Jonathan Ho , Tim Salimans

Training large AI models typically requires large-scale datasets in the machine learning process, making training and parameter-tuning process both time-consuming and costly. Some researchers address this problem by carefully synthesizing a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Jiyuan Shen , Wenzhuo Yang , Kwok-Yan Lam

Constructing fine-grained image datasets typically requires domain-specific expert knowledge, which is not always available for crowd-sourcing platform annotators. Accordingly, learning directly from web images becomes an alternative method…

Computer Vision and Pattern Recognition · Computer Science 2020-08-07 Chuanyi Zhang , Yazhou Yao , Xiangbo Shu , Zechao Li , Zhenmin Tang , Qi Wu

Dataset distillation, a pragmatic approach in machine learning, aims to create a smaller synthetic dataset from a larger existing dataset. However, existing distillation methods primarily adopt a model-based paradigm, where the synthetic…

Machine Learning · Computer Science 2024-02-21 Binglin Zhou , Linhao Zhong , Wentao Chen

Recently, a number of image-mixing-based augmentation techniques have been introduced to improve the generalization of deep neural networks. In these techniques, two or more randomly selected natural images are mixed together to generate an…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Khawar Islam , Muhammad Zaigham Zaheer , Arif Mahmood , Karthik Nandakumar

Self-distillation (SD) is the process of first training a \enquote{teacher} model and then using its predictions to train a \enquote{student} model with the \textit{same} architecture. Specifically, the student's objective function is…

Machine Learning · Computer Science 2023-02-01 Rudrajit Das , Sujay Sanghavi

Image tokenization plays a central role in modern generative modeling by mapping visual inputs into compact representations that serve as an intermediate signal between pixels and generative models. Diffusion-based decoders have recently…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Chuhan Wang , Hao Chen

The rapid iteration and widespread dissemination of deepfake technology have posed severe challenges to information security, making robust and generalizable detection of AI-generated forged images increasingly important. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zhilin Tu , Kemou Li , Fengpeng Li , Jianwei Fei , Jiamin Zhang , Haiwei Wu

Dataset distillation seeks to synthesize a compact distilled dataset, enabling models trained on it to achieve performance comparable to models trained on the full dataset. Recent methods for large-scale datasets focus on matching global…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Xiao Cui , Yulei Qin , Wengang Zhou , Hongsheng Li , Houqiang Li

Dataset distillation (DD) aims to synthesize compact training sets that enable models to achieve high accuracy with significantly fewer samples. Recent diffusion-based DD methods commonly introduce semantic guidance through late-stage…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Wenqi Cai , Yawen Zou , Guang Li , Chunzhi Gu , Chao Zhang

In the realm of industrial quality inspection, defect detection stands as a critical component, particularly in high-precision, safety-critical sectors such as automotive components aerospace, and medical devices. Traditional methods,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Shuai Li , Shihan Chen , Wanru Geng , Zhaohua Xu , Xiaolu Liu , Can Dong , Zhen Tian , Changlin Chen