中文
相关论文

相关论文: Taming Diffusion for Dataset Distillation with Hig…

200 篇论文

We present a novel framework for rectifying occlusions and distortions in degraded texture samples from natural images. Traditional texture synthesis approaches focus on generating textures from pristine samples, which necessitate…

图形学 · 计算机科学 2023-09-27 Guoqing Hao , Satoshi Iizuka , Kensho Hara , Edgar Simo-Serra , Hirokatsu Kataoka , Kazuhiro Fukui

Due to the high storage and search efficiency, hashing has become prevalent for large-scale similarity search. Particularly, deep hashing methods have greatly improved the search performance under supervised scenarios. In contrast,…

计算机视觉与模式识别 · 计算机科学 2019-05-10 Erkun Yang , Tongliang Liu , Cheng Deng , Wei Liu , Dacheng Tao

Diffusion models (DMs) have demonstrated exceptional generative capabilities across various domains, including image, video, and so on. A key factor contributing to their effectiveness is the high quantity and quality of data used during…

计算机视觉与模式识别 · 计算机科学 2025-03-03 Qianlong Xiang , Miao Zhang , Yuzhang Shang , Jianlong Wu , Yan Yan , Liqiang Nie

Recent success of deep learning is largely attributed to the sheer amount of data used for training deep neural networks.Despite the unprecedented success, the massive data, unfortunately, significantly increases the burden on storage and…

机器学习 · 计算机科学 2023-10-10 Ruonan Yu , Songhua Liu , Xinchao Wang

Diffusion Transformers (DiTs) with billions of model parameters form the backbone of popular image and video generation models like DALL.E, Stable-Diffusion and SORA. Though these models are necessary in many low-latency applications like…

计算机视觉与模式识别 · 计算机科学 2025-02-21 Vignesh Sundaresha

With the exponential increase in image data, training an image restoration model is laborious. Dataset distillation is a potential solution to this problem, yet current distillation techniques are a blank canvas in the field of image…

计算机视觉与模式识别 · 计算机科学 2025-04-22 Zhuoran Zheng , Xin Su , Chen Wu , Xiuyi Jia

The inference latency of diffusion models remains a critical barrier to their real-time application. While trajectory-based and distribution-based step distillation methods offer solutions, they present a fundamental trade-off.…

计算机视觉与模式识别 · 计算机科学 2025-11-13 Hanbo Cheng , Peng Wang , Kaixiang Lei , Qi Li , Zhen Zou , Pengfei Hu , Jun Du

To address the computational and storage challenges posed by large-scale datasets in deep learning, dataset distillation has been proposed to synthesize a compact dataset that replaces the original while maintaining comparable model…

机器学习 · 计算机科学 2025-10-20 Wenyuan Li , Guang Li , Keisuke Maeda , Takahiro Ogawa , Miki Haseyama

Dataset distillation or condensation aims to condense a large-scale training dataset into a much smaller synthetic one such that the training performance of distilled and original sets on neural networks are similar. Although the number of…

计算机视觉与模式识别 · 计算机科学 2024-08-16 Ruonan Yu , Songhua Liu , Zigeng Chen , Jingwen Ye , Xinchao Wang

We introduce DD3G, a formulation that Distills a multi-view Diffusion model (MV-DM) into a 3D Generator using gaussian splatting. DD3G compresses and integrates extensive visual and spatial geometric knowledge from the MV-DM by simulating…

计算机视觉与模式识别 · 计算机科学 2025-04-04 Hao Qin , Luyuan Chen , Ming Kong , Mengxu Lu , Qiang Zhu

Reverse sampling and score-distillation have emerged as main workhorses in recent years for image manipulation using latent diffusion models (LDMs). While reverse diffusion sampling often requires adjustments of LDM architecture or feature…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Jeongsol Kim , Geon Yeong Park , Jong Chul Ye

Dataset distillation enables efficient training by distilling the information of large-scale datasets into significantly smaller synthetic datasets. Diffusion based paradigms have emerged in recent years, offering novel perspectives for…

计算机视觉与模式识别 · 计算机科学 2026-05-06 Qichao Wang , Yunhong Lu , Hengyuan Cao , Junyi Zhang , Min Zhang

We present ControlSR, a new method that can tame Diffusion Models for consistent real-world image super-resolution (Real-ISR). Previous Real-ISR models mostly focus on how to activate more generative priors of text-to-image diffusion models…

计算机视觉与模式识别 · 计算机科学 2025-04-02 Yuhao Wan , Peng-Tao Jiang , Qibin Hou , Hao Zhang , Jinwei Chen , Ming-Ming Cheng , Bo Li

Data distillation is the problem of reducing the volume oftraining data while keeping only the necessary information. With thispaper, we deeper explore the new data distillation algorithm, previouslydesigned for image data. Our experiments…

机器学习 · 计算机科学 2020-10-21 Dmitry Medvedev , Alexander D'yakonov

Dataset distillation is the task of synthesizing a small dataset such that a model trained on the synthetic set will match the test accuracy of the model trained on the full dataset. In this paper, we propose a new formulation that…

计算机视觉与模式识别 · 计算机科学 2022-03-23 George Cazenavette , Tongzhou Wang , Antonio Torralba , Alexei A. Efros , Jun-Yan Zhu

In the realm of high-resolution (HR), fine-grained image segmentation, the primary challenge is balancing broad contextual awareness with the precision required for detailed object delineation, capturing intricate details and the finest…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Qian Yu , Peng-Tao Jiang , Hao Zhang , Jinwei Chen , Bo Li , Lihe Zhang , Huchuan Lu

Diffusion distillation models effectively accelerate reverse sampling by compressing the process into fewer steps. However, these models still exhibit a performance gap compared to their pre-trained diffusion model counterparts, exacerbated…

计算机视觉与模式识别 · 计算机科学 2024-12-13 Geon Yeong Park , Sang Wan Lee , Jong Chul Ye

Dataset distillation seeks to synthesize a compact distilled dataset, enabling models trained on it to achieve performance comparable to models trained on the full dataset. Recent methods for large-scale datasets focus on matching global…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Xiao Cui , Yulei Qin , Wengang Zhou , Hongsheng Li , Houqiang Li

Pre-trained on extensive and diverse multi-modal datasets, 2D foundation models excel at addressing 2D tasks with little or no downstream supervision, owing to their robust representations. The emergence of 2D-to-3D distillation frameworks…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Anas Mahmoud , Ali Harakeh , Steven Waslander

4D radar super-resolution, which aims to reconstruct sparse and noisy point clouds into dense and geometrically consistent representations, is a foundational problem in autonomous perception. However, existing methods often suffer from high…

计算机视觉与模式识别 · 计算机科学 2025-09-17 Minqing Huang , Shouyi Lu , Boyuan Zheng , Ziyao Li , Xiao Tang , Guirong Zhuo