English
Related papers

Related papers: CONCORD: Concept-Informed Diffusion for Dataset Di…

200 papers

Recently, deep learning technology has been successfully introduced into Automatic Modulation Recognition (AMR) tasks. However, the success of deep learning is all attributed to the training on large-scale datasets. Such a large amount of…

Machine Learning · Computer Science 2024-08-07 Dongwei Xu , Jiajun Chen , Yao Lu , Tianhao Xia , Qi Xuan , Wei Wang , Yun Lin , Xiaoniu Yang

Conversational Search (CS) involves retrieving relevant documents from a corpus while considering the conversational context, integrating retrieval with context modeling. Recent advancements in Large Language Models (LLMs) have…

Information Retrieval · Computer Science 2025-05-19 Simon Lupart , Mohammad Aliannejadi , Evangelos Kanoulas

Deep learning has grown tremendously over recent years, yielding state-of-the-art results in various fields. However, training such models requires huge amounts of data, increasing the computational time and cost. To address this, dataset…

Machine Learning · Computer Science 2023-07-18 Murad Tukan , Alaa Maalouf , Margarita Osadchy

Dataset distillation (DD) aims to minimize the time and memory consumption needed for training deep neural networks on large datasets, by creating a smaller synthetic dataset that has similar performance to that of the full real dataset.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Xinhao Zhong , Bin Chen , Hao Fang , Xulin Gu , Shu-Tao Xia , En-Hui Yang

Dataset distillation compresses a large training set into a small synthetic set that preserves downstream training utility. While most existing methods target training networks from scratch, modern visual transfer learning often uses frozen…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Bincheng Peng , Guang Li , Ping Liu , Takahiro Ogawa , Miki Haseyama

In controllable generation tasks, flexibly manipulating the generated images to attain a desired appearance or structure based on a single input image cue remains a critical and longstanding challenge. Achieving this requires the effective…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xi Wang , Yichen Peng , Heng Fang , Yilin Wang , Haoran Xie , Xi Yang , Chuntao Li

As deep learning models grow in complexity and the volume of training data increases, reducing storage and computational costs becomes increasingly important. Dataset distillation addresses this challenge by synthesizing a compact set of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Zhe Li , Sarah Cechnicka , Cheng Ouyang , Katharina Breininger , Peter Schüffler , Bernhard Kainz

Although larger datasets are crucial for training large deep models, the rapid growth of dataset size has brought a significant challenge in terms of considerable training costs, which even results in prohibitive computational expenses.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Sheng-Feng Yu , Jia-Jiun Yao , Wei-Chen Chiu

Model interpretability plays a central role in human-AI decision-making systems. Ideally, explanations should be expressed using human-interpretable semantic concepts. Moreover, the causal relations between these concepts should be captured…

Machine Learning · Computer Science 2024-01-29 Ricardo Moreira , Jacopo Bono , Mário Cardoso , Pedro Saleiro , Mário A. T. Figueiredo , Pedro Bizarro

Knowledge distillation is an effective method for training small and efficient deep learning models. However, the efficacy of a single method can degenerate when transferring to other tasks, modalities, or even other architectures. To…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Roy Miles , Ismail Elezi , Jiankang Deng

Dataset distillation aims to synthesize small datasets with little information loss from original large-scale ones for reducing storage and training costs. Recent state-of-the-art methods mainly constrain the sample synthesis process by…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Yanqing Liu , Jianyang Gu , Kai Wang , Zheng Zhu , Wei Jiang , Yang You

Diffusion models have achieved remarkable success in generating high-resolution, realistic images across diverse natural distributions. However, their performance heavily relies on high-quality training data, making it challenging to learn…

Machine Learning · Computer Science 2025-05-22 Tianyu Chen , Yasi Zhang , Zhendong Wang , Ying Nian Wu , Oscar Leong , Mingyuan Zhou

Diffusion distillation is central to accelerating image and video generation, yet existing methods are fundamentally limited by the denoising process, where step reduction has largely saturated. Partial timestep low-resolution generation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Feiyang Chen , Hongpeng Pan , Haonan Xu , Xinyu Duan , Yang Yang , Zhefeng Wang

Diffusion models achieve high-quality image generation but are limited by slow iterative sampling. Distillation methods alleviate this by enabling one- or few-step generation. Flow matching, originally introduced as a distinct framework,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Mingyuan Zhou , Yi Gu , Huangjie Zheng , Liangchen Song , Guande He , Yizhe Zhang , Wenze Hu , Yinfei Yang

Dataset distillation (DD) has emerged as a widely adopted technique for crafting a synthetic dataset that captures the essential information of a training dataset, facilitating the training of accurate neural models. Its applications span…

Machine Learning · Computer Science 2025-02-04 Saeed Vahidian , Mingyu Wang , Jianyang Gu , Vyacheslav Kungurtsev , Wei Jiang , Yiran Chen

Dataset Distillation (DD) is a promising technique to synthesize a smaller dataset that preserves essential information from the original dataset. This synthetic dataset can serve as a substitute for the original large-scale one, and help…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yao Lu , Jianyang Gu , Xuguang Chen , Saeed Vahidian , Qi Xuan

Large Language models (LLMs) have demonstrated impressive in-context learning (ICL) capabilities, where a LLM makes predictions for a given test input together with a few input-output pairs (demonstrations). Nevertheless, the inclusion of…

Computation and Language · Computer Science 2024-03-13 Yichuan Li , Xiyao Ma , Sixing Lu , Kyumin Lee , Xiaohu Liu , Chenlei Guo

Diffusion Models~(DMs) have emerged as the dominant approach in Generative Artificial Intelligence (GenAI), owing to their remarkable performance in tasks such as text-to-image synthesis. However, practical DMs, such as stable diffusion,…

Machine Learning · Computer Science 2025-08-18 Xuhui Fan , Zhangkai Wu , Hongyu Wu

Text-to-image diffusion models have shown an impressive ability to generate high-quality images from input textual descriptions. However, concerns have been raised about the potential for these models to create content that infringes on…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Tingxu Han , Weisong Sun , Yanrong Hu , Chunrong Fang , Yonglong Zhang , Shiqing Ma , Tao Zheng , Zhenyu Chen , Zhenting Wang

Dataset Condensation aims to condense a large dataset into a smaller one while maintaining its ability to train a well-performing model, thus reducing the storage cost and training effort in deep learning applications. However, conventional…

Machine Learning · Computer Science 2023-07-20 Ganlong Zhao , Guanbin Li , Yipeng Qin , Yizhou Yu