English
Related papers

Related papers: Transfer Learning for Diffusion Models

200 papers

Unsupervised domain transfer is the task of transferring or translating samples from a source distribution to a different target distribution. Current solutions unsupervised domain transfer often operate on data on which the modes of the…

Machine Learning · Computer Science 2019-05-31 Mikołaj Bińkowski , R Devon Hjelm , Aaron Courville

As Diffusion Models have shown promising performance, a lot of efforts have been made to improve the controllability of Diffusion Models. However, how to train Diffusion Models to have the disentangled latent spaces and how to naturally…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Wonwoong Cho , Hareesh Ravi , Midhun Harikumar , Vinh Khuc , Krishna Kumar Singh , Jingwan Lu , David I. Inouye , Ajinkya Kale

Dataset distillation enables efficient training by distilling the information of large-scale datasets into significantly smaller synthetic datasets. Diffusion based paradigms have emerged in recent years, offering novel perspectives for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Qichao Wang , Yunhong Lu , Hengyuan Cao , Junyi Zhang , Min Zhang

Acquiring high-quality data for training discriminative models is a crucial yet challenging aspect of building effective predictive systems. In this paper, we present Diffusion Inversion, a simple yet effective method that leverages the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Yongchao Zhou , Hshmat Sahak , Jimmy Ba

Joint machine learning models that allow synthesizing and classifying data often offer uneven performance between those tasks or are unstable to train. In this work, we depart from a set of empirical observations that indicate the…

Machine Learning · Computer Science 2023-04-06 Kamil Deja , Tomasz Trzcinski , Jakub M. Tomczak

The scope of this paper is generative modeling through diffusion processes. An approach falling within this paradigm is the work of Song et al. (2021), which relies on a time-reversal argument to construct a diffusion process targeting the…

Machine Learning · Computer Science 2023-12-25 Stefano Peluchetti

In the domains of image and audio, diffusion models have shown impressive performance. However, their application to discrete data types, such as language, has often been suboptimal compared to autoregressive generative models. This paper…

Machine Learning · Computer Science 2024-05-29 Severi Rissanen , Markus Heinonen , Arno Solin

Diffusion models generalize well in practice. However, an optimal diffusion model fully memorizes the training data and therefore fails to generalize, raising the question of what induces generalization in a real diffusion model. We show…

Machine Learning · Computer Science 2026-05-21 Tim Kaiser , Markus Kollmann

We introduce Mediffusion -- a new method for semi-supervised learning with explainable classification based on a joint diffusion model. The medical imaging domain faces unique challenges due to scarce data labelling -- insufficient for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Joanna Kaleta , Paweł Skierś , Jan Dubiński , Przemysław Korzeniowski , Kamil Deja

Despite the remarkable generation capabilities of Diffusion Models (DMs), conducting training and inference remains computationally expensive. Previous works have been devoted to accelerating diffusion sampling, but achieving data-efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Yize Li , Yihua Zhang , Sijia Liu , Xue Lin

Semantic segmentation models trained on synthetic data often perform poorly on real-world images due to domain gaps, particularly in adverse conditions where labeled data is scarce. Yet, recent foundation models enable to generate realistic…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Estelle Chigot , Dennis G. Wilson , Meriem Ghrib , Thomas Oberlin

All famous machine learning algorithms that comprise both supervised and semi-supervised learning work well only under a common assumption: the training and test data follow the same distribution. When the distribution changes, most…

Machine Learning · Computer Science 2022-07-15 Ievgen Redko , Emilie Morvant , Amaury Habrard , Marc Sebban , Younès Bennani

In this paper, we aim to adapt a model at test-time using a few unlabeled data to address distribution shifts. To tackle the challenges of extracting domain knowledge from a limited amount of data, it is crucial to utilize correlated…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Zhixiang Chi , Li Gu , Tao Zhong , Huan Liu , Yuanhao Yu , Konstantinos N Plataniotis , Yang Wang

Due to the ease of training, ability to scale, and high sample quality, diffusion models (DMs) have become the preferred option for generative modeling, with numerous pre-trained models available for a wide variety of datasets. Containing…

Machine Learning · Computer Science 2024-01-17 Weijian Luo , Tianyang Hu , Shifeng Zhang , Jiacheng Sun , Zhenguo Li , Zhihua Zhang

Retrosynthesis is a problem to infer reactant compounds to synthesize a given product compound through chemical reactions. Recent studies on retrosynthesis focus on proposing more sophisticated prediction models, but the dataset to feed the…

Machine Learning · Computer Science 2020-10-05 Katsuhiko Ishiguro , Kazuya Ujihara , Ryohto Sawada , Hirotaka Akita , Masaaki Kotera

Diffusion models are widely used for generative tasks across domains. Given a pre-trained diffusion model, it is often desirable to fine-tune it further either to correct for errors in learning or to align with downstream applications.…

Diffusion models have become increasingly popular for generative modeling due to their ability to generate high-quality samples. This has unlocked exciting new possibilities for solving inverse problems, especially in image restoration and…

Diffusion models have become emerging generative models. Their sampling process involves multiple steps, and in each step the models predict the noise from a noisy sample. When the models make prediction, the output deviates from the ground…

Machine Learning · Computer Science 2025-10-28 Shifeng Xu , Yanzhu Liu , Adams Wai-Kin Kong

Classical Domain Adaptation methods acquire transferability by regularizing the overall distributional discrepancies between features in the source domain (labeled) and features in the target domain (unlabeled). They often do not…

Machine Learning · Computer Science 2023-06-01 Shumin Ma , Zhiri Yuan , Qi Wu , Yiyan Huang , Xixu Hu , Cheuk Hang Leung , Dongdong Wang , Zhixiang Huang

Diffusion models have demonstrated significant potential in achieving state-of-the-art performance across various text generation tasks. In this systematic study, we investigate their application to the table-to-text problem by adapting the…

Computation and Language · Computer Science 2024-09-24 Aleksei S. Krylov , Oleg D. Somov