中文
相关论文

相关论文: Efficient Transfer Learning in Diffusion Models vi…

200 篇论文

Diffusion models have recently achieved great success in the synthesis of high-quality images and videos. However, the existing denoising techniques in diffusion models are commonly based on step-by-step noise predictions, which suffers…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Hancheng Ye , Jiakang Yuan , Renqiu Xia , Xiangchao Yan , Tao Chen , Junchi Yan , Botian Shi , Bo Zhang

Diffusion-based methods represented as stochastic differential equations on a continuous-time domain have recently proven successful as a non-adversarial generative model. Training such models relies on denoising score matching, which can…

机器学习 · 计算机科学 2024-11-05 Sarthak Mittal , Korbinian Abstreiter , Stefan Bauer , Bernhard Schölkopf , Arash Mehrjou

Real-world data often has a long-tailed distribution, where the scarcity of tail samples significantly limits the model's generalization ability. Denoising Diffusion Probabilistic Models (DDPM) are generative models based on stochastic…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Jingyu Kong , Yuan Guo , Yu Wang , Yuping Duan

Denoising Diffusion Probabilistic Models (DDPMs) have emerged as a powerful family of generative models that can yield high-fidelity samples and competitive log-likelihoods across a range of domains, including image and speech synthesis.…

机器学习 · 计算机科学 2021-06-08 Daniel Watson , Jonathan Ho , Mohammad Norouzi , William Chan

Remote sensing change detection is crucial for understanding the dynamics of our planet's surface, facilitating the monitoring of environmental changes, evaluating human impact, predicting future trends, and supporting decision-making. In…

计算机视觉与模式识别 · 计算机科学 2024-01-15 Wele Gedara Chaminda Bandara , Nithin Gopalakrishnan Nair , Vishal M. Patel

While many unsupervised learning models focus on one family of tasks, either generative or discriminative, we explore the possibility of a unified representation learner: a model which uses a single pre-training stage to address both…

Diffusion models have gained traction as powerful algorithms for synthesizing high-quality images. Central to these algorithms is the diffusion process, a set of equations which maps data to noise in a way that can significantly affect…

机器学习 · 计算机科学 2024-11-12 Subham Sekhar Sahoo , Aaron Gokaslan , Chris De Sa , Volodymyr Kuleshov

Transformer-based diffusion models have demonstrated remarkable performance at generating high-quality samples. However, our theoretical understanding of the reasons for this success remains limited. For instance, existing models are…

机器学习 · 计算机科学 2026-04-14 Hongkang Li , Hancheng Min , Rene Vidal

Many interesting tasks in image restoration can be cast as linear inverse problems. A recent family of approaches for solving these problems uses stochastic algorithms that sample from the posterior distribution of natural images given the…

图像与视频处理 · 电气工程与系统科学 2022-10-14 Bahjat Kawar , Michael Elad , Stefano Ermon , Jiaming Song

Due to various physical degradation factors and limited counts received, PET image quality needs further improvements. The denoising diffusion probabilistic models (DDPM) are distribution learning-based models, which try to transform a…

图像与视频处理 · 电气工程与系统科学 2022-09-15 Kuang Gong , Keith A. Johnson , Georges El Fakhri , Quanzheng Li , Tinsu Pan

Existing transfer learning-based beam prediction approaches primarily rely on simple fine-tuning. When there is a significant difference in data distribution between the target domain and the source domain, simple fine-tuning limits the…

信息论 · 计算机科学 2025-09-26 Zhiqiang Xiao , Yuwen Cao , Mondher Bouazizi , Tomoaki Ohtsuki , Shahid Mumtaz

Diffusion models have shown an impressive ability to model complex data distributions, with several key advantages over GANs, such as stable training, better coverage of the training distribution's modes, and the ability to solve inverse…

计算机视觉与模式识别 · 计算机科学 2024-06-12 Yinbo Chen , Oliver Wang , Richard Zhang , Eli Shechtman , Xiaolong Wang , Michael Gharbi

Adversarial Imitation Learning is traditionally framed as a two-player zero-sum game between a learner and an adversarially chosen cost function, and can therefore be thought of as the sequential generalization of a Generative Adversarial…

机器学习 · 计算机科学 2025-03-04 Runzhe Wu , Yiding Chen , Gokul Swamy , Kianté Brantley , Wen Sun

Recently deep neural networks (DNNs) have been successfully introduced to the field of lensless imaging through scattering media. By solving an inverse problem in computational imaging, DNNs can overcome several shortcomings in the…

图像与视频处理 · 电气工程与系统科学 2020-01-01 Yukuan Yang , Lei Deng , Peng Jiao , Yansong Chua , Jing Pei , Cheng Ma , Guoqi Li

Deep neural networks have achieved unprecedented success on diverse vision tasks. However, they are vulnerable to adversarial noise that is imperceptible to humans. This phenomenon negatively affects their deployment in real-world…

计算机视觉与模式识别 · 计算机科学 2023-03-29 Jianping Zhang , Jen-tse Huang , Wenxuan Wang , Yichen Li , Weibin Wu , Xiaosen Wang , Yuxin Su , Michael R. Lyu

Diffusion models are emerging as powerful solutions for generating high-fidelity and diverse images, often surpassing GANs under many circumstances. However, their slow inference speed hinders their potential for real-time applications. To…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Luan Thanh Trinh , Tomoki Hamagami

Diffusion models are powerful generative models that map noise to data using stochastic processes. However, for many applications such as image editing, the model input comes from a distribution that is not random noise. As such, diffusion…

计算机视觉与模式识别 · 计算机科学 2023-12-06 Linqi Zhou , Aaron Lou , Samar Khanna , Stefano Ermon

Recently, several discriminative learning approaches have been proposed for effective image restoration, achieving convincing trade-off between image quality and computational efficiency. However, these methods require separate training for…

计算机视觉与模式识别 · 计算机科学 2018-07-04 Lei Xiao , Felix Heide , Wolfgang Heidrich , Bernhard Schölkopf , Michael Hirsch

This paper explores the challenges and benefits of a trainable destruction process in diffusion samplers -- diffusion-based generative models trained to sample an unnormalised density without access to data samples. Contrary to the majority…

The rapid advancement in image generation models has predominantly been driven by diffusion models, which have demonstrated unparalleled success in generating high-fidelity, diverse images from textual prompts. Despite their success,…

计算机视觉与模式识别 · 计算机科学 2024-03-29 Yusuf Dalva , Hidir Yesiltepe , Pinar Yanardag