中文
相关论文

相关论文: Improved Techniques for Training Score-Based Gener…

200 篇论文

We introduce a new generative model where samples are produced via Langevin dynamics using gradients of the data distribution estimated with score matching. Because gradients can be ill-defined and hard to estimate when the data resides on…

机器学习 · 计算机科学 2020-10-13 Yang Song , Stefano Ermon

Most existing generative models are limited to learning a single probability distribution from the training data and cannot generalize to novel distributions for unseen data. An architecture that can generate samples from both trained…

机器学习 · 计算机科学 2024-10-16 Xinyu Liao , Aoyang Qin , Jacob Seidman , Junqi Wang , Wei Wang , Paris Perdikaris

Score-based models generate samples by mapping noise to data (and vice versa) via a high-dimensional diffusion process. We question whether it is necessary to run this entire process at high dimensionality and incur all the inconveniences…

机器学习 · 计算机科学 2023-02-28 Bowen Jing , Gabriele Corso , Renato Berlinghieri , Tommi Jaakkola

Score-based generative models have demonstrated highly promising results for medical image reconstruction tasks in magnetic resonance imaging or computed tomography. However, their application to Positron Emission Tomography (PET) is still…

图像与视频处理 · 电气工程与系统科学 2024-01-24 Imraj RD Singh , Alexander Denker , Riccardo Barbano , Željko Kereta , Bangti Jin , Kris Thielemans , Peter Maass , Simon Arridge

Advances in generative models increase the need for sample quality assessment. To do so, previous methods rely on a pre-trained feature extractor to embed the generated samples and real samples into a common space for comparison. However,…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Jingyi Xu , Hieu Le , Dimitris Samaras

A valuable step in the modeling of multiscale dynamical systems in fields such as computational chemistry, biology, materials science and more, is the representative sampling of the phase space over long timescales of interest; this task is…

机器学习 · 计算机科学 2023-12-29 Ellis R. Crabtree , Juan M. Bello-Rivas , Ioannis G. Kevrekidis

Generative adversarial networks (GANs) usually struggle in learning from highly diverse data, whose underlying manifold is complex. In this work, we revisit the mathematical foundations of GANs, and theoretically reveal that the native…

机器学习 · 计算机科学 2025-10-02 Mengfei Xia , Yujun Shen , Ceyuan Yang , Ran Yi , Wenping Wang , Yong-Jin Liu

A longstanding problem in machine learning is to find unsupervised methods that can learn the statistical structure of high dimensional signals. In recent years, GANs have gained much attention as a possible solution to the problem, and in…

计算机视觉与模式识别 · 计算机科学 2018-11-06 Eitan Richardson , Yair Weiss

Generative adversarial networks (GANs) have achieved remarkable progress in the natural image field. However, when applying GANs in the remote sensing (RS) image generation task, an extraordinary phenomenon is observed: the GAN model is…

计算机视觉与模式识别 · 计算机科学 2024-05-15 Xingzhe Su , Wenwen Qiang , Jie Hu , Fengge Wu , Changwen Zheng , Fuchun Sun

Recent work has explored a range of model families for human motion generation, including Variational Autoencoders (VAEs), Generative Adversarial Networks (GANs), and diffusion-based models. Despite their differences, many methods rely on…

计算机视觉与模式识别 · 计算机科学 2025-10-15 David Björkstrand , Tiesheng Wang , Lars Bretzner , Josephine Sullivan

Score-based generative models (SGMs) have recently emerged as a promising class of generative models. However, a fundamental limitation is that their inference is very slow due to a need for many (e.g., 2000) iterations of sequential…

计算机视觉与模式识别 · 计算机科学 2022-12-06 Hengyuan Ma , Li Zhang , Xiatian Zhu , Jianfeng Feng

Neural networks have proven their capabilities by outperforming many other approaches on regression or classification tasks on various kinds of data. Other astonishing results have been achieved using neural nets as data generators,…

计算机视觉与模式识别 · 计算机科学 2018-10-16 Andrej Junginger , Markus Hanselmann , Thilo Strauss , Sebastian Boblest , Jens Buchner , Holger Ulmer

We present SURE-Score: an approach for learning score-based generative models using training samples corrupted by additive Gaussian noise. When a large training set of clean samples is available, solving inverse problems via score-based…

机器学习 · 计算机科学 2025-04-23 Asad Aali , Marius Arvinte , Sidharth Kumar , Jonathan I. Tamir

Generative models operate at fixed resolution, even though natural images come in a variety of sizes. As high-resolution details are downsampled away and low-resolution images are discarded altogether, precious supervision is lost. We argue…

计算机视觉与模式识别 · 计算机科学 2022-08-08 Lucy Chai , Michael Gharbi , Eli Shechtman , Phillip Isola , Richard Zhang

Score-based generative models (SGMs) sample from a target distribution by iteratively transforming noise using the score function of the perturbed target. For any finite training set, this score function can be evaluated in closed form, but…

机器学习 · 计算机科学 2025-05-07 Christopher Scarvelis , Haitz Sáez de Ocáriz Borde , Justin Solomon

Deep generative models require large amounts of training data. This often poses a problem as the collection of datasets can be expensive and difficult, in particular datasets that are representative of the appropriate underlying…

计算机视觉与模式识别 · 计算机科学 2023-12-22 Anubhav Jain , Nasir Memon , Julian Togelius

Recent GAN-based (Generative adversarial networks) inpainting methods show remarkable improvements and generate plausible images using multi-stage networks or Contextual Attention Modules (CAM). However, these techniques increase the model…

计算机视觉与模式识别 · 计算机科学 2021-02-16 Mohamed Abbas Hedjazi , Yakup Genc

This work presents an unsupervised deep learning scheme that exploiting high-dimensional assisted score-based generative model for color image restoration tasks. Considering that the sample number and internal dimension in score-based…

图像与视频处理 · 电气工程与系统科学 2021-08-17 Kai Hong , Chunhua Wu , Cailian Yang , Minghui Zhang , Yancheng Lu , Yuhao Wang , Qiegen Liu

We introduce a simple but effective unsupervised method for generating realistic and diverse images. We train a class-conditional GAN model without using manually annotated class labels. Instead, our model is conditional on labels…

计算机视觉与模式识别 · 计算机科学 2022-02-11 Steven Liu , Tongzhou Wang , David Bau , Jun-Yan Zhu , Antonio Torralba

Score-based diffusion modeling is a generative machine learning algorithm that can be used to sample from complex distributions. They achieve this by learning a score function, i.e., the gradient of the log-probability density of the data,…

机器学习 · 计算机科学 2025-12-17 Dibyajyoti Chakraborty , Haiwen Guan , Jason Stock , Troy Arcomano , Guido Cervone , Romit Maulik