中文
相关论文

相关论文: Optimizing Noise Schedules of Generative Models in…

200 篇论文

Diffusion models, widely used in image generation, rely on iterative refinement to generate images from noise. Understanding this data evolution is important for model development and interpretability, yet challenging due to its…

计算机视觉与模式识别 · 计算机科学 2024-12-12 Vidya Prasad , Hans van Gorp , Christina Humer , Ruud J. G. van Sloun , Anna Vilanova , Nicola Pezzotti

Removing the shape noise from the observed weak lensing field, i.e., denoising, enhances the potential of WL by accessing information at small scales where the shape noise dominates without denoising. We utilise two machine learning (ML)…

宇宙学与河外天体物理 · 物理学 2026-05-13 Shohei D. Aoyama , Ken Osato , Masato Shirasaki

In this paper we present a method for single-channel wind noise reduction using our previously proposed diffusion-based stochastic regeneration model combining predictive and generative modelling. We introduce a non-additive speech in noise…

音频与语音处理 · 电气工程与系统科学 2024-01-10 Jean-Marie Lemercier , Joachim Thiemann , Raphael Koning , Timo Gerkmann

The generative priors of pre-trained latent diffusion models (DMs) have demonstrated great potential to enhance the visual quality of image super-resolution (SR) results. However, the noise sampling process in DMs introduces randomness in…

图像与视频处理 · 电气工程与系统科学 2024-09-26 Lingchen Sun , Rongyuan Wu , Jie Liang , Zhengqiang Zhang , Hongwei Yong , Lei Zhang

Denoising diffusion probabilistic models (DDPM) are a class of generative models which have recently been shown to produce excellent samples. We show that with a few simple modifications, DDPMs can also achieve competitive log-likelihoods…

机器学习 · 计算机科学 2021-02-22 Alex Nichol , Prafulla Dhariwal

An implicit goal in works on deep generative models is that such models should be able to generate novel examples that were not previously seen in the training data. In this paper, we investigate to what extent this property holds for…

机器学习 · 计算机科学 2018-12-27 Alican Bozkurt , Babak Esmaeili , Dana H. Brooks , Jennifer G. Dy , Jan-Willem van de Meent

Diffusion Policies have become widely used in Imitation Learning, offering several appealing properties, such as generating multimodal and discontinuous behavior. As models are becoming larger to capture more complex capabilities, their…

机器学习 · 计算机科学 2024-12-18 Moritz Reuss , Jyothish Pari , Pulkit Agrawal , Rudolf Lioutikov

Generative modeling aims to generate new data samples that resemble a given dataset, with diffusion models recently becoming the most popular generative model. One of the main challenges of diffusion models is solving the problem in the…

数值分析 · 数学 2025-10-08 Wonjun Lee , Riley C. W. O'Neill , Dongmian Zou , Jeff Calder , Gilad Lerman

Diffusion models offer a robust framework for sampling from unnormalized probability densities, which requires accurately estimating the score of the noise-perturbed target distribution. While the standard Denoising Score Identity (DSI)…

机器学习 · 计算机科学 2025-12-24 Khaled Kahouli , Romuald Elie , Klaus-Robert Müller , Quentin Berthet , Oliver T. Unke , Arnaud Doucet

Diffusion models learn to denoise data and the trained denoiser is then used to generate new samples from the data distribution. In this paper, we revisit the diffusion sampling process and identify a fundamental cause of sample quality…

机器学习 · 计算机科学 2024-11-05 Yunshu Wu , Yingtao Luo , Xianghao Kong , Evangelos E. Papalexakis , Greg Ver Steeg

Diffusion models generate high-quality samples but can also memorize training data, raising serious privacy concerns. Understanding the mechanisms governing when memorization versus generalization occurs remains an active area of research.…

机器学习 · 计算机科学 2026-02-23 Nick Dodson , Xinyu Gao , Qingsong Wang , Yusu Wang , Zhengchao Wan

Latent neural stochastic differential equations (SDEs) have recently emerged as a promising approach for learning generative models from stochastic time series data. However, they systematically underestimate the noise level inherent in…

机器学习 · 计算机科学 2025-06-11 Linus Heck , Maximilian Gelbrecht , Michael T. Schaub , Niklas Boers

In deep latent Gaussian models, the latent variable is generated by a time-inhomogeneous Markov chain, where at each time step we pass the current state through a parametric nonlinear map, such as a feedforward neural net, and add a small…

机器学习 · 计算机科学 2019-10-29 Belinda Tzen , Maxim Raginsky

Generating high-quality novel views of a scene from a single image requires maintaining structural coherence across different views, referred to as view consistency. While diffusion models have driven advancements in novel view synthesis,…

计算机视觉与模式识别 · 计算机科学 2025-08-07 Jiwoo Park , Tae Eun Choi , Youngjun Jun , Seong Jae Hwang

In this paper, we are interested in unsupervised (unknown noise) audio-visual speech enhancement based on variational autoencoders (VAEs), where the probability distribution of clean speech spectra is simulated using an encoder-decoder…

音频与语音处理 · 电气工程与系统科学 2021-03-10 Mostafa Sadeghi , Xavier Alameda-Pineda

Diffusion models achieve state-of-the-art image generation but remain computationally costly due to iterative denoising. Latent-space models like Stable Diffusion reduce overhead yet lose fine detail, while retrieval-augmented methods…

机器学习 · 计算机科学 2025-12-23 Bilal Faye , Hanane Azzag , Mustapha Lebbah

Exploiting the information provided by the molecular noise of a biological process has proven to be valuable in extracting knowledge about the underlying kinetic parameters and sources of variability from single cell measurements. However,…

定量方法 · 定量生物学 2013-08-30 Jakob Ruess , Andreas Milias-Argeitis , John Lygeros

Diffusion models learn to restore noisy data, which is corrupted with different levels of noise, by optimizing the weighted sum of the corresponding loss terms, i.e., denoising score matching loss. In this paper, we show that restoring data…

计算机视觉与模式识别 · 计算机科学 2022-04-04 Jooyoung Choi , Jungbeom Lee , Chaehun Shin , Sungwon Kim , Hyunwoo Kim , Sungroh Yoon

This paper considers the problem of recovering the permutation of an n-dimensional random vector X observed in Gaussian noise. First, a general expression for the probability of error is derived when a linear decoder (i.e., linear estimator…

信息论 · 计算机科学 2021-05-10 Minoh Jeong , Alex Dytso , Martina Cardone

Consistency models possess high capabilities for image generation, advancing sampling steps to a single step through their advanced techniques. Current advancements move one step forward consistency training techniques and eliminates the…

机器学习 · 计算机科学 2024-04-10 Mahmut S. Gokmen , Cody Bumgardner , Jie Zhang , Ge Wang , Jin Chen