English
Related papers

Related papers: Solving Inverse Problems with Score-Based Generati…

200 papers

We consider testing statistical hypotheses about densities of signals in deconvolution models. A new approach to this problem is proposed. We constructed score tests for the deconvolution with the known noise density and efficient score…

Statistics Theory · Mathematics 2013-12-02 Mikhail Langovoy

We provide an overview of the diffusion model as a method to generate new samples. Generative models have been recently adopted for tasks such as art generation (Stable Diffusion, Dall-E) and text generation (ChatGPT). Diffusion models in…

Machine Learning · Statistics 2025-06-13 Justin Le

This work presents an unsupervised deep learning scheme that exploiting high-dimensional assisted score-based generative model for color image restoration tasks. Considering that the sample number and internal dimension in score-based…

Image and Video Processing · Electrical Eng. & Systems 2021-08-17 Kai Hong , Chunhua Wu , Cailian Yang , Minghui Zhang , Yancheng Lu , Yuhao Wang , Qiegen Liu

Capitalizing on the complementary advantages of generative and discriminative models has always been a compelling vision in machine learning, backed by a growing body of research. This work discloses the hidden semantic structure within…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Mingjia Li , Shuang Li , Tongrui Su , Longhui Yuan , Jian Liang , Wei Li

Point clouds acquired from scanning devices are often perturbed by noise, which affects downstream tasks such as surface reconstruction and analysis. The distribution of a noisy point cloud can be viewed as the distribution of a set of…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Shitong Luo , Wei Hu

Deep neural network based speech enhancement approaches aim to learn a noisy-to-clean transformation using a supervised learning paradigm. However, such a trained-well transformation is vulnerable to unseen noises that are not included in…

Sound · Computer Science 2023-02-24 Chen Chen , Yuchen Hu , Heqing Zou , Linhui Sun , Eng Siong Chng

Building on recent advances in Bayesian statistics and image denoising, we propose Noise2Score3D, a fully unsupervised framework for point cloud denoising. Noise2Score3D learns the score function of the underlying point cloud distribution…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Xiangbin Wei , Yuanfeng Wang , Ao XU , Lingyu Zhu , Dongyong Sun , Keren Li , Yang Li , Qi Qin

Diffusion models are widely used as priors in imaging inverse problems. However, their performance often degrades under distribution shifts between the training and test-time images. Existing methods for identifying and quantifying…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Shirin Shoushtari , Edward P. Chandler , Yuanhao Wang , M. Salman Asif , Ulugbek S. Kamilov

Modeling imaging sensor noise is a fundamental problem for image processing and computer vision applications. While most previous works adopt statistical noise models, real-world noise is far more complicated and beyond what these models…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Ke-Chi Chang , Ren Wang , Hung-Jin Lin , Yu-Lun Liu , Chia-Ping Chen , Yu-Lin Chang , Hwann-Tzong Chen

Score-based diffusion models synthesize samples by reversing a stochastic process that diffuses data to noise, and are trained by minimizing a weighted combination of score matching losses. The log-likelihood of score-based diffusion models…

Machine Learning · Statistics 2021-10-22 Yang Song , Conor Durkan , Iain Murray , Stefano Ermon

Since most inverse problems arising in scientific and engineering applications are ill-posed, prior information about the solution space is incorporated, typically through regularization, to establish a well-posed problem with a unique…

Signal Processing · Electrical Eng. & Systems 2024-06-18 Carter Lyons , Raghu G. Raj , Margaret Cheney

We propose a new score-based model with one-step sampling. Previously, score-based models were burdened with heavy computations due to iterative sampling. For substituting the iterative process, we train a standalone generator to compress…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Senmao Ye , Fei Liu

Diffusion models are typically trained using score matching, a learning objective agnostic to the underlying noising process that guides the model. This paper argues that Markov noising processes enjoy an advantage over alternatives, as the…

Machine Learning · Statistics 2025-05-27 Zheyang Shen , Huihui Wang , Marina Riabiz , Chris J. Oates

The tremendous success of generative models in recent years raises the question whether they can also be used to perform classification. Generative models have been used as adversarially robust classifiers on simple datasets such as MNIST,…

Machine Learning · Statistics 2021-12-14 Roland S. Zimmermann , Lukas Schott , Yang Song , Benjamin A. Dunn , David A. Klindt

Prior probability models are a fundamental component of many image processing problems, but density estimation is notoriously difficult for high-dimensional signals such as photographic images. Deep neural networks have provided…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Zahra Kadkhodaie , Eero P. Simoncelli

Recent literature has effectively leveraged diffusion models trained on continuous variables as priors for solving inverse problems. Notably, discrete diffusion models with discrete latent codes have shown strong performance, particularly…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Naoki Murata , Chieh-Hsin Lai , Yuhta Takida , Toshimitsu Uesaka , Bac Nguyen , Stefano Ermon , Yuki Mitsufuji

Recently, Stein's unbiased risk estimator (SURE) has been applied to unsupervised training of deep neural network Gaussian denoisers that outperformed classical non-deep learning based denoisers and yielded comparable performance to those…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Magauiya Zhussip , Shakarim Soltanayev , Se Young Chun

Diffusion models are gaining widespread use in cutting-edge image, video, and audio generation. Score-based diffusion models stand out among these methods, necessitating the estimation of score function of the input data distribution. In…

Machine Learning · Computer Science 2024-05-24 Fangzhao Zhang , Mert Pilanci

Recent diffusion-based generative models achieve remarkable results by training on massive datasets, yet this practice raises concerns about memorization and copyright infringement. A proposed remedy is to train exclusively on noisy data…

Machine Learning · Computer Science 2025-06-04 Haoye Lu , Qifan Wu , Yaoliang Yu

We present a novel approach to reconstruct gas and dark matter projected density maps of galaxy clusters using score-based generative modeling. Our diffusion model takes in mock SZ and X-ray images as conditional inputs, and generates…

Cosmology and Nongalactic Astrophysics · Physics 2025-07-16 Alan Hsu , Matthew Ho , Joyce Lin , Carleen Markey , Michelle Ntampaka , Hy Trac , Barnabás Póczos