English
Related papers

Related papers: MCMC-Correction of Score-Based Diffusion Models fo…

200 papers

Diffusion probabilistic models have generated high quality image synthesis recently. However, one pain point is the notorious inference to gradually obtain clear images with thousands of steps, which is time consuming compared to other…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Gang Chen

The need to calibrate increasingly complex statistical models requires a persistent effort for further advances on available, computationally intensive Monte Carlo methods. We study here an advanced version of familiar Markov Chain Monte…

Methodology · Statistics 2015-03-20 Alexandros Beskos , Konstantinos Kalogeropoulos , Erik Pazos

The recent, impressive advances in algorithmic generation of high-fidelity image, audio, and video are largely due to great successes in score-based diffusion models. A key implementing step is score matching, that is, the estimation of the…

Machine Learning · Statistics 2024-09-12 Zehao Dou , Subhodh Kotekal , Zhehao Xu , Harrison H. Zhou

Markov chain Monte Carlo (MCMC) methods are sampling methods that have become a commonly used tool in statistics, for example to perform Monte Carlo integration. As a consequence of the increase in computational power, many variations of…

Computation · Statistics 2021-06-14 F. Din-Houn Lau , Sebastian Krumscheid

Constrained decoding enables Language Models (LMs) to produce samples that provably satisfy hard constraints. However, existing constrained-decoding approaches often distort the underlying model distribution, a limitation that is especially…

Artificial Intelligence · Computer Science 2025-06-09 Emmanuel Anaya Gonzalez , Sairam Vaidya , Kanghee Park , Ruyi Ji , Taylor Berg-Kirkpatrick , Loris D'Antoni

Diffusion-based generative models (DBGMs) perturb data to a target noise distribution and reverse this process to generate samples. The choice of noising process, or inference diffusion process, affects both likelihoods and sample quality.…

Machine Learning · Computer Science 2023-03-06 Raghav Singhal , Mark Goldstein , Rajesh Ranganath

Divide-and-conquer MCMC is a strategy for parallelising Markov Chain Monte Carlo sampling by running independent samplers on disjoint subsets of a dataset and merging their output. An ongoing challenge in the literature is to efficiently…

Machine Learning · Statistics 2024-06-18 C. Trojan , P. Fearnhead , C. Nemeth

We develop diffusion-based samplers for target distributions known up to a normalising constant. To this end, we rely on the well-known diffusion path that smoothly interpolates between a simple base distribution and the target, popularised…

Markov Chain Monte Carlo (MCMC) methods, such as the Metropolis-Hastings (MH) algorithm, are widely used for Bayesian inference. One of the most important issues for any MCMC method is the convergence of the Markov chain, which depends…

Computation · Statistics 2015-11-20 Luca Martino , Jesse Read , David Luengo

We introduce a score-based generative sampling method for solving the nonlinear filtering problem with robust accuracy. A major drawback of existing nonlinear filtering methods, e.g., particle filters, is the low stability. To overcome this…

Optimization and Control · Mathematics 2023-06-16 Feng Bao , Zezhong Zhang , Guannan Zhang

MRI and CT are most widely used medical imaging modalities. It is often necessary to acquire multi-modality images for diagnosis and treatment such as radiotherapy planning. However, multi-modality imaging is not only costly but also…

Image and Video Processing · Electrical Eng. & Systems 2022-10-03 Qing Lyu , Ge Wang

We present Style Matching Score (SMS), a novel optimization method for image stylization with diffusion models. Balancing effective style transfer with content preservation is a long-standing challenge. Unlike existing efforts, our method…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Yuxin Jiang , Liming Jiang , Shuai Yang , Jia-Wei Liu , Ivor Tsang , Mike Zheng Shou

Diffusion generative models have excelled at diverse image generation and reconstruction tasks across fields. A less explored avenue is their application to discriminative tasks involving regression or classification problems. The…

Cosmology and Nongalactic Astrophysics · Physics 2025-02-26 Nayantara Mudur , Carolina Cuesta-Lazaro , Douglas P. Finkbeiner

Diffusion models have achieved great success in generating high-dimensional samples across various applications. While the theoretical guarantees for continuous-state diffusion models have been extensively studied, the convergence analysis…

Machine Learning · Computer Science 2025-04-15 Zikun Zhang , Zixiang Chen , Quanquan Gu

In this article we propose a novel MCMC method based on deterministic transformations T: X x D --> X where X is the state-space and D is some set which may or may not be a subset of X. We refer to our new methodology as Transformation-based…

Computation · Statistics 2013-10-21 Somak Dutta , Sourabh Bhattacharya

We address the problem of parameter estimation for diffusion driven stochastic volatility models through Markov chain Monte Carlo (MCMC). To avoid degeneracy issues we introduce an innovative reparametrisation defined through…

Methodology · Statistics 2008-12-02 Konstantinos Kalogeropoulos , Gareth O. Roberts , Petros Dellaportas

We present Diffusion Restore, a real-time framework for diffusion-based MCMC light transport. MCMC methods are highly suitable for sampling from complex high-dimensional distributions and for approximating integrals over them. In practice,…

Computational Engineering, Finance, and Science · Computer Science 2026-05-21 Sascha Holl , Gurprit Singh , Hans-Peter Seidel

Reversing a diffusion process by learning its score forms the heart of diffusion-based generative modeling and for estimating properties of scientific systems. The diffusion processes that are tractable center on linear processes with a…

Machine Learning · Computer Science 2024-07-12 Raghav Singhal , Mark Goldstein , Rajesh Ranganath

Score matching is an approach to learning probability distributions parametrized up to a constant of proportionality (e.g. Energy-Based Models). The idea is to fit the score of the distribution, rather than the likelihood, thus avoiding the…

Machine Learning · Computer Science 2024-01-31 Yilong Qin , Andrej Risteski

Machine learning models are increasingly trained or fine-tuned on synthetic data. Recursively training on such data has been observed to significantly degrade performance in a wide range of tasks, often characterized by a progressive drift…

Machine Learning · Statistics 2026-02-19 Nail B. Khelifa , Richard E. Turner , Ramji Venkataramanan