English
Related papers

Related papers: Sampling from Energy distributions with Target Con…

200 papers

Denoising diffusion models are a popular class of generative models providing state-of-the-art results in many domains. One adds gradually noise to data using a diffusion to transform the data distribution into a Gaussian distribution.…

Machine Learning · Computer Science 2023-08-21 Francisco Vargas , Will Grathwohl , Arnaud Doucet

Diffusion models have achieved huge empirical success in data generation tasks. Recently, some efforts have been made to adapt the framework of diffusion models to discrete state space, providing a more natural approach for modeling…

Machine Learning · Statistics 2024-02-15 Hongrui Chen , Lexing Ying

We propose a physics-aware Consistency Training (CT) method that accelerates sampling in Diffusion Models with physical constraints. Our approach leverages a two-stage strategy: (1) learning the noise-to-data mapping via CT, and (2)…

Machine Learning · Computer Science 2025-02-12 Che-Chia Chang , Chen-Yang Dai , Te-Sheng Lin , Ming-Chih Lai , Chieh-Hsin Lai

We propose a new framework for efficiently sampling from complex probability distributions using a combination of normalizing flows and elliptical slice sampling (Murray et al., 2010). The central idea is to learn a diffeomorphism, through…

Methodology · Statistics 2023-03-28 Alberto Cabezas , Christopher Nemeth

Since its discovery over the last decade, Compressed Sensing (CS) has been successfully applied to Magnetic Reso- nance Imaging (MRI). It has been shown to be a powerful way to reduce scanning time without sacrificing image quality. MR…

Applications · Statistics 2013-07-29 Nicolas Chauffert , Philippe Ciuciu , Pierre Weiss , Fabrice Gamboa

Markov chain Monte Carlo (MCMC) is a powerful tool for sampling from complex probability distributions. Despite its versatility, MCMC often suffers from strong autocorrelation and the negative sign problem, leading to slowing down the…

Statistical Mechanics · Physics 2024-12-05 Synge Todo

Geophysical inverse problems are often ill-posed and admit multiple solutions. Conventional discriminative methods typically yield a single deterministic solution, which fails to model the posterior distribution, cannot generate diverse…

Long scan time significantly hinders the widespread applications of three-dimensional multi-contrast cardiac magnetic resonance (3D-MC-CMR) imaging. This study aims to accelerate 3D-MC-CMR acquisition by a novel method based on score-based…

Signal Processing · Electrical Eng. & Systems 2024-10-29 Yuanyuan Liu , Zhuo-Xu Cui , Shucong Qin , Congcong Liu , Hairong Zheng , Haifeng Wang , Yihang Zhou , Dong Liang , Yanjie Zhu

Markov chain Monte Carlo (MCMC) methods are simulated by local exploration of complex statistical distributions, and while bypassing the cumbersome requirement of a specific analytical expression for the target, this stochastic exploration…

Computation · Statistics 2023-12-04 Xiongming Dai , Gerald Baumgartner

Score-based generative models (SGMs) have gained prominence in sparse-view CT reconstruction for their precise sampling of complex distributions. In SGM-based reconstruction, data consistency in the score-based diffusion model ensures close…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Weiwen Wu , Yanyang Wang

We provide the first complete continuous time framework for denoising diffusion models of discrete data. This is achieved by formulating the forward noising process and corresponding reverse time generative process as Continuous Time Markov…

Reducing acquisition time is a crucial challenge for many imaging techniques. Compressed Sensing (CS) theory offers an appealing framework to address this issue since it provides theoretical guarantees on the reconstruction of sparse…

Applications · Statistics 2014-07-17 Nicolas Chauffert , Philippe Ciuciu , Jonas Kahn , Pierre Weiss

We present a form of stratified MCMC algorithm built with non-reversible stochastic dynamics in mind. It can also be viewed as a generalization of the exact milestoning method, or form of NEUS. We prove convergence of the method under…

Probability · Mathematics 2022-02-21 Gabriel Earle , Jonathan Mattingly

Efficient sampling of many-dimensional and multimodal density functions is a task of great interest in many research fields. We describe an algorithm that allows parallelizing inherently serial Markov chain Monte Carlo (MCMC) sampling by…

Computation · Statistics 2020-08-10 Vasyl Hafych , Philipp Eller , Oliver Schulz , Allen Caldwell

Two common problems in time series analysis are the decomposition of the data stream into disjoint segments that are each in some sense "homogeneous" - a problem known as Change Point Detection (CPD) - and the grouping of similar…

Signal Processing · Electrical Eng. & Systems 2020-02-24 Kevin C. Cheng , Shuchin Aeron , Michael C. Hughes , Erika Hussey , Eric L. Miller

In the context of Bayesian inversion for scientific and engineering modeling, Markov chain Monte Carlo sampling strategies are the benchmark due to their flexibility and robustness in dealing with arbitrary posterior probability density…

Computation · Statistics 2021-12-07 Han Lu , Mohammad Khalil , Thomas Catanach , Jiefu Chen , Xuqing Wu , Xin Fu , Cosmin Safta , Yueqin Huang

Bayesian inference requires determining the posterior distribution, a task that becomes particularly challenging when the dimension of the parameter space is large and unknown. This limitation arises in many physics problems, such as…

Sampling the parameters of high-dimensional Continuous Time Markov Chains (CTMC) is a challenging problem with important applications in many fields of applied statistics. In this work a recently proposed type of non-reversible…

Machine Learning · Statistics 2021-06-01 Tingting Zhao , Alexandre Bouchard-Côté

Noise contrastive estimation (NCE) is a popular method for training energy-based models (EBM) with intractable normalisation terms. The key idea of NCE is to learn by comparing unnormalised log-likelihoods of the reference and noisy…

Sound · Computer Science 2025-05-21 Wanli Sun , Anton Ragni

We develop a modular approach to Markov chain Monte Carlo (MCMC) sampling for unnormalized target densities. In this approach, Markov chains are constructed in parallel, each constrained to a subset of the target space. The Monte Carlo…

Computation · Statistics 2026-05-05 Joonha Park