English
Related papers

Related papers: IID Sampling from Intractable Distributions

200 papers

Diffusion models are distinguished by their exceptional generative performance, particularly in producing high-quality samples through iterative denoising. While current theory suggests that the number of denoising steps required for…

Machine Learning · Computer Science 2025-04-08 Gen Li , Changxiao Cai , Yuting Wei

Slice sampling is a well-established Markov chain Monte Carlo method for (approximate) sampling of target distributions which are only known up to a normalizing constant. The method is based on choosing a new state on a slice, i.e., a…

Computation · Statistics 2025-12-22 Kevin Bitterlich , Daniel Rudolf , Björn Sprungk

This paper provides an elementary, self-contained analysis of diffusion-based sampling methods for generative modeling. In contrast to existing approaches that rely on continuous-time processes and then discretize, our treatment works…

Machine Learning · Statistics 2025-06-25 Galen Reeves , Henry D. Pfister

In this paper we examine a number of models that generate random fractals. The models are studied using the tools of computational complexity theory from the perspective of parallel computation. Diffusion limited aggregation and several…

Condensed Matter · Physics 2009-10-28 J. Machta , R. Greenlaw

Diffusion models are a remarkably effective way of learning and sampling from a distribution $p(x)$. In posterior sampling, one is also given a measurement model $p(y \mid x)$ and a measurement $y$, and would like to sample from $p(x \mid…

Machine Learning · Computer Science 2025-11-11 Shivam Gupta , Ajil Jalal , Aditya Parulekar , Eric Price , Zhiyang Xun

In this work, we introduce a novel class of adaptive Monte Carlo methods, called adaptive independent sticky MCMC algorithms, for efficient sampling from a generic target probability density function (pdf). The new class of algorithms…

Computation · Statistics 2025-04-09 L. Martino , R. Casarin , F. Leisen , D. Luengo

In many areas of applied statistics and machine learning, generating an arbitrary number of independent and identically distributed (i.i.d.) samples from a given distribution is a key task. When the distribution is known only through…

Artificial Intelligence · Computer Science 2021-10-29 Ulysse Marteau-Ferey , Francis Bach , Alessandro Rudi

Well-spread samples are desirable in many disciplines because they improve estimation when target variables exhibit spatial structure. This paper introduces an integrated methodological framework for spreading samples over the population's…

Methodology · Statistics 2025-10-29 Bardia Panahbehagh , Mehdi Mohebbi , Amir Mohammad HosseiniNasab

Deep Learning performs well when training data densely covers the experience space. For complex problems this makes data collection prohibitively expensive. We propose to intelligently select samples when constructing data sets in order to…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Mark Philip Philipsen , Thomas Baltzer Moeslund

The computational complexity of MCMC methods for the exploration of complex probability measures is a challenging and important problem. A challenge of particular importance arises in Bayesian inverse problems where the target distribution…

Statistics Theory · Mathematics 2014-10-23 Sebastian J. Vollmer

Reliable out-of-distribution (OOD) detection is fundamental to implementing safer modern machine learning (ML) systems. In this paper, we introduce Igeood, an effective method for detecting OOD samples. Igeood applies to any pre-trained…

Machine Learning · Statistics 2022-03-16 Eduardo Dadalto Camara Gomes , Florence Alberge , Pierre Duhamel , Pablo Piantanida

We present a novel method to compute the approximate global penetration depth (PD) between two non-convex geometric models. Our approach consists of two phases: offline precomputation and run-time queries. In the first phase, our…

Robotics · Computer Science 2015-11-16 Liang He , Jia Pan , Danwei Li , Dinesh Manocha

Monte Carlo methods represent the "de facto" standard for approximating complicated integrals involving multidimensional target distributions. In order to generate random realizations from the target distribution, Monte Carlo techniques use…

Computation · Statistics 2022-01-21 L. Martino , V. Elvira , D. Luengo , J. Corander

We propose a probabilistic shape completion method extended to the continuous geometry of large-scale 3D scenes. Real-world scans of 3D scenes suffer from a considerable amount of missing data cluttered with unsegmented objects. The problem…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Dongsu Zhang , Changwoon Choi , Inbum Park , Young Min Kim

Elliptical slice sampling is a widely used gradient-free Markov chain Monte Carlo algorithm that is tuning-free and capable of adapting to local characteristics of the target distribution. However, its primary limitation is that sampling…

Computation · Statistics 2026-05-22 Nicholas Marco , Surya T. Tokdar

For a $d$-dimensional log-concave distribution $\pi(\theta) \propto e^{-f(\theta)}$ constrained to a convex body $K$, the problem of outputting samples from a distribution $\nu$ which is $\varepsilon$-close in infinity-distance…

Data Structures and Algorithms · Computer Science 2022-11-14 Oren Mangoubi , Nisheeth K. Vishnoi

Bayesian model selection provides the cosmologist with an exacting tool to distinguish between competing models based purely on the data, via the Bayesian evidence. Previous methods to calculate this quantity either lacked general…

Astrophysics · Physics 2008-11-26 J. R. Shaw , M. Bridges , M. P. Hobson

In light of the widespread success of generative models, a significant amount of research has gone into speeding up their sampling time. However, generative models are often sampled multiple times to obtain a diverse set incurring a cost…

Machine Learning · Computer Science 2023-11-27 Gabriele Corso , Yilun Xu , Valentin de Bortoli , Regina Barzilay , Tommi Jaakkola

Multi-object spectroscopic galaxy surveys typically make use of photometric and colour criteria to select targets. Conversely, the Euclid NISP slitless spectrograph will record spectra for every source over its field of view. Slitless…

Cosmology and Nongalactic Astrophysics · Physics 2024-09-18 M. S. Cagliari , B. R. Granett , L. Guzzo , M. Bethermin , M. Bolzonella , S. de la Torre , P. Monaco , M. Moresco , W. J. Percival , C. Scarlata , Y. Wang , M. Ezziati , O. Ilbert , V. Le Brun , A. Amara , S. Andreon , N. Auricchio , M. Baldi , S. Bardelli , R. Bender , C. Bodendorf , E. Branchini , M. Brescia , J. Brinchmann , S. Camera , V. Capobianco , C. Carbone , J. Carretero , S. Casas , M. Castellano , S. Cavuoti , A. Cimatti , G. Congedo , C. J. Conselice , L. Conversi , Y. Copin , L. Corcione , F. Courbin , H. M. Courtois , A. Da Silva , H. Degaudenzi , A. M. Di Giorgio , J. Dinis , F. Dubath , C. A. J. Duncan , X. Dupac , S. Dusini , A. Ealet , M. Farina , S. Farrens , S. Ferriol , S. Fotopoulou , M. Frailis , E. Franceschi , S. Galeotta , B. Gillis , C. Giocoli , A. Grazian , F. Grupp , S. V. H. Haugan , H. Hoekstra , I. Hook , F. Hormuth , A. Hornstrup , K. Jahnke , E. Keihänen , S. Kermiche , A. Kiessling , M. Kilbinger , B. Kubik , M. Kümmel , M. Kunz , H. Kurki-Suonio , S. Ligori , P. B. Lilje , V. Lindholm , I. Lloro , D. Maino , E. Maiorano , O. Mansutti , O. Marggraf , K. Markovic , N. Martinet , F. Marulli , R. Massey , S. Maurogordato , H. J. McCracken , E. Medinaceli , S. Mei , Y. Mellier , M. Meneghetti , E. Merlin , G. Meylan , L. Moscardini , E. Munari , R. C. Nichol , S. -M. Niemi , C. Padilla , S. Paltani , F. Pasian , K. Pedersen , V. Pettorino , S. Pires , G. Polenta , M. Poncet , L. A. Popa , L. Pozzetti , F. Raison , R. Rebolo , A. Renzi , J. Rhodes , G. Riccio , E. Romelli , M. Roncarelli , E. Rossetti , R. Saglia , D. Sapone , B. Sartoris , P. Schneider , M. Scodeggio , A. Secroun , G. Seidel , M. Seiffert , S. Serrano , C. Sirignano , G. Sirri , J. Skottfelt , L. Stanco , C. Surace , A. N. Taylor , H. I. Teplitz , I. Tereno , R. Toledo-Moreo , F. Torradeflot , I. Tutusaus , E. A. Valentijn , L. Valenziano , T. Vassallo , A. Veropalumbo , J. Weller , G. Zamorani , J. Zoubian , E. Zucca , C. Burigana , V. Scottez , M. Viel , L. Bisigello

We present the umbrella sampling (US) technique and show that it can be used to sample extremely low probability areas of the posterior distribution that may be required in statistical analyses of data. In this approach sampling of the…

Instrumentation and Methods for Astrophysics · Physics 2018-08-15 Charles Matthews , Jonathan Weare , Andrey Kravtsov , Elise Jennings