English
Related papers

Related papers: Nested sampling cross-checks using order statistic…

200 papers

In this paper, we present a novel approach to accelerate the Bayesian inference process, focusing specifically on the nested sampling algorithms. Bayesian inference plays a crucial role in cosmological parameter estimation, providing a…

Instrumentation and Methods for Astrophysics · Physics 2024-10-17 Isidro Gómez-Vargas , J. Alberto Vázquez

Sampling errors in nested sampling parameter estimation differ from those in Bayesian evidence calculation, but have been little studied in the literature. This paper provides the first explanation of the two main sources of sampling errors…

Methodology · Statistics 2018-12-11 Edward Higson , Will Handley , Mike Hobson , Anthony Lasenby

We introduce a new class of sequential Monte Carlo methods which reformulates the essence of the nested sampling method of Skilling (2006) in terms of sequential Monte Carlo techniques. Two new algorithms are proposed, nested sampling via…

Cross-correlations between datasets are used in many different contexts in cosmological analyses. Recently, $k$-Nearest Neighbor Cumulative Distribution Functions ($k{\rm NN}$-${\rm CDF}$) were shown to be sensitive probes of cosmological…

Cosmology and Nongalactic Astrophysics · Physics 2021-04-28 Arka Banerjee , Tom Abel

Bayesian model selection provides a powerful framework for objectively comparing models directly from observed data, without reference to ground truth data. However, Bayesian model selection requires the computation of the marginal…

Methodology · Statistics 2024-01-17 Xiaohao Cai , Jason D. McEwen , Marcelo Pereyra

The recently introduced nested sampling algorithm allows the direct and efficient calculation of the partition function of atomistic systems. We demonstrate its applicability to condensed phase systems with periodic boundary conditions by…

Statistical Mechanics · Physics 2014-01-09 Lívia B. Pártay , Albert P. Bartók , Gábor Csányi

Bayesian model selection provides the cosmologist with an exacting tool to distinguish between competing models based purely on the data, via the Bayesian evidence. Previous methods to calculate this quantity either lacked general…

Astrophysics · Physics 2008-11-26 J. R. Shaw , M. Bridges , M. P. Hobson

Parameter estimation with non-Gaussian stochastic fields is a common challenge in astrophysics and cosmology. In this paper, we advocate performing this task using the scattering transform, a statistical tool sharing ideas with…

Cosmology and Nongalactic Astrophysics · Physics 2024-10-07 Sihao Cheng , Yuan-Sen Ting , Brice Ménard , Joan Bruna

For several decades now, Bayesian inference techniques have been applied to theories of particle physics, cosmology and astrophysics to obtain the probability density functions of their free parameters. In this study, we review and compare…

High Energy Physics - Phenomenology · Physics 2025-09-03 Joshua Albert , Csaba Balazs , Andrew Fowlie , Will Handley , Nicholas Hunt-Smith , Roberto Ruiz de Austri , Martin White

Handling big data has largely been a major bottleneck in traditional statistical models. Consequently, when accurate point prediction is the primary target, machine learning models are often preferred over their statistical counterparts for…

Methodology · Statistics 2021-04-02 Arindam Fadikar , Stefan M. Wild , Jonas Chaves-Montero

The Nearest subspace classifier (NSS) finds an estimation of the underlying subspace within each class and assigns data points to the class that corresponds to its nearest subspace. This paper mainly studies how well NSS can be generalized…

Machine Learning · Statistics 2015-01-27 Yi Wang

The present generation of weak lensing surveys will be superseded by surveys run from space with much better sky coverage and high level of signal to noise ratio, such as SNAP. However, removal of any systematics or noise will remain a…

Astrophysics · Physics 2009-11-10 Dipak Munshi , Patrick Valageas

Deep Neural Networks (DNN) are typically tested for accuracy relying on a set of unlabelled real world data (operational dataset), from which a subset is selected, manually labelled and used as test suite. This subset is required to be…

Software Engineering · Computer Science 2024-03-27 Antonio Guerriero , Roberto Pietrantuono , Stefano Russo

We present dynesty, a public, open-source, Python package to estimate Bayesian posteriors and evidences (marginal likelihoods) using Dynamic Nested Sampling. By adaptively allocating samples based on posterior structure, Dynamic Nested…

Instrumentation and Methods for Astrophysics · Physics 2020-02-12 Joshua S Speagle

Standard deep neural networks (DNNs) are commonly trained in an end-to-end fashion for specific tasks such as object recognition, face identification, or character recognition, among many examples. This specificity often leads to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Raphaël Achddou , J. Matias di Martino , Guillermo Sapiro

Here we present an investigation into using nested sampling algorithms in cosmological likelihood analysis. We present a new nested sampling algorithm, ESNested, that uses Evolution Strategies for sample proposals. This quickly finds the…

Cosmology and Nongalactic Astrophysics · Physics 2011-01-28 M. Axiak , T. D. Kitching , J. I. van Hemert

Astronomers are often confronted with funky populations and distributions of objects: brighter objects are more likely to be detected; targets are selected based on colour cuts; imperfect classification yields impure samples. Failing to…

Cosmology and Nongalactic Astrophysics · Physics 2017-06-21 Samuel R. Hinton , Alex Kim , Tamara M. Davis

While the evaluation of explanations is an important step towards trustworthy models, it needs to be done carefully, and the employed metrics need to be well-understood. Specifically model randomization testing is often overestimated and…

We consider the problem of multiple hypothesis testing when there is a logical nested structure to the hypotheses. When one hypothesis is nested inside another, the outer hypothesis must be false if the inner hypothesis is false. We model…

Methodology · Statistics 2021-03-17 Jackson H. Loper , Lihua Lei , William Fithian , Wesley Tansey