English
Related papers

Related papers: Massive optimal data compression and density estim…

200 papers

This paper aims to develop an effective model-free inference procedure for high-dimensional data. We first reformulate the hypothesis testing problem via sufficient dimension reduction framework. With the aid of new reformulation, we…

Methodology · Statistics 2022-05-17 Xu Guo , Runze Li , Zhe Zhang , Changliang Zou

Machine-learning techniques have become fundamental in high-energy physics and, for new physics searches, it is crucial to know their performance in terms of experimental sensitivity, understood as the statistical significance of the…

High Energy Physics - Phenomenology · Physics 2022-11-10 Ernesto Arganda , Xabier Marcano , Víctor Martín Lozano , Anibal D. Medina , Andres D. Perez , Manuel Szewc , Alejandro Szynkman

We develop, discuss, and compare several inference techniques to constrain theory parameters in collider experiments. By harnessing the latent-space structure of particle physics processes, we extract extra information from the simulator.…

High Energy Physics - Phenomenology · Physics 2018-09-19 Johann Brehmer , Kyle Cranmer , Gilles Louppe , Juan Pavez

Likelihood-free inference (LFI) has been successfully applied to state-space models, where the likelihood of observations is not available but synthetic observations generated by a black-box simulator can be used for inference instead.…

Machine Learning · Computer Science 2023-02-21 Alexander Aushev , Thong Tran , Henri Pesonen , Andrew Howes , Samuel Kaski

The frequentist method of profile likelihoods has recently received renewed attention in the field of cosmology. This is because the results of inferences based on the latter may differ from those of Bayesian inferences, either because of…

Cosmology and Nongalactic Astrophysics · Physics 2023-12-15 Andreas Nygaard , Emil Brinch Holm , Steen Hannestad , Thomas Tram

We demonstrate that the Bayesian evidence can be used to find a good approximation of the ground truth likelihood function of a dataset, a goal of the likelihood-free inference (LFI) paradigm. As a concrete example, we use forward modelled…

Cosmology and Nongalactic Astrophysics · Physics 2023-06-14 K. H. Scheutwinkel , W. Handley , E. de Lera Acedo

Probability mass curves the data space with horizons. Let f be a multivariate probability density function with continuous second order partial derivatives. Consider the problem of estimating the true value of f(z) > 0 at a single point z,…

Data Analysis, Statistics and Probability · Physics 2009-11-06 Carlos C. Rodriguez

In this work we investigated methods for the accurate and efficient incorporation of photometrically classified supernovae into cosmological analyses, and to assess the impact of the additional uncertainty associated with this procedure on…

Cosmology and Nongalactic Astrophysics · Physics 2026-05-19 Marcos P. Freaza , Ribamar R. R. Reis

Ensemble methods are among the state-of-the-art predictive modeling approaches. Applied to modern big data, these methods often require a large number of sub-learners, where the complexity of each learner typically grows with the size of…

Machine Learning · Computer Science 2018-10-29 Amichai Painsky , Saharon Rosset

This paper considers properties of an optimization based sampler for targeting the posterior distribution when the likelihood is intractable and auxiliary statistics are used to summarize information in the data. Our reverse sampler…

Methodology · Statistics 2015-12-02 Jean-Jacques Forneron , Serena Ng

Cosmological parameter estimation is traditionally performed in the Bayesian context. By adopting an "agnostic" statistical point of view, we show the interest of confronting the Bayesian results to a frequentist approach based on…

Cosmology and Nongalactic Astrophysics · Physics 2016-07-12 S. Henrot-Versillé , O. Perdereau , S. Plaszczynski , B. Rouillé d'Orfeuil , M. Spinelli , M. Tristram

Estimating copulas with discrete marginal distributions is challenging, especially in high dimensions, because computing the likelihood contribution of each observation requires evaluating $2^{J}$ terms, with $J$ the number of discrete…

Methodology · Statistics 2018-11-12 D. Gunawan , M. -N. Tran , K. Suzuki , J. Dick , R. Kohn

Most cosmic shear analyses to date have relied on summary statistics (e.g. $\xi_+$ and $\xi_-$). These types of analyses are necessarily sub-optimal, as the use of summary statistics is lossy. In this paper, we forward-model the convergence…

Cosmology and Nongalactic Astrophysics · Physics 2022-04-29 Supranta Sarma Boruah , Eduardo Rozo , Pier Fiedorowicz

The statistical properties of cosmic structures are well known to be strong probes for cosmology. In particular, several studies tried to use the cosmic void counting number to obtain tight constrains on Dark Energy. In this paper we…

Cosmology and Nongalactic Astrophysics · Physics 2018-02-07 Jean-Michel Alimi , Paul de Fromont

Standard approaches to Bayesian parameter inference in large scale structure assume a Gaussian functional form (chi-squared form) for the likelihood. This assumption, in detail, cannot be correct. Likelihood free inferences such as…

Cosmology and Nongalactic Astrophysics · Physics 2017-06-21 ChangHoon Hahn , Mohammadjavad Vakili , Kilian Walsh , Andrew P. Hearin , David W. Hogg , Duncan Campbell

The fate of scientific hypotheses often relies on the ability of a computational model to explain the data, quantified in modern statistical approaches by the likelihood function. The log-likelihood is the key element for parameter…

Machine Learning · Computer Science 2021-01-27 Bas van Opheusden , Luigi Acerbi , Wei Ji Ma

This paper provides a review of Approximate Bayesian Computation (ABC) methods for carrying out Bayesian posterior inference, through the lens of density estimation. We describe several recent algorithms and make connection with traditional…

Computation · Statistics 2019-09-09 Clara Grazian , Yanan Fan

Statistical analysis of max-stable processes used to model spatial extremes has been limited by the difficulty in calculating the joint likelihood function. This precludes all standard likelihood-based approaches, including Bayesian…

Computation · Statistics 2011-12-14 Robert J. Erhardt , Richard L. Smith

As computer resources become increasingly limited, traditional statistical methods face challenges in analyzing massive data, especially in functional data analysis. To address this issue, subsampling offers a viable solution by…

Methodology · Statistics 2024-07-01 Jingxiang Pan , Xiaohui Yuan , Xiaohui Yuan

How might a smooth probability distribution be estimated, with accurately quantified uncertainty, from a limited amount of sampled data? Here we describe a field-theoretic approach that addresses this problem remarkably well in one…

Data Analysis, Statistics and Probability · Physics 2018-10-24 Wei-Chia Chen , Ammar Tareen , Justin B. Kinney