English
Related papers

Related papers: Should unfolded histograms be used to test hypothe…

200 papers

Shape-valued data are of interest in applied sciences, particularly in medical imaging. In this paper, inspired by a specific medical imaging example, we introduce a hypothesis testing method via the smooth Euler characteristic transform to…

Methodology · Statistics 2023-08-15 Jinyu Wang , Kun Meng , Fenghai Duan

Machine learning has enabled differential cross section measurements that are not discretized. Going beyond the traditional histogram-based paradigm, these unbinned unfolding methods are rapidly being integrated into experimental workflows.…

High Energy Physics - Phenomenology · Physics 2025-05-28 Ryan Milton , Vinicius Mikuni , Trevin Lee , Miguel Arratia , Tanvi Wamorkar , Benjamin Nachman

In high-energy physics (HEP), both the exclusion and discovery of new theories depend not only on the acquisition of high-quality experimental data but also on the rigorous application of statistical methods. These methods provide…

High Energy Physics - Phenomenology · Physics 2024-11-04 Alejandro Segura , Angie Catalina Parra

We consider the high energy physics unfolding problem where the goal is to estimate the spectrum of elementary particles given observations distorted by the limited resolution of a particle detector. This important statistical inverse…

Applications · Statistics 2015-11-18 Mikael Kuusela , Victor M. Panaretos

Modern statisticians are often presented with hundreds or thousands of hypothesis testing problems to evaluate at the same time, generated from new scientific technologies such as microarrays, medical and satellite imaging devices, or flow…

Applications · Statistics 2008-12-18 Bradley Efron

A frequently faced task in experimental physics is to measure the probability distribution of some quantity. Often this quantity to be measured is smeared by a non-ideal detector response or by some physical process. The procedure of…

Statistics Theory · Mathematics 2014-04-11 Andras Laszlo

When reading peer-reviewed scientific literature describing any analysis of empirical data, it is natural and correct to proceed with the underlying assumption that experiments have made good faith efforts to ensure that their analyses…

Data Analysis, Statistics and Probability · Physics 2012-09-13 S. Towers

The high energy physics unfolding problem is an important statistical inverse problem in data analysis at the Large Hadron Collider (LHC) at CERN. The goal of unfolding is to make nonparametric inferences about a particle spectrum from…

Applications · Statistics 2017-06-09 Mikael Kuusela , Philip B. Stark

The use of machine learning algorithms is an attractive way to produce very fast detector simulations for scattering reactions that can otherwise be computationally expensive. Here we develop a factorised approach where we deal with each…

Data Analysis, Statistics and Probability · Physics 2022-07-26 D. Darulis , R. Tyson , D. G. Ireland , D. I. Glazier , B. McKinnon , P. Pauli

Our predictions for particle physics processes are realized in a chain of complex simulators. They allow us to generate high-fidelity simulated data, but they are not well-suited for inference on the theory parameters with observed data. We…

High Energy Physics - Phenomenology · Physics 2020-11-03 Johann Brehmer , Kyle Cranmer

Hypothesis testing in high dimensional data is a notoriously difficult problem without direct access to competing models' likelihood functions. This paper argues that statistical divergences can be used to quantify the difference between…

Data Analysis, Statistics and Probability · Physics 2024-08-02 Jeremy J. H. Wilkinson , Christopher G. Lester

Emerging applications of sensor networks for detection sometimes suggest that classical problems ought be revisited under new assumptions. This is the case of binary hypothesis testing with independent - but not necessarily identically…

Information Theory · Computer Science 2019-03-27 Stefano Marano , Peter Willett

The Bayesian Block algorithm, originally developed for applications in astronomy, can be used to improve the binning of histograms in high energy physics. The visual improvement can be dramatic, as shown here with two simple examples. More…

Data Analysis, Statistics and Probability · Physics 2019-06-14 Brian Pollack , Saptaparna Bhattacharya , Michael Schmitt

Random geometric graphs are widely used in modeling geometry and dependence structure in networks. In a random geometric graph, nodes are independently generated from some probability distribution $F$ over a metric space, and edges link…

Methodology · Statistics 2025-10-17 Mingao Yuan

Direct searches for new particles at colliders have traditionally been factorized into model proposals by theorists and model testing by experimentalists. With the recent advent of machine learning methods that allow for the simultaneous…

High Energy Physics - Phenomenology · Physics 2021-11-10 Patrick Komiske , W. Patrick McCormack , Benjamin Nachman

We develop, discuss, and compare several inference techniques to constrain theory parameters in collider experiments. By harnessing the latent-space structure of particle physics processes, we extract extra information from the simulator.…

High Energy Physics - Phenomenology · Physics 2018-09-19 Johann Brehmer , Kyle Cranmer , Gilles Louppe , Juan Pavez

Several approaches to testing the hypothesis that two histograms are drawn from the same distribution are investigated. We note that single-sample continuous distribution tests may be adapted to this two-sample grouped data situation. The…

Data Analysis, Statistics and Probability · Physics 2008-04-03 Frank C. Porter

Statistical hypothesis testing serves as statistical evidence for scientific innovation. However, if the reported results are intentionally biased, hypothesis testing no longer controls the rate of false discovery. In particular, we study…

Methodology · Statistics 2018-10-12 Junpei Komiyama , Takanori Maehara

We present a universal method to include residual un-modeled background shape uncertainties in likelihood based statistical tests for high energy physics and astroparticle physics. This approach provides a simple and natural protection…

Data Analysis, Statistics and Probability · Physics 2017-05-10 Nadav Priel , Ludwig Rauch , Hagar Landsman , Alessandro Manfredini , Ranny Budnik

We study a generalization of the classical hidden clique problem to graphs with real-valued edge weights. Formally, we define a hypothesis testing problem. Under the null hypothesis, edges of a complete graph on $n$ vertices are associated…