English
Related papers

Related papers: Should unfolded histograms be used to test hypothe…

200 papers

We present a new way of performing hypothesis tests on scattering data, by means of a perturbatively calculable classifier. This classifier exploits the "history tree" of how the measured data point might have evolved out of any simpler…

High Energy Physics - Phenomenology · Physics 2022-10-12 Stefan Prestel , Michael Spannowsky

This paper considers the problem of testing whether there exists a non-negative solution to a possibly under-determined system of linear equations with known coefficients. This hypothesis testing problem arises naturally in a number of…

Econometrics · Economics 2021-09-16 Zheng Fang , Andres Santos , Azeem M. Shaikh , Alexander Torgovitsky

We propose a rigorous and effective way to compare experimental and theoretical histograms, incorporating the different sources of statistical and systematic uncertainties. This is a useful tool to extract as much information as possible…

High Energy Physics - Phenomenology · Physics 2015-03-19 M. E. Cabrera , J. A. Casas , V. A. Mitsou , R. Ruiz de Austri , J. Terron

A popular approach to significance testing proposes to decide whether the given hypothesized statistical model is likely to be true (or false). Statistical decision theory provides a basis for this approach by requiring every significance…

Methodology · Statistics 2013-01-08 William Perkins , Mark Tygert , Rachel Ward

A method is presented for performing joint analyses of cosmological datasets, in which the weight assigned to each dataset is determined directly by it own statistical properties. The weights are considered in a Bayesian context as a set of…

Astrophysics · Physics 2009-11-07 M. P. Hobson , S. L. Bridle , O. Lahav

Topological models of empirical and formal inquiry are increasingly prevalent. They have emerged in such diverse fields as domain theory [1, 16], formal learning theory [18], epistemology and philosophy of science [10, 15, 8, 9, 2],…

Machine Learning · Computer Science 2017-08-01 Konstantin Genin , Kevin T. Kelly

We are interested in testing general linear hypotheses in a high-dimensional multivariate linear regression model. The framework includes many well-studied problems such as two-sample tests for equality of population means, MANOVA and…

Methodology · Statistics 2018-10-05 Haoran Li , Alexander Aue , Debashis Paul

High complexity models are notorious in machine learning for overfitting, a phenomenon in which models well represent data but fail to generalize an underlying data generating process. A typical procedure for circumventing overfitting…

Machine Learning · Statistics 2025-03-11 James Schmidt

A method for correcting smearing effects using machine learning technique is presented. Compared to the standard deconvolution approaches in high energy particle physics, the method can use more than one reconstructed variable to predict…

Data Analysis, Statistics and Probability · Physics 2020-01-30 Bora Işıldak , Alper Hayreter , Aidan R. Wiederhold

Hypothesis testing in singular statistical models is often regarded as inherently problematic due to non-identifiability and degeneracy of the Fisher information. We show that the fundamental obstruction to testing in such models is not…

Statistics Theory · Mathematics 2026-03-02 Sean Plummer

Two modifications of the chi square test for comparing usual(unweighted) and weighted histograms and two weighted histograms are proposed. Numerical examples illustrate an application of the tests for the histograms with different…

Data Analysis, Statistics and Probability · Physics 2011-11-09 N. D. Gagunashvili

This paper proposes a framework for semantic hypothesis testing tailored to imaging inverse problems. Modern imaging methods struggle to support hypothesis testing, a core component of the scientific method that is essential for the…

Machine Learning · Statistics 2025-05-29 Yiming Xi , Konstantinos Zygalakis , Marcelo Pereyra

This paper addresses patient heterogeneity associated with prediction problems in biomedical applications. We propose a systematic hypothesis testing approach to determine the existence of patient subgroup structure and the number of…

Methodology · Statistics 2021-01-08 Xu Gao , Weining Shen , Jing Ning , Ziding Feng , Jianhua Hu

The problem of large-scale simultaneous hypothesis testing is re-visited. Bagging and subagging procedures are put forth with the purpose of improving the discovery power of the tests. The procedures are implemented in both simulated and…

Methodology · Statistics 2007-05-23 Dimitris N. Politis

Hypothesis testing is a statistical inference approach used to determine whether data supports a specific hypothesis. An important type is the two-sample test, which evaluates whether two sets of data points are from identical…

Machine Learning · Computer Science 2025-01-08 Weizhi Li , Visar Berisha , Gautam Dasarathy

Hypothesis testing for graphs has been an important tool in applied research fields for more than two decades, and still remains a challenging problem as one often needs to draw inference from few replicates of large graphs. Recent studies…

Machine Learning · Statistics 2018-12-03 Debarghya Ghoshdastidar , Ulrike von Luxburg

Usually one compares the accuracy of two competing classifiers via null hypothesis significance tests (nhst). Yet the nhst tests suffer from important shortcomings, which can be overcome by switching to Bayesian hypothesis testing. We…

Machine Learning · Computer Science 2016-11-23 Giorgio Corani , Alessio Benavoli , Janez Demšar , Francesca Mangili , Marco Zaffalon

The unfolding of detector effects is crucial for the comparison of data to theory predictions. While traditional methods are limited to representing the data in a low number of dimensions, machine learning has enabled new unfolding…

High Energy Physics - Phenomenology · Physics 2024-01-12 Mathias Backes , Anja Butter , Monica Dunford , Bogdan Malaescu

While powerful methods have been developed for high-dimensional hypothesis testing assuming orthogonal parameters, current approaches struggle to generalize to the more common non-orthogonal case. We propose Stable Distillation (SD), a…

Methodology · Statistics 2025-01-10 Ryan Christ , Ira Hall , David Steinsaltz

Hypothesis testing and other statistical inference procedures are most efficient when a reliable low-dimensional parametric family can be specified. We propose a method that learns such a family when one exists but its form is not known a…

Methodology · Statistics 2017-11-29 William Fithian , Daniel Ting