English
Related papers

Related papers: Ensemble methods for testing a global null

200 papers

How can researchers test for heterogeneity in the local structure of a network? In this paper, we present a framework that utilizes random sampling to give subgraphs which are then used in a goodness of fit test to test for heterogeneity.…

Methodology · Statistics 2015-12-04 Jonathan Tuke , Matthew Roughan

While statistical learning methods have proved powerful tools for predictive modeling, the black-box nature of the models they produce can severely limit their interpretability and the ability to conduct formal inference. However, the…

Machine Learning · Statistics 2016-08-30 Lucas Mentch , Giles Hooker

We develop a general statistical framework for the analysis and inference of large tree-structured data, with a focus on developing asymptotic goodness-of-fit tests. We first propose a consistent statistical model for binary trees, from…

Software fault prediction model are employed to optimize testing resource allocation by identifying fault-prone classes before testing phases. Several researchers' have validated the use of different classification techniques to develop…

Software Engineering · Computer Science 2017-04-17 Lov Kumar , Santanu Rath , Ashish Sureka

Incipient anomalies present milder symptoms compared to severe ones, and are more difficult to detect and diagnose due to their close resemblance to normal operating conditions. The lack of incipient anomaly examples in the training data…

Machine Learning · Computer Science 2020-08-21 Yingshui Tan , Baihong Jin , Qiushi Cui , Xiangyu Yue , Alberto Sangiovanni Vincentelli

In this paper a new class of uniformity tests is proposed. It is shown that those tests are applicable to the cases of any simple null hypothesis as well as for the composite null hypothesis of rectangular distributions on arbitrary…

Methodology · Statistics 2018-08-21 Bojana Milošević

Applied statistical problems often come with pre-specified groupings to predictors. It is natural to test for the presence of simultaneous group-wide signal for groups in isolation, or for multiple groups together. Classical tests for the…

Applications · Statistics 2015-11-25 Stephen Reid , Jonathan Taylor , Robert Tibshirani

Introduction. We investigate the generalization ability of models built on datasets containing a small number of subjects, recorded in single study protocols. Next, we propose and evaluate methods combining these datasets into a single,…

Machine Learning · Computer Science 2023-12-05 Gideon Vos , Kelly Trinh , Zoltan Sarnyai , Mostafa Rahimi Azghadi

The classical binary hypothesis testing problem is revisited. We notice that when one of the hypotheses is composite, there is an inherent difficulty in defining an optimality criterion that is both informative and well-justified. For…

Statistics Theory · Mathematics 2021-03-29 Michael Bell , Yuval Kochman

In this paper, we consider ensemble classifiers, that is, machine learning based classifiers that utilize a combination of scoring functions. We provide a framework for categorizing such classifiers, and we outline several ensemble…

Cryptography and Security · Computer Science 2021-03-24 Mark Stamp , Aniket Chandak , Gavin Wong , Allen Ye

High-dimensional logistic regression is widely used in analyzing data with binary outcomes. In this paper, global testing and large-scale multiple testing for the regression coefficients are considered in both single- and two-regression…

Methodology · Statistics 2020-11-23 Rong Ma , T. Tony Cai , Hongzhe Li

This paper introduces two new families of non-parametric tests of goodness-of-fit on the compact classical groups. One of them is a family of tests for the eigenvalue distribution induced by the uniform distribution, which is consistent…

Statistics Theory · Mathematics 2018-02-27 Amir Sepehri

Quality assessments of models in unsupervised learning and clustering verification in particular have been a long-standing problem in the machine learning research. The lack of robust and universally applicable cluster validity scores often…

Machine Learning · Statistics 2018-03-30 Luzie Helfmann , Johannes von Lindheim , Mattes Mollenhauer , Ralf Banisch

We consider the problem of testing a null hypothesis defined by equality and inequality constraints on a statistical parameter. Testing such hypotheses can be challenging because the number of relevant constraints may be on the same order…

Methodology · Statistics 2024-02-19 Nils Sturma , Mathias Drton , Dennis Leung

The scaling of Large Language Models (LLMs) currently faces significant challenges. Model assembly is widely considered a promising solution to break through these performance bottlenecks. However, current ensembling methods are primarily…

Machine Learning · Computer Science 2025-07-08 Yanxin Liu , Yunqi Zhang

Ensembles of artificial neural networks show improved generalization capabilities that outperform those of single networks. However, for aggregation to be effective, the individual networks must be as accurate and diverse as possible. An…

Artificial Intelligence · Computer Science 2007-05-23 P. M. Granitto , P. F. Verdes , H. A. Ceccatto

In this paper, a novel approach for the optimal combination of binary classifiers is proposed. The classifier combination problem is approached from a Game Theory perspective. The proposed framework of adapted weighted majority rules (WMR)…

Machine Learning · Computer Science 2013-02-05 Harris V. Georgiou , Michael E. Mavroforakis

A massive dataset often consists of a growing number of (potentially) heterogeneous sub-populations. This paper is concerned about testing various forms of heterogeneity arising from massive data. In a general nonparametric framework, a set…

Statistics Theory · Mathematics 2016-01-26 Junwei Lu , Guang Cheng , Han Liu

In recent years, multi-label classification problem has become a controversial issue. In this kind of classification, each sample is associated with a set of class labels. Ensemble approaches are supervised learning algorithms in which an…

Machine Learning · Computer Science 2018-01-09 Amirreza Mahdavi-Shahri , Mahboobeh Houshmand , Mahdi Yaghoobi , Mehrdad Jalali

Finite mixtures of multivariate normal distributions have been widely used in empirical applications in diverse fields such as statistical genetics and statistical finance. Testing the number of components in multivariate normal mixture…

Statistics Theory · Mathematics 2019-02-11 Hiroyuki Kasahara , Katsumi Shimotsu