English
Related papers

Related papers: Dealing with multiple testing: To adjust or not to…

200 papers

Consider the multiple testing problem of testing k null hypotheses, where the unknown family of distributions is assumed to satisfy a certain monotonicity assumption. Attention is restricted to procedures that control the familywise error…

Statistics Theory · Mathematics 2007-06-13 E. L. Lehmann , Joseph P. Romano , Juliet Popper Shaffer

Motivated by the practice of exploratory research, we formulate an approach to multiple testing that reverses the conventional roles of the user and the multiple testing procedure. Traditionally, the user chooses the error criterion, and…

Methodology · Statistics 2013-10-03 Jelle J. Goeman , Aldo Solari

This paper introduces and defends an account of model-based science that I dub model pluralism. I argue that despite a growing awareness in the philosophy of science literature of the multiplicity, diversity, and richness of models and…

History and Philosophy of Physics · Physics 2019-10-01 Walter Veit

The field of psychological sciences has been grappling with the replicability crisis. Various issues have been identified as potential sources of this problem. We bring to light a potential source that has largely been overlooked and…

Methodology · Statistics 2025-04-28 Yoav Zeevi , Sofi Astashenko , Liad Mudrik , Yoav Benjamini

As a common step in refining their scientific inquiry, investigators are often interested in performing some screening of a collection of given statistical hypotheses. For example, they may wish to determine whether any one of several…

Methodology · Statistics 2022-03-04 Adam Elder , Marco Carone , Peter Gilbert , Alex Luedtke

Dynamic multiobjective optimisation has gained increasing attention in recent years. Test problems are of great importance in order to facilitate the development of advanced algorithms that can handle dynamic environments well. However,…

Neural and Evolutionary Computing · Computer Science 2019-03-07 Shouyong Jiang , Marcus Kaiser , Shengxiang Yang , Stefanos Kollias , Natalio Krasnogor

In many applied sciences a popular analysis strategy for high-dimensional data is to fit many multivariate generalized linear models in parallel. This paper presents a novel approach to address the resulting multiple testing problem by…

Statistics Theory · Mathematics 2024-10-07 Riccardo De Santis , Jelle J. Goeman , Samuel Davenport , Jesse Hemerik , Livio Finos

In recent years, the interest in developing adaptive solutions for online testing has grown significantly in the industry. While the advances related to this relative new technology have been developed in multiple domains, it lacks in the…

Methodology · Statistics 2022-03-16 Da Xu , Bo Yang

The growing need for trustworthy machine learning has led to the blossom of interpretability research. Numerous explanation methods have been developed to serve this purpose. However, these methods are deficiently and inappropriately…

Machine Learning · Computer Science 2022-03-29 Yipei Wang , Xiaoqian Wang

Possible models of modified gravity are being extensively studied now, with most phenomenological motivations coming from puzzles and tensions in cosmology due to a natural desire to better fit the known and newly coming data. At the same…

General Relativity and Quantum Cosmology · Physics 2024-02-06 Alexey Golovnev , Maria-Jose Guzman

Choice overload - in which larger choice sets are detrimental to a chooser's well-being - is potentially of great importance in the design of economic policy. Yet the current evidence on its prevalence is inconclusive. We argue that…

General Economics · Economics 2025-06-27 Mark Dean , Dilip Ravindran , Jörg Stoye

As software systems continue to grow in complexity, testing has become a fundamental part of ensuring the quality and reliability of software products. Yet, software testing is still often perceived, both in industry and academia, as a…

Software Engineering · Computer Science 2025-07-29 Davi Gama Hardman , Cesar França , Brody Stuart-Verner , Ronnie de Souza Santos

Multiple imputation is a straightforward method for handling missing data in a principled fashion. This paper presents an overview of multiple imputation, including important theoretical results and their practical implications for…

Methodology · Statistics 2018-01-15 Jared S. Murray

Established frameworks to understand problems with reproducibility in science begin with the relationship between our understanding of the prior probability of a claim and the statistical certainty that should be demanded of it, and explore…

Other Statistics · Statistics 2022-05-30 Maria Chikina , Wesley Pegden

Some large scale inference problems are considered based on using the relative belief ratio as a measure of statistical evidence. This approach is applied to the multiple testing problem. A particular application of this is concerned with…

Statistics Theory · Mathematics 2016-09-22 Michael Evans , Jabed Tomal

The problem of identifying to which of a given set of classes objects belong is ubiquitous, occurring in many research domains and application areas, including medical diagnosis, financial decision making, online commerce, and national…

Machine Learning · Computer Science 2024-09-20 David J. Hand , Peter Christen , Sumayya Ziyad

In this essay, we provide an overview of methodological considerations necessary to lay out the foundation for our PhD research on uncertainty and risk-aware adaptation.

Software Engineering · Computer Science 2025-11-11 Sara Mahdavi Hezavehi , Danny Weyns , Paris Avgeriou

Multilingual language models often perform unevenly across different languages due to limited generalization capabilities for some languages. This issue is significant because of the growing interest in making universal language models that…

Computation and Language · Computer Science 2024-10-11 Gürkan Soykan , Gözde Gül Şahin

Context: Research software is essential for developing advanced tools and models to solve complex research problems and drive innovation across domains. Therefore, it is essential to ensure its correctness. Software testing plays a vital…

Software Engineering · Computer Science 2025-01-30 Nasir U. Eisty , Upulee Kanewala , Jeffrey C. Carver

Validation is a key challenge in the search for safe autonomy. Simulations are often either too simple to provide robust validation, or too complex to tractably compute. Therefore, approximate validation methods are needed to tractably find…

Robotics · Computer Science 2020-04-10 Mark Koren , Anthony Corso , Mykel J. Kochenderfer