English
Related papers

Related papers: Power Analysis for Prediction-Powered Inference

200 papers

Recent applications of machine learning (ML) reveal a noticeable shift from its use for predictive modeling in the sense of a data-driven construction of models mainly used for the purpose of prediction (of ground-truth facts) to its use…

Machine Learning · Computer Science 2021-12-16 Eyke Hüllermeier

We study the performance of classical and quantum machine learning (ML) models in predicting outcomes of physical experiments. The experiments depend on an input parameter $x$ and involve execution of a (possibly unknown) quantum process…

Quantum Physics · Physics 2021-05-19 Hsin-Yuan Huang , Richard Kueng , John Preskill

Incomplete data are common in practical applications. Most predictive machine learning models do not handle missing values so they require some preprocessing. Although many algorithms are used for data imputation, we do not understand the…

Machine Learning · Statistics 2020-07-07 Katarzyna Woźnica , Przemysław Biecek

Combining information from multiple samples is often needed in biomedical and economic studies, but the differences between these samples must be appropriately taken into account in the analysis of the combined data. We study estimation for…

Methodology · Statistics 2018-08-14 Heng Shu , Zhiqiang Tan

A fundamental task in the analysis of datasets with many variables is screening for associations. This can be cast as a multiple testing task, where the objective is achieving high detection power while controlling type I error. We consider…

Methodology · Statistics 2021-09-01 Nikolaos Ignatiadis , Wolfgang Huber

The rapid proliferation of high-quality synthetic data -- generated by advanced AI models or collected as auxiliary data from related tasks -- presents both opportunities and challenges for statistical inference. This paper introduces a…

Methodology · Statistics 2026-02-19 Meshi Bashari , Yonghoon Lee , Roy Maor Lotan , Edgar Dobriban , Yaniv Romano

Bernstein fits implemented into R allow another route for Kruskal-Wallis power-study tool development. Monte-Carlo Kruskal-Wallis power studies were compared with measured power, with Monte-Carlo ANOVA equivalent and with an analytical…

Power-law scaling, a central concept in critical phenomena, is found to be useful in deep learning, where optimized test errors on handwritten digit examples converge as a power-law to zero with database size. For rapid decision making with…

Machine Learning · Computer Science 2022-11-17 Yuval Meir , Shira Sardi , Shiri Hodassman , Karin Kisos , Itamar Ben-Noam , Amir Goldental , Ido Kanter

Batch effects are pervasive in biomedical studies. One approach to address the batch effects is repeatedly measuring a subset of samples in each batch. These remeasured samples are used to estimate and correct the batch effects. However,…

Methodology · Statistics 2023-11-07 Hanxuan Ye , Xianyang Zhang , Chen Wang , Ellen L. Goode , Jun Chen

When evaluating the performance of a model for individualised risk prediction, the sample size needs to be large enough to precisely estimate the performance measures of interest. Current sample size guidance is based on precisely…

Research often necessitates of samples, yet obtaining large enough samples is not always possible. When it is, the researcher may use one of two methods for deciding upon the required sample size: rules-of-thumb, quick yet uncertain, and…

Methodology · Statistics 2016-04-08 Jose D. Perezgonzalez

In the world of big data, large but costly to label datasets dominate many fields. Active learning, a semi-supervised alternative to the standard PAC-learning model, was introduced to explore whether adaptive labeling could learn concepts…

Machine Learning · Computer Science 2020-06-02 Max Hopkins , Daniel M. Kane , Shachar Lovett

In clinical settings, we often face the challenge of building prediction models based on small observational data sets. For example, such a data set might be from a medical center in a multi-center study. Differences between centers might…

Genome-wide association analysis has generated much discussion about how to preserve power to detect signals despite the detrimental effect of multiple testing on power. We develop a weighted multiple testing procedure that facilitates the…

Statistics Theory · Mathematics 2007-06-13 Kathryn Roeder , Bernie Devlin , Larry Wasserman

Data-Augmentation (DA) is known to improve performance across tasks and datasets. We propose a method to theoretically analyze the effect of DA and study questions such as: how many augmented samples are needed to correctly estimate the…

Machine Learning · Computer Science 2022-02-18 Randall Balestriero , Ishan Misra , Yann LeCun

Microgrids and, in general, active distribution networks require ultra-short-term prediction, i.e., for sub-second time scales, for specific control decisions. Conventional forecasting methodologies are not effective at such time scales. To…

Systems and Control · Electrical Eng. & Systems 2023-09-20 Plouton Grammatikos , Fabrizio Sossan , Jean-Yves Le Boudec , Mario Paolone

The increasing deployment of artificial intelligence (AI) in clinical settings challenges foundational assumptions underlying traditional frameworks of medical evidence. Classical statistical approaches, centered on randomized controlled…

Methodology · Statistics 2026-01-07 Richik Chakraborty

The improvement of economic policymaking presents an opportunity for broad societal benefit, a notion that has inspired research towards AI-driven policymaking tools. AI policymaking holds the potential to surpass human performance through…

Artificial Intelligence · Computer Science 2024-10-14 Henry Gasztowtt , Benjamin Smith , Vincent Zhu , Qinxun Bai , Edwin Zhang

Inference-time sampling can elicit strong reasoning abilities from language models without additional training. Existing power-sampling methods do so by sharpening the distribution over full generated outputs, favoring completions that are…

Machine Learning · Computer Science 2026-05-28 Aleksei Arzhantsev , Otmane Sakhi , Nicolas Chopin

Parametric hypothesis testing associated with two independent samples arises frequently in several applications in biology, medical sciences, epidemiology, reliability and many more. In this paper, we propose robust Wald-type tests for…

Methodology · Statistics 2019-05-09 Abhik Ghosh , Nirian Martin , Ayanendranath Basu , Leandro Pardo