English
Related papers

Related papers: Improving Power by Conditioning on Less in Post-se…

200 papers

We study two nonparametric tests of the hypothesis that a sequence of independent observations is identically distributed against the alternative that at a single change point the distribution changes. The tests are based on the Cramer-von…

Statistics Theory · Mathematics 2020-10-15 Rasmus Erlemann , Richard Lockhart , Rihan Yao

Changepoint localization is the problem of estimating the index at which a change occurred in the data generating distribution of an ordered list of data, or declaring that no change occurred. We present the broadly applicable MCP…

Statistics Theory · Mathematics 2026-02-20 Sanjit Dandapanthula , Aaditya Ramdas

In this paper, we study statistical inference of change-points (CPs) in multi-dimensional sequence. In CP detection from a multi-dimensional sequence, it is often desirable not only to detect the location, but also to identify the subset of…

Machine Learning · Statistics 2021-10-19 Ryota Sugiyama , Hiroki Toda , Vo Nguyen Le Duy , Yu Inatsu , Ichiro Takeuchi

A reliable deep learning system should be able to accurately express its confidence with respect to its predictions, a quality known as calibration. One of the most effective ways to produce reliable confidence estimates with a pre-trained…

Machine Learning · Computer Science 2024-10-10 Thomas P. Zollo , Zhun Deng , Jake C. Snell , Toniann Pitassi , Richard Zemel

It's better to say "I can't answer" than to answer incorrectly. This selective prediction ability is crucial for NLP systems to be reliably deployed in real-world applications. Prior work has shown that existing selective prediction…

Computation and Language · Computer Science 2022-04-08 Neeraj Varshney , Swaroop Mishra , Chitta Baral

We introduce Preconditioned Monte Carlo (PMC), a novel Monte Carlo method for Bayesian inference that facilitates efficient sampling of probability distributions with non-trivial geometry. PMC utilises a Normalising Flow (NF) in order to…

Instrumentation and Methods for Astrophysics · Physics 2022-08-24 Minas Karamanis , Florian Beutler , John A. Peacock , David Nabergoj , Uros Seljak

The power of multiple testing procedures can be increased by using weighted p-values (Genovese, Roeder and Wasserman 2005). We derive the optimal weights and we show that the power is remarkably robust to misspecification of these weights.…

Statistics Theory · Mathematics 2007-06-13 Larry Wasserman , Kathryn Roeder

Monte Carlo (MC) sampling algorithms are an extremely widely-used technique to estimate expectations of functions f(x), especially in high dimensions. Control variates are a very powerful technique to reduce the error of such estimates, but…

Machine Learning · Statistics 2016-06-08 Brendan D. Tracey , David H. Wolpert

This paper describes how to specify probability models for data analysis via a backward induction procedure. The new approach yields coherent, prior-free uncertainty assessment. After presenting some intuition-building examples, the new…

Methodology · Statistics 2015-02-24 P. Richard Hahn

Permutation tests are amongst the most commonly used statistical tools in modern genomic research, a process by which p-values are attached to a test statistic by randomly permuting the sample or gene labels. Yet permutation p-values…

Applications · Statistics 2016-03-21 Belinda Phipson , Gordon K. Smyth

We propose a frequentist testing procedure that maintains a defined coverage and is optimal in the sense that it gives maximal power to detect deviations from a null hypothesis when the alternative to the null hypothesis is sampled from a…

Applications · Statistics 2020-07-07 Christian Bartels , Johanna Mielke , Ekkehard Glimm

It is conventionally believed that a permutation test should ideally use all permutations. If this is computationally unaffordable, it is believed one should use the largest affordable Monte Carlo sample or (algebraic) subgroup of…

Statistics Theory · Mathematics 2023-11-27 Nick W. Koning

We consider linear transformation models applied to right censored survival data with a change-point based on a covariate threshold. We establish consistency and weak convergence of the nonparametric maximum lieklihood estimators. The…

Statistics Theory · Mathematics 2007-06-13 Michael R. Kosorok , Rui Song

Many economic panel and dynamic models, such as rational behavior and Euler equations, imply that the parameters of interest are identified by conditional moment restrictions. We introduce a novel inference method without any prior…

Econometrics · Economics 2024-11-01 Xiaohong Chen , Sokbae Lee , Myung Hwan Seo , Myunghyun Song

High statistical precision is critical for Monte Carlo (MC) samples in high energy physics and is degraded by negatively weighted events. This paper investigates a procedure to learn the relationship between the negative and positive weight…

High Energy Physics - Experiment · Physics 2026-01-15 Christopher Palmer , Braden Kronheim

Prediction-powered inference (PPI) is a method that improves statistical estimates based on limited human-labeled data. PPI achieves this by combining small amounts of human-labeled data with larger amounts of data labeled by a reasonably…

Machine Learning · Computer Science 2024-12-05 Adam Fisch , Joshua Maynez , R. Alex Hofer , Bhuwan Dhingra , Amir Globerson , William W. Cohen

After selection with the Group LASSO (or generalized variants such as the overlapping, sparse, or standardized Group LASSO), inference for the selected parameters is unreliable in the absence of adjustments for selection bias. In the…

Methodology · Statistics 2022-08-16 Snigdha Panigrahi , Peter W. MacDonald , Daniel Kessler

We study tools for inference conditioned on model selection events that are defined by the generalized lasso regularization path. The generalized lasso estimate is given by the solution of a penalized least squares regression problem, where…

Methodology · Statistics 2016-06-14 Sangwon Hyun , Max G'Sell , Ryan J. Tibshirani

Model selection/optimization in conformal inference is challenging, since it may break the exchangeability between labeled and unlabeled data. We study this problem in the context of conformal selection, which uses conformal p-values to…

Methodology · Statistics 2024-11-28 Tian Bai , Ying Jin

While Bayesian methods are praised for their ability to incorporate useful prior knowledge, in practice, convenient priors that allow for computationally cheap or tractable inference are commonly used. In this paper, we investigate the…

Machine Learning · Statistics 2017-07-14 Willie Neiswanger , Eric Xing