English
Related papers

Related papers: Catoni-style confidence sequences for heavy-tailed…

200 papers

A confidence sequence (CS) is an anytime-valid sequential inference primitive which produces an adapted sequence of sets for a predictable parameter sequence with a time-uniform coverage guarantee. This work constructs a non-parametric…

Machine Learning · Statistics 2022-10-21 Paul Mineiro

We consider a discrete time stochastic model with infinite variance and study the mean estimation problem as in Wang and Ramdas (2023). We refine the Catoni-type confidence sequence (abbr. CS) and use an idea of Bhatt et al. (2022) to…

Statistics Theory · Mathematics 2024-09-10 Chengfu Wei , Jordan Stoyanov , Yiming Chen , Zijun Chen

In this paper, we provide an extension of confidence sequences for settings where the variance of the data-generating distribution does not exist or is infinite. Confidence sequences furnish confidence intervals that are valid at arbitrary…

Statistics Theory · Mathematics 2022-08-08 Sujay Bhatt , Guanhua Fang , Ping Li , Gennady Samorodnitsky

A confidence sequence (CS) is a sequence of confidence sets that contains a target parameter of an underlying stochastic process at any time step with high probability. This paper proposes a new approach to constructing CSs for means of…

Methodology · Statistics 2024-08-22 J. Jon Ryu , Gregory W. Wornell

Confidence sequences are confidence intervals that can be sequentially tracked, and are valid at arbitrary data-dependent stopping times. This paper presents confidence sequences for a univariate mean of an unknown distribution with a known…

Statistics Theory · Mathematics 2023-02-09 Hongjian Wang , Aaditya Ramdas

We derive a new closed-form variance-adaptive confidence sequence (CS) for estimating the average conditional mean of a sequence of bounded random variables. Empirically, it yields the tightest closed-form CS we have found for tracking…

Statistics Theory · Mathematics 2025-12-25 Ben Chugg , Aaditya Ramdas

We study sequential mean estimation in $\mathbb{R}^d$. In particular, we derive time-uniform confidence spheres -- confidence sphere sequences (CSSs) -- which contain the mean of random vectors with high probability simultaneously across…

Statistics Theory · Mathematics 2025-05-16 Ben Chugg , Hongjian Wang , Aaditya Ramdas

Many practical tasks involve sampling sequentially without replacement (WoR) from a finite population of size $N$, in an attempt to estimate some parameter $\theta^\star$. Accurately quantifying uncertainty throughout this process is a…

Methodology · Statistics 2021-01-11 Ian Waudby-Smith , Aaditya Ramdas

A powerful robust mean estimator introduced by Catoni (2012) allows for mean estimation of heavy-tailed data while achieving the performance characteristics of classical mean estimator for sub-Gaussian data. While Catoni's framework has…

Statistics Theory · Mathematics 2026-02-16 Zhijun Cai , Xiang Li , Lihu Xu

We survey some of the recent advances in mean estimation and regression function estimation. In particular, we describe sub-Gaussian mean estimators for possibly heavy-tailed data both in the univariate and multivariate settings. We focus…

Statistics Theory · Mathematics 2019-06-12 Gabor Lugosi , Shahar Mendelson

Confidence intervals based on the central limit theorem (CLT) are a cornerstone of classical statistics. Despite being only asymptotically valid, they are ubiquitous because they permit statistical inference under weak assumptions and can…

Statistics Theory · Mathematics 2024-03-15 Ian Waudby-Smith , David Arbour , Ritwik Sinha , Edward H. Kennedy , Aaditya Ramdas

In the real world, the class of a time series is usually labeled at the final time, but many applications require to classify time series at every time point. e.g. the outcome of a critical patient is only determined at the end, but he…

Machine Learning · Computer Science 2022-08-16 Chenxi Sun , Moxian Song , Derun Can , Baofeng Zhang , Shenda Hong , Hongyan Li

Confidence sequences are collections of confidence regions that simultaneously cover the true parameter for every sample size at a prescribed confidence level. Tightening these sequences is of practical interest and can be achieved by…

Methodology · Statistics 2026-05-11 Stefano Cortinovis , Valentin Kilian , François Caron

Constructing nonasymptotic confidence intervals (CIs) for the mean of a univariate distribution from independent and identically distributed (i.i.d.) observations is a fundamental task in statistics. For bounded observations, a classical…

Statistics Theory · Mathematics 2023-11-28 Shubhanshu Shekhar , Aaditya Ramdas

This paper derives confidence intervals (CI) and time-uniform confidence sequences (CS) for the classical problem of estimating an unknown mean from bounded observations. We present a general approach for deriving concentration bounds, that…

Statistics Theory · Mathematics 2022-08-29 Ian Waudby-Smith , Aaditya Ramdas

Empirical-likelihood-based confidence intervals for a mean were introduced by Owen [Biometrika 75 (1988) 237-249], where at least a finite second moment is required. This excludes some important distributions, for example, those in the…

Statistics Theory · Mathematics 2007-06-13 Liang Peng

In most prediction and estimation situations, scientists consider various statistical models for the same problem, and naturally want to select amongst the best. Hansen et al. (2011) provide a powerful solution to this problem by the…

Methodology · Statistics 2026-01-23 Sebastian Arnold , Georgios Gavrilopoulos , Benedikt Schulz , Johanna Ziegel

Selecting the top-$m$ variables with the $m$ largest population parameters from a larger set of candidates is a fundamental problem in statistics. In this paper, we propose a novel methodology called Sequential Correct Screening (SCS),…

Methodology · Statistics 2025-08-21 Masaki Toyoda , Yoshimasa Uematsu

Confidence intervals for the means of multiple normal populations are often based on a hierarchical normal model. While commonly used interval procedures based on such a model have the nominal coverage rate on average across a population of…

Methodology · Statistics 2016-12-28 Chaoyu Yu , Peter D. Hoff

Consider two forecasters, each making a single prediction for a sequence of events over time. We ask a relatively basic question: how might we compare these forecasters, either online or post-hoc, while avoiding unverifiable assumptions on…

Methodology · Statistics 2023-11-10 Yo Joong Choe , Aaditya Ramdas
‹ Prev 1 2 3 10 Next ›