English
Related papers

Related papers: Sample-constrained partial identification with app…

200 papers

Adaptive experiment designs can dramatically improve statistical efficiency in randomized trials, but they also complicate statistical inference. For example, it is now well known that the sample mean is biased in adaptive trials.…

Machine Learning · Statistics 2021-02-16 Vitor Hadad , David A. Hirshberg , Ruohan Zhan , Stefan Wager , Susan Athey

We revisit empirical Bayes discrimination detection, focusing on uncertainty arising from both partial identification and sampling variability. While prior work has mostly focused on partial identification, we find that some empirical…

Econometrics · Economics 2025-08-19 Jiaying Gu , Nikolaos Ignatiadis , Azeem M. Shaikh

In analyzing big data for finite population inference, it is critical to adjust for the selection bias in the big data. In this paper, we propose two methods of reducing the selection bias associated with the big data sample. The first…

Methodology · Statistics 2019-01-08 Jae Kwang Kim , Zhonglei Wang

In studies involving lifetimes, observed survival times are frequently censored and possibly subject to biased sampling. In this paper, we model survival times under biased sampling (a.k.a., biased survival data) by a semi-parametric model,…

Statistics Theory · Mathematics 2007-06-13 Jiayang Sun , Bin Wang

We consider the high-dimensional discriminant analysis problem. For this problem, different methods have been proposed and justified by establishing exact convergence rates for the classification risk, as well as the l2 convergence results…

Machine Learning · Statistics 2013-06-28 Mladen Kolar , Han Liu

We develop minimax optimal risk bounds for the general learning task consisting in predicting as well as the best function in a reference set $\mathcal{G}$ up to the smallest possible additive term, called the convergence rate. When the…

Statistics Theory · Mathematics 2009-09-09 Jean-Yves Audibert

In many modern statistical problems, the limited available data must be used both to develop the hypotheses to test, and to test these hypotheses-that is, both for exploratory and confirmatory data analysis. Reusing the same dataset for…

Methodology · Statistics 2023-07-24 Youngjoo Yun , Rina Foygel Barber

We consider clinical trials in which an experimental treatment is compared with a control in pre-specified patient subpopulations. In such settings, adaptive enrichment designs allow the enrolled population to be modified at an interim…

Methodology · Statistics 2026-03-17 Enyu Li , Nigel Stallard , Ekkehard Glimm , Dominic Magirr , Peter K. Kimani

In the pivotal variable selection problem, we derive the exact non-asymptotic minimax selector over the class of all $s$-sparse vectors, which is also the Bayes selector with respect to the uniform prior. While this optimal selector is, in…

Statistics Theory · Mathematics 2022-01-03 Cristina Butucea , Enno Mammen , Mohamed Ndaoud , Alexandre B. Tsybakov

We developed a corporative stochastic approximation (CSA) type algorithm for semi-infinite programming (SIP), where the cut generation problem is solved inexactly. First, we provide general error bounds for inexact CSA. Then, we propose two…

Optimization and Control · Mathematics 2018-12-24 Bo Wei , William B. Haskell , Sixiang Zhao

We consider parameter estimation, hypothesis testing and variable selection for partially time-varying coefficient models. Our asymptotic theory has the useful feature that it can allow dependent, nonstationary error and covariate…

Statistics Theory · Mathematics 2012-08-20 Ting Zhang , Wei Biao Wu

Real-life statistical samples are often plagued by selection bias, which complicates drawing conclusions about the general population. When learning causal relationships between the variables is of interest, the sample may be assumed to be…

Statistics Theory · Mathematics 2018-11-15 Angelos P. Armen , Robin J. Evans

Existing identification and estimation methods for semiparametric sample selection models rely heavily on exclusion restrictions. However, it is difficult in practice to find a credible excluded variable that has a correlation with…

Econometrics · Economics 2024-12-03 Zhewen Pan , Yifan Zhang

Sample complexity of bias estimation is a lower bound on the runtime of any bias detection method. Many regulatory frameworks require the bias to be tested for all subgroups, whose number grows exponentially with the number of protected…

Machine Learning · Computer Science 2025-02-06 German Martinez Matilla , Jakub Marecek

This work addresses the distributed estimation problem in a set membership framework. The agents of a network collect measurements which are affected by bounded errors, thus implying that the unknown parameters to be estimated belong to a…

Optimization and Control · Mathematics 2018-12-11 Francesco Farina , Andrea Garulli , Antonio Giannitrapani

In this work we consider the task of constructing prediction intervals in an inductive batch setting. We present a discriminative learning framework which optimizes the expected error rate under a budget constraint on the interval sizes.…

Machine Learning · Computer Science 2018-02-28 Nir Rosenfeld , Yishay Mansour , Elad Yom-Tov

Optimal portfolio selection problems are determined by the (unknown) parameters of the data generating process. If an investor wants to realise the position suggested by the optimal portfolios, he/she needs to estimate the unknown…

Portfolio Management · Quantitative Finance 2023-04-19 Taras Bodnar , Holger Dette , Nestor Parolya , Erik Thorsén

We propose a semiparametric model to study the effect of covariates on the distribution of a censored event time while making minimal assumptions about the censoring mechanism. The result is a partially identified model, in the sense that…

Methodology · Statistics 2025-03-19 Ilias Willems , Jad Beyhum , Ingrid Van Keilegom

Selective inference is the problem of giving valid answers to statistical questions chosen in a data-driven manner. A standard solution to selective inference is simultaneous inference, which delivers valid answers to the set of all…

Methodology · Statistics 2024-05-03 Tijana Zrnic , William Fithian

Estimation and inference in dynamic discrete choice models often relies on approximation to lower the computational burden of dynamic programming. Unfortunately, the use of approximation can impart substantial bias in estimation and results…

Econometrics · Economics 2020-10-23 Ben Deaner