English
Related papers

Related papers: Finite sample expansions and risk bounds in high-d…

200 papers

In the presence of sample selection, Lee's (2009) nonparametric bounds are a popular tool for estimating a treatment effect. However, the Lee bounds rely on the monotonicity assumption, whose empirical validity is sometimes unclear.…

Econometrics · Economics 2025-01-07 Yuta Okamoto

Finite Sample Smeariness (FSS) has been recently discovered. It means that the distribution of sample Fr\'echet means of underlying rather unsuspicious random variables can behave as if it were smeary for quite large regimes of finite…

Statistics Theory · Mathematics 2021-03-02 Benjamin Eltzner , Shayan Hundrieser , Stephan F. Huckemann

Linear Least Squares is a very well known technique for parameter estimation, which is used even when sub-optimal, because of its very low computational requirements and the fact that exact knowledge of the noise statistics is not required.…

Signal Processing · Electrical Eng. & Systems 2017-11-01 Michael Krikheli , Amir Leshem

This paper revisits the prominent Fisher, Wilks, and Bernstein -- von Mises (BvM) results from different viewpoints. Particular issues to address are: nonasymptotic framework with just one finite sample, possible model misspecification, and…

Statistics Theory · Mathematics 2014-04-28 Vladimir Spokoiny

Penalized likelihood approaches are widely used for high-dimensional regression. Although many methods have been proposed and the associated theory is now well-developed, the relative efficacy of different approaches in finite-sample…

Methodology · Statistics 2020-01-29 Fan Wang , Sach Mukherjee , Sylvia Richardson , Steven M. Hill

High-dimensional data sets are commonly collected in many contemporary applications arising in various fields of scientific research. We present two views of finite samples in high dimensions: a probabilistic one and a nonprobabilistic one.…

Statistics Theory · Mathematics 2013-11-13 Jinchi Lv

The paper aims at reconsidering the famous Le Cam LAN theory. The main features of the approach which make it different from the classical one are as follows: (1) the study is nonasymptotic, that is, the sample size is fixed and does not…

Statistics Theory · Mathematics 2013-03-06 Vladimir Spokoiny

This paper presents uniform-in-time finite-sample bounds for regularized linear regression with vector-valued outputs and conditionally zero-mean subgaussian noise. By revisiting classical self-normalized martingale arguments, we obtain…

Statistics Theory · Mathematics 2026-03-20 Léo Simpson , Katrin Baumgärtner , Johannes Köhler , Moritz Diehl

ATLAS and CMS have been performing a large number of searches for physics beyond the Standard Model (BSM). In particular results of supersymmetry (SUSY) searches are typically interpreted in the context of simplified models. While mass…

High Energy Physics - Phenomenology · Physics 2017-10-02 Ursula Laa

We develop a general framework for estimating function-valued parameters under equality or inequality constraints in infinite-dimensional statistical models. Such constrained learning problems are common across many areas of statistics and…

Machine Learning · Statistics 2025-07-22 Razieh Nabi , Nima S. Hejazi , Mark J. van der Laan , David Benkeser

This article offers a comprehensive treatment of polynomial functional regression, culminating in the establishment of a novel finite sample bound. This bound encompasses various aspects, including general smoothness conditions, capacity…

Numerical Analysis · Mathematics 2024-05-08 Markus Holzleitner , Sergei Pereverzyev

In meta-analysis, the random-effects models are standard tools to address between-study heterogeneity in evidence synthesis analyses. For the random-effects distribution models, the normal distribution model has been adopted in most…

Applications · Statistics 2021-07-28 Hisashi Noma , Kengo Nagashima , Shogo Kato , Satoshi Teramukai , Toshi A. Furukawa

We introduce, for the first time, a new class of Birnbaum-Saunders nonlinear regression models potentially useful in lifetime data analysis. The class generalizes the regression model described by Rieck and Nedelman [1991, A log-linear…

Methodology · Statistics 2009-07-03 Artur J. Lemonte , Gauss M. Cordeiro

We investigate hypothesis testing in nonparametric additive models estimated using simplified smooth backfitting (Huang and Yu, Journal of Computational and Graphical Statistics, \textbf{28(2)}, 386--400, 2019). Simplified smooth…

Statistics Theory · Mathematics 2022-09-16 Suneel Babu Chatla

There has been remarkable progress over the past decade in establishing finite-sample, non-asymptotic bounds on recovering unknown system parameters from observed system behavior. Surprisingly, however, we show that the current…

Machine Learning · Statistics 2026-04-24 Yichen Zhou , Stephen Tu

The scaling and mass expansion (shortly 'sm-expansion') is a new axiom for causal perturbation theory, which is a stronger version of a frequently used renormalization condition in terms of Steinmann's scaling degree. If one quantizes the…

Mathematical Physics · Physics 2015-06-18 Michael Duetsch

We address the problem of learning an unknown smooth function and its derivatives from noisy pointwise evaluations under the supremum norm. While classical nonparametric regression provides a strong theoretical foundation, traditional…

Machine Learning · Computer Science 2026-03-10 Davide Maran , Marcello Restelli

The problem of binary hypothesis testing between two probability measures is considered. New sharp bounds are derived for the best achievable error probability of such tests based on independent and identically distributed observations.…

Information Theory · Computer Science 2024-05-30 Valentinian Lungu , Ioannis Kontoyiannis

In statistical analysis, many classic results require the assumption that models have finite mean or variance, including the most standard versions of the laws of large numbers and the central limit theorems. Such an assumption may not be…

Risk Management · Quantitative Finance 2024-10-28 Yuyu Chen , Ruodu Wang

In this paper, I try to tame "Basu's elephants" (data with extreme selection on observables). I propose new practical large-sample and finite-sample methods for estimating and inferring heterogeneous causal effects (under unconfoundedness)…

Econometrics · Economics 2023-01-20 Ganesh Karapakula