English
Related papers

Related papers: Inference on Directionally Differentiable Function…

200 papers

In high-dimensional learning, models remain stable until they collapse abruptly once the sample size falls below a critical level. This instability is not algorithm-specific but a geometric mechanism: when the weakest Fisher eigendirection…

Machine Learning · Statistics 2025-11-26 William Hao-Cheng Huang

This article proposes an online bootstrap scheme for nonparametric level estimation in nonstationary time series. Our approach applies to a broad class of level estimators expressible as weighted sample averages over time windows, including…

Methodology · Statistics 2026-03-02 Thomas Nagler , Tobias Brock , Nicolai Palm

In this paper, we study distributional reinforcement learning from the perspective of statistical efficiency. We investigate distributional policy evaluation, aiming to estimate the complete return distribution (denoted $\eta^\pi$) attained…

Machine Learning · Statistics 2025-11-13 Liangyu Zhang , Yang Peng , Jiadong Liang , Wenhao Yang , Zhihua Zhang

Modeling of longitudinal data often requires diffusion models that incorporate overall time-dependent, nonlinear dynamics of multiple components and provide sufficient flexibility for subject-specific modeling. This complexity challenges…

Methodology · Statistics 2017-01-31 Mareile Große Ruse , Adeline Samson , Susanne Ditlevsen

We propose two semiparametric versions of the debiased Lasso procedure for the model $Y_i = X_i\beta_0 + g_0(Z_i) + \epsilon_i$, where $\beta_0$ is high dimensional but sparse (exactly or approximately). Both versions are shown to have the…

Statistics Theory · Mathematics 2017-08-09 Ying Zhu , Zhuqing Yu , Guang Cheng

We study the out-of-sample properties of robust empirical optimization problems with smooth $\phi$-divergence penalties and smooth concave objective functions, and develop a theory for data-driven calibration of the non-negative "robustness…

Machine Learning · Statistics 2020-05-20 Jun-Ya Gotoh , Michael Jong Kim , Andrew E. B. Lim

We propose a novel Riemannian geometric framework for variational inference in Bayesian models based on the nonparametric Fisher-Rao metric on the manifold of probability density functions. Under the square-root density representation, the…

Methodology · Statistics 2019-03-29 Abhijoy Saha , Karthik Bharath , Sebastian Kurtek

Identification-robust hypothesis tests are commonly based on the continuous updating GMM objective function. When the number of moment conditions grows proportionally with the sample size, the large-dimensional weighting matrix prohibits…

Econometrics · Economics 2025-10-10 Tom Boot , Johannes W. Ligtenberg

In modern experimental science, there is a common problem of estimating the coefficients of a linear regression in a context where the variables of interest cannot be observed simultaneously. When there is a categorical variable that is…

Methodology · Statistics 2025-03-10 Polina Arsenteva , Mohamed Amine Benadjaoud , Hervé Cardot

We present a practical framework to prove, in a simple way, two-terms asymptotic expansions for Fourier integrals $$ {\mathcal I}(t) = \int_{\mathbb R}({\rm e}^{it\phi(x)}-1) {\rm d} \mu(x) $$ where $\mu$ is a probability measure on…

Number Theory · Mathematics 2020-11-03 Sandro Bettin , Sary Drappeau

We consider parametric inference for an ergodic and stationary diffusion process, when the data are high-frequency observations of the integral of the diffusion process. Such data are obtained via certain measurement devices, or if…

Statistics Theory · Mathematics 2026-02-09 Emil S. Jørgensen , Michael Sørensen

Accurate statistical inference in logistic regression models remains a critical challenge when the ratio between the number of parameters and sample size is not negligible. This is because approximations based on either classical asymptotic…

Methodology · Statistics 2022-08-19 Qian Zhao , Emmanuel J. Candes

The diffusion equation \partial_t\phi = \nabla^2\phi is considered, with initial condition \phi( _x_ ,0) a gaussian random variable with zero mean. Using a simple approximate theory we show that the probability p_n(t_1,t_2) that \phi( _x_…

Condensed Matter · Physics 2009-10-28 Satya N. Majumdar , Clement Sire , Alan J. Bray , Stephen J. Cornell

We propose a novel procedure for estimating and conducting inference on average marginal effects in partially linear instrumental regressions using Reproducing Kernel Hilbert Space methods. Our procedure relies on a single regularization…

Econometrics · Economics 2026-04-14 Lucas Girard , Elia Lapenta

In a Hilbert space setting $\mathcal H$, we study the fast convergence properties as $t \to + \infty$ of the trajectories of the second-order differential equation $ \ddot{x}(t) + \frac{\alpha}{t} \dot{x}(t) + \nabla \Phi (x(t)) = g(t)$,…

Optimization and Control · Mathematics 2015-07-07 H. Attouch , Z. Chbani

This is a review of asymptotic and non-asymptotic behaviour of Bayesian methods under model specification. In particular we focus on consistency, i.e. convergence of the posterior distribution to the point mass at the best parametric…

Statistics Theory · Mathematics 2023-11-21 Natalia Bochkina

When are asymptotic approximations using the delta-method uniformly valid? We provide sufficient conditions as well as closely related necessary conditions for uniform negligibility of the remainder of such approximations. These conditions…

Statistics Theory · Mathematics 2015-07-22 Maximilian Kasy

Asymptotic inference using functional principal component regression (FPCR) has long been considered difficult, largely because, upon any scalar scaling, the FPCR estimator fails to satisfy a central limit theorem, leading to the prevailing…

Statistics Theory · Mathematics 2026-03-16 Hyemin Yeon

This paper proposes a new approach to obtain uniformly valid inference for linear functionals or scalar subvectors of a partially identified parameter defined by linear moment inequalities. The procedure amounts to bootstrapping the value…

Econometrics · Economics 2023-05-09 JoonHwan Cho , Thomas M. Russell

This paper describes three methods for carrying out non-asymptotic inference on partially identified parameters that are solutions to a class of optimization problems. Applications in which the optimization problems arise include estimation…

Methodology · Statistics 2022-12-02 Joel L. Horowitz , Sokbae Lee