English
Related papers

Related papers: Second Order Correctness of Perturbation Bootstrap…

200 papers

In this paper the problem of retrospective change-point detection and estimation in multivariate linear models is considered. The lower bounds for the error of change-point estimation are proved in different cases (one change-point:…

Statistics Theory · Mathematics 2011-10-27 Boris Brodsky , Boris Darkhovsky

Despite being robust to small amounts of label noise, convolutional neural networks trained with stochastic gradient methods have been shown to easily fit random labels. When there are a mixture of correct and mislabelled targets, networks…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Eric Arazo , Diego Ortego , Paul Albert , Noel E. O'Connor , Kevin McGuinness

In this paper, we propose a novel approach to detect heteroskedasticity in regression models with regressors contaminated by measurement error. Specifically, inspired by the integrated conditional moment (ICM) approach, we construct test…

Econometrics · Economics 2026-05-20 Xiaojun Song , Jichao Yuan

We study the bias of the isotonic regression estimator. While there is extensive work characterizing the mean squared error of the isotonic regression estimator, relatively little is known about the bias. In this paper, we provide a sharp…

Statistics Theory · Mathematics 2020-01-14 Ran Dai , Hyebin Song , Rina Foygel Barber , Garvesh Raskutti

Self-supervised pre-training, where large corpora of unlabeled data are used to learn representations for downstream fine-tuning, has become a cornerstone of modern machine learning. While a growing body of theoretical work has begun to…

Machine Learning · Computer Science 2026-03-31 Mohammad Tinati , Stephen Tu

Deep learning models often achieve high performance by inadvertently learning spurious correlations between targets and non-essential features. For example, an image classifier may identify an object via its background that spuriously…

Machine Learning · Computer Science 2025-06-19 Guangtao Zheng , Wenqian Ye , Aidong Zhang

We modify the Double Machine Learning estimator to broaden its applicability to macroeconomic time-series settings. A deterministic cross-fitting step, termed Reverse Cross-Fitting, leverages the time-reversibility of stationary series to…

Econometrics · Economics 2026-03-12 Milos Ciganovic , Federico D'Amario , Massimiliano Tancioni

We generalize the na\"ive estimator of a Poisson regression model with measurement errors as discussed in Kukush et al. [1]. The explanatory variable is not always normally distributed as they assume. In this study, we assume that the…

Statistics Theory · Mathematics 2022-05-12 Kentarou Wada , Takeshi Kurosawa

We consider penalized extremum estimation of a high-dimensional, possibly nonlinear model that is sparse in the sense that most of its parameters are zero but some are not. We use the SCAD penalty function, which provides model selection…

Econometrics · Economics 2024-02-23 Joel L. Horowitz , Ahnaf Rafi

The maximum-likelihood estimator of nonlinear panel data models with fixed effects is consistent but asymptotically-biased under rectangular-array asymptotics. The literature has thus far concentrated its effort on devising methods to…

Econometrics · Economics 2022-01-28 Ayden Higgins , Koen Jochmans

The block maxima method is a standard approach for analyzing the extremal behavior of a potentially multivariate time series. It has recently been found that the classical approach based on disjoint block maxima may be universally improved…

Statistics Theory · Mathematics 2025-03-26 Axel Bücher , Torben Staud

An important challenge in statistical analysis concerns the control of the finite sample bias of estimators. For example, the maximum likelihood estimator has a bias that can result in a significant inferential loss. This problem is…

Statistics Theory · Mathematics 2019-11-04 Stéphane Guerrier , Mucyo Karemera , Samuel Orso , Maria-Pia Victoria-Feser

This paper concerns the robust regression model when the number of predictors and the number of observations grow in a similar rate. Theory for M-estimators in this regime has been recently developed by several authors [El Karoui et al.,…

Statistics Theory · Mathematics 2016-04-06 Daniel Nevo , Ya'acov Ritov

Focusing on a high dimensional linear model $y = X\beta + \epsilon$ with dependent, non-stationary, and heteroskedastic errors, this paper applies the debiased and threshold ridge regression method that gives a consistent estimator for…

Statistics Theory · Mathematics 2021-10-27 Yunyi Zhang , Dimitris N. Politis

We consider the eigenvalues and eigenvectors of small rank perturbations of random $N\times N$ matrices. We allow the rank of perturbation $M$ increases with $N$, and the only assumption is $M=o(N)$. In both additive and multiplicative…

Probability · Mathematics 2015-05-18 Jiaoyang Huang

Bias correction can often improve the finite sample performance of estimators. We show that the choice of bias correction method has no effect on the higher-order variance of semiparametrically efficient parametric estimators, so long as…

Econometrics · Economics 2024-01-29 Jinyong Hahn , David W. Hughes , Guido Kuersteiner , Whitney K. Newey

A minimal requirement for simulating multi-scale systems is to reproduce the statistical behavior of the slow variables. In particular, a good numerical method should accurately aproximate the probability density function of the…

Dynamical Systems · Mathematics 2018-04-13 J. Frank , G. A. Gottwald

The block bootstrap confidence interval based on dependent data can outperform the computationally more convenient normal approximation only with non-trivial Studentization which, in the case of complicated statistics, calls for highly…

Methodology · Statistics 2008-04-29 Stephen M. S. Lee , P. Y. Lai

Joint utilization of multiple discrete frequency bands can enhance the accuracy of delay estimation. Although some unique challenges of multiband fusion, such as phase distortion, oscillation phenomena, and high-dimensional search, have…

Signal Processing · Electrical Eng. & Systems 2025-07-09 Zhixiang Hu , An Liu , Minjian Zhao

We assume a second-order source separation model where the observed multivariate time series is a linear mixture of latent, temporally uncorrelated time series with some components pure white noise. To avoid the modelling of noise, we…

Methodology · Statistics 2019-05-07 Markus Matilainen , Klaus Nordhausen , Joni Virta