English
Related papers

Related papers: Local asymptotics of cross-validation in least-squ…

200 papers

In reliability theory and survival analysis, observed data are often weakly dependent and subject to additive measurement errors. Such contamination arises when the underlying data are neither independent nor strongly mixed but instead…

Statistics Theory · Mathematics 2025-03-20 Benjrada Mohammed Essalih

In this paper we compare and contrast the behavior of the posterior predictive distribution to the risk of the maximum a posteriori estimator for the random features regression model in the overparameterized regime. We will focus on the…

Machine Learning · Statistics 2023-10-30 Youngsoo Baek , Samuel I. Berchuck , Sayan Mukherjee

We consider the problem of estimating the predictive density of future observations from a non-parametric regression model. The density estimators are evaluated under Kullback--Leibler divergence and our focus is on establishing the exact…

Statistics Theory · Mathematics 2010-10-12 Xinyi Xu , Feng Liang

We study sharp detection thresholds for degree corrections in Stochastic Block Models in the context of a goodness of fit problem, and explore the effect of the unknown community assignment (a high dimensional nuisance parameter) and the…

Statistics Theory · Mathematics 2019-07-16 Rajarshi Mukherjee , Subhabrata Sen

We study convex empirical risk minimization for high-dimensional inference in binary models. Our first result sharply predicts the statistical performance of such estimators in the linear asymptotic regime under isotropic Gaussian features.…

Statistics Theory · Mathematics 2020-02-27 Hossein Taheri , Ramtin Pedarsani , Christos Thrampoulidis

Model averaging, as an appealing ensemble technique, strategically integrates all valuable information from candidate models to construct fast and accurate prediction. Despite of having been widely practiced in many fields such as…

Methodology · Statistics 2026-03-17 Zhuang Yong , Lv Jing , Tingting Li

We study the asymptotic properties of nearest-neighbor random walks in 1d random environment under the influence of an external field of intensity $\lambda\in\mathbb{R}$. For ergodic shift-invariant environments, we show that the limiting…

Probability · Mathematics 2018-06-11 Alessandra Faggionato , Michele Salvi

Vovk (2015) introduced cross-conformal prediction, a modification of split conformal designed to improve the width of prediction sets. The method, when trained with a miscoverage rate equal to $\alpha$ and $n \gg K$, ensures a marginal…

Machine Learning · Statistics 2025-05-22 Matteo Gasparin , Aaditya Ramdas

We study the problem of estimating a temporally varying coefficient and varying structure (VCVS) graphical model underlying nonstationary time series data, such as social states of interacting individuals or microarray expression profiles…

Machine Learning · Statistics 2010-12-21 Mladen Kolar , Eric P. Xing

We consider signal source localization from range-difference measurements. First, we give some readily-checked conditions on measurement noises and sensor deployment to guarantee the asymptotic identifiability of the model and show the…

Signal Processing · Electrical Eng. & Systems 2023-09-26 Guangyang Zeng , Biqiang Mu , Ling Shi , Jiming Chen , Junfeng Wu

The paper deals with asymptotic properties of the adaptive procedure proposed in the author paper, 2007, for estimating a unknown nonparametric regression. We prove that this procedure is asymptotically efficient for a quadratic risk, i.e.…

Statistics Theory · Mathematics 2008-10-08 Leonid Galtchouk , Serguey Pergamenshchikov

Asymptotic properties of three estimators of probability density function of sample maximum $f_{(m)}:=mfF^{m-1}$ are derived, where $m$ is a function of sample size $n$. One of the estimators is the parametrically fitted by the…

Statistics Theory · Mathematics 2022-06-13 Taku Moriyama

Existing optimal estimators of nonequilibrium path-ensemble averages are shown to fall within the framework of extended bridge sampling. Using this framework, we derive a general minimal-variance estimator that can combine nonequilibrium…

Statistical Mechanics · Physics 2011-12-06 David D. L. Minh , John D. Chodera

We study behavior of the restricted maximum likelihood (REML) estimator under a misspecified linear mixed model (LMM) that has received much attention in recent gnome-wide association studies. The asymptotic analysis establishes consistency…

Statistics Theory · Mathematics 2014-04-10 Jiming Jiang , Cong Li , Debashis Paul , Can Yang , Hongyu Zhao

We characterize the squared prediction risk of ensemble estimators obtained through subagging (subsample bootstrap aggregating) regularized M-estimators and construct a consistent estimator for the risk. Specifically, we consider a…

Statistics Theory · Mathematics 2025-09-30 Takuya Koriyama , Pratik Patil , Jin-Hong Du , Kai Tan , Pierre C. Bellec

In parametric estimation of covariance function of Gaussian processes, it is often the case that the true covariance function does not belong to the parametric set used for estimation. This situation is called the misspecified case. In this…

Statistics Theory · Mathematics 2015-11-13 François Bachoc

Covariance parameter estimation of Gaussian processes is analyzed in an asymptotic framework. The spatial sampling is a randomly perturbed regular grid and its deviation from the perfect regular grid is controlled by a single scalar…

Statistics Theory · Mathematics 2014-12-09 François Bachoc

Cross-validation (CV) is one of the main tools for performance estimation and parameter tuning in machine learning. The general recipe for computing CV estimate is to run a learning algorithm separately for each CV fold, a computationally…

Machine Learning · Statistics 2015-07-02 Pooria Joulani , András György , Csaba Szepesvári

Recently, there has been substantial interest in statistical guarantees for cross-validation (CV) methods of uncertainty quantification in statistical learning (cf. Barber et al. 2021a, Liang and Barber 2024, Steinberger and Leeb 2023).…

Statistics Theory · Mathematics 2025-05-09 Nicolai Amann , Hannes Leeb , Lukas Steinberger

We consider a one dimensional ballistic random walk evolving in a parametric independent and identically distributed random environment. We study the asymptotic properties of the maximum likelihood estimator of the parameter based on a…

Statistics Theory · Mathematics 2014-04-29 Mikael Falconnet , Dasha Loukianova , Catherine Matias
‹ Prev 1 8 9 10 Next ›