English
Related papers

Related papers: Shrinkage Estimation of Higher Order Bochner Integ…

200 papers

This paper presents uniform convergence rates for kernel regression estimators, in the setting of a structural nonlinear cointegrating regression model. We generalise the existing literature in three ways. First, the domain to which these…

Statistics Theory · Mathematics 2015-05-08 James A. Duffy

The present paper concerns large covariance matrix estimation via composite minimization under the assumption of low rank plus sparse structure. In this approach, the low rank plus sparse decomposition of the covariance matrix is recovered…

Methodology · Statistics 2019-12-16 Matteo Farnè , Angela Montanari

In this work, we address the problem of Hessian inversion bias in distributed second-order optimization algorithms. We introduce a novel shrinkage-based estimator for the resolvent of gram matrices which is asymptotically unbiased, and…

Optimization and Control · Mathematics 2024-02-06 Fangzhao Zhang , Mert Pilanci

To recover a low rank structure from a noisy matrix, truncated singular value decomposition has been extensively used and studied. Recent studies suggested that the signal can be better estimated by shrinking the singular values. We pursue…

Methodology · Statistics 2014-11-25 Julie Josse , Sylvain Sardy

We provide a new estimator of integral operators with smooth kernels, obtained from a set of scattered and noisy impulse responses. The proposed approach relies on the formalism of smoothing in reproducing kernel Hilbert spaces and on the…

Information Theory · Computer Science 2017-12-04 Jérémie Bigot , Paul Escande , Pierre Weiss

Regularity estimates for an integral operator with a symmetric continuous kernel on a convex bounded domain are derived. The covariance of a mean-square continuous random field on the domain is an example of such an operator. The estimates…

Probability · Mathematics 2022-04-25 Mihály Kovács , Annika Lang , Andreas Petersson

We study shrinkage estimation of the mean parameters of a class of multivariate distributions for which the diagonal entries of the corresponding covariance matrix are certain quadratic functions of the mean parameter. This class of…

Statistics Theory · Mathematics 2022-07-04 Nikolas Siapoutis , Donald Richards , Bharath K. Sriperumbudur

Let $X$ be a random vector with distribution $P_{\theta}$ where $\theta$ is an unknown parameter. When estimating $\theta$ by some estimator $\varphi(X)$ under a loss function $L(\theta,\varphi)$, classical decision theory advocates that…

Methodology · Statistics 2012-03-23 Dominique Fourdrinier , Martin T. Wells

In this paper we investigate the problem of estimating the regression function in models with correlated observations. The data is obtained from several experimental units each of them forms a time series. We propose a new estimator based…

Statistics Theory · Mathematics 2019-06-13 Djihad Benelmadani , Karim Benhenni , Sana Louhichi

Compared to nonparametric estimators in the multivariate setting, kernel estimators for functional data models have a larger order of bias. This is problematic for constructing confidence regions or statistical tests since the bias might…

Statistics Theory · Mathematics 2025-11-21 Melanie Birke , Tim Greger

We prove H\"older regularity estimates up to the boundary for weak solutions $u$ to nonlocal Schr\"odinger equations subject to exterior Dirichlet conditions in an open set $\Omega\subset \mathbb{R}^N$. The class of nonlocal operators…

Analysis of PDEs · Mathematics 2018-05-15 Mouhamed Moustapha Fall

In this paper, a new ridge-type shrinkage estimator for the precision matrix has been proposed. The asymptotic optimal shrinkage coefficients and the theoretical loss were derived. Data-driven estimators for the shrinkage coefficients were…

Methodology · Statistics 2019-09-04 Cheng Wang , Guangming Pan , Longbing Cao

In this study, we propose shrinkage methods based on {\it generalized ridge regression} (GRR) estimation which is suitable for both multicollinearity and high dimensional problems with small number of samples (large $p$, small $n$). Also,…

Statistics Theory · Mathematics 2020-03-04 Bahadır Yüzbaşı , Mohammad Arashi , S. Ejaz Ahmed

We study degenerate hypoelliptic Ornstein-Uhlenbeck operators in $L^2$ spaces with respect to invariant measures. The purpose of this article is to show how recent results on general quadratic operators apply to the study of degenerate…

Analysis of PDEs · Mathematics 2014-11-25 Michela Ottobre , Grigorios Pavliotis , Karel Pravda-Starov

In this work we construct an optimal linear shrinkage estimator for the covariance matrix in high dimensions. The recent results from the random matrix theory allow us to find the asymptotic deterministic equivalents of the optimal…

Statistics Theory · Mathematics 2014-10-28 Taras Bodnar , Arjun K. Gupta , Nestor Parolya

In this paper, we consider a partial deconvolution kernel estimator for nonparametric regression when some covariates are measured with error while others are observed without error. We focus on a general and realistic setting in which the…

Statistics Theory · Mathematics 2026-01-29 Baba Thiam

Learning kernels in operators from data lies at the intersection of inverse problems and statistical learning, providing a powerful framework for capturing non-local dependencies in function spaces and high-dimensional settings. In contrast…

Statistics Theory · Mathematics 2025-06-24 Sichong Zhang , Xiong Wang , Fei Lu

Shrinkage methods are frequently used to improve the precision of least squares estimators of fixed effects. However, widely used shrinkage estimators guarantee improved precision only under strong distributional assumptions. I develop an…

Econometrics · Economics 2025-09-09 Soonwoo Kwon

Large-scale kernel approximation is an important problem in machine learning research. Approaches using random Fourier features have become increasingly popular [Rahimi and Recht, 2007], where kernel approximation is treated as empirical…

Machine Learning · Computer Science 2017-05-25 Wei-Cheng Chang , Chun-Liang Li , Yiming Yang , Barnabas Poczos

We consider the problem of combining data from observational and experimental sources to make causal conclusions. This problem is increasingly relevant, as the modern era has yielded passive collection of massive observational datasets in…

Methodology · Statistics 2020-05-19 Evan Rosenman , Guillaume Basse , Art Owen , Michael Baiocchi