English
Related papers

Related papers: Generalized robust shrinkage estimator and its app…

200 papers

We address the problem of robust sparse estimation of the precision matrix for heavy-tailed distributions in high-dimensional settings. In such high-dimensional contexts, we observe that the covariance matrix can be approximated by a…

Methodology · Statistics 2025-03-06 Zhengke Lu , Long Feng

Convex-composite optimization, which minimizes an objective function represented by the sum of a differentiable function and a convex one, is widely used in machine learning and signal/image processing. Fast Iterative Shrinkage Thresholding…

Optimization and Control · Mathematics 2022-05-12 Hiroki Tanabe , Ellen H. Fukuda , Nobuo Yamashita

Large-scale kernel approximation is an important problem in machine learning research. Approaches using random Fourier features have become increasingly popular [Rahimi and Recht, 2007], where kernel approximation is treated as empirical…

Machine Learning · Computer Science 2017-05-25 Wei-Cheng Chang , Chun-Liang Li , Yiming Yang , Barnabas Poczos

The rigorous convergence analysis of adaptive finite element methods for regularized variational models of quasi-static brittle fracture in strain-limiting elastic solids is presented. This work introduces two novel adaptive mesh refinement…

Numerical Analysis · Mathematics 2025-11-19 Ram Manohar , S. M. Mallikarjunaiah

In high-dimensional data settings where $p\gg n$, many penalized regularization approaches were studied for simultaneous variable selection and estimation. However, with the existence of covariates with weak effect, many existing variable…

Methodology · Statistics 2016-03-24 Xiaoli Gao , S. E. Ahmed , Yang Feng

We consider shrinkage estimation of higher order Hilbert space valued Bochner integrals in a non-parametric setting. We propose estimators that shrink the $U$-statistic estimator of the Bochner integral towards a pre-specified target…

Statistics Theory · Mathematics 2022-07-22 Saiteja Utpala , Bharath K. Sriperumbudur

One of the major challenges in multivariate analysis is the estimation of population covariance matrix from sample covariance matrix (SCM). Most recent covariance matrix estimators use either shrinkage transformations or asymptotic results…

Methodology · Statistics 2019-12-10 Samruddhi Deshmukh , Amartansh Dubey

Over the past decades, there has been a surge of interest in studying low-dimensional structures within high-dimensional data. Statistical factor models $-$ i.e., low-rank plus diagonal covariance structures $-$ offer a powerful framework…

Machine Learning · Statistics 2025-05-20 Daniel Cederberg

This paper considers the problem of robustly estimating the parameters of a heavy-tailed multivariate distribution when the covariance matrix is known to have the structure of a low-rank matrix plus a diagonal matrix as considered in factor…

Computation · Statistics 2019-09-30 Rui Zhou , Junyan Liu , Sandeep Kumar , Daniel P. Palomar

This article studies the behavior of regularized Tyler estimators (RTEs) of scatter matrices. The key advantages of these estimators are twofold. First, they guarantee by construction a good conditioning of the estimate and second, being a…

Information Theory · Computer Science 2016-04-20 Abla Kammoun , Romain Couillet , Frederic Pascal , Mohamed-Slim Alouini

We establish the existence theory of several commonly used finite element (FE) nonlinear fully discrete solutions, and the convergence theory of a linearized iteration. First, it is shown for standard FE, SUPG and edge-averaged method…

Numerical Analysis · Mathematics 2023-12-04 Yang Liu , Shi Shu , Ying Yang

The aim of this paper is to present a new fast-convergent numerically stable space-time adaptive processing (STAP) algorithm derived using a novel technique of feedback orthogonalization. The main advantages of this approach lie in its…

Instrumentation and Methods for Astrophysics · Physics 2010-08-26 Vasily A. Khlebnikov , Kristian Zarb Adami

In this paper, we study robust covariance estimation under the approximate factor model with observed factors. We propose a novel framework to first estimate the initial joint covariance matrix of the observed data and the factors, and then…

Methodology · Statistics 2016-02-03 Jianqing Fan , Weichen Wang , Yiqiao Zhong

Covariate adjustment is a ubiquitous method used to estimate the average treatment effect (ATE) from observational data. Assuming a known graphical structure of the data generating model, recent results give graphical criteria for optimal…

Statistics Theory · Mathematics 2025-12-08 Alexander Mangulad Christgau , Anton Rask Lundborg , Niels Richard Hansen

In this paper we derive the optimal linear shrinkage estimator for the high-dimensional mean vector using random matrix theory. The results are obtained under the assumption that both the dimension $p$ and the sample size $n$ tend to…

Statistics Theory · Mathematics 2018-07-17 Taras Bodnar , Ostap Okhrin , Nestor Parolya

This paper introduces a flexible regularization approach that reduces point estimation risk of group means stemming from e.g. categorical regressors, (quasi-)experimental data or panel data models. The loss function is penalized by adding…

Econometrics · Economics 2019-01-08 Phillip Heiler , Jana Mareckova

We study the problem of change point localisation and inference for sequentially collected fragmented functional data, where each curve is observed only over discrete grids randomly sampled over a short fragment. The sequence of underlying…

Methodology · Statistics 2024-05-10 Gengyu Xue , Haotian Xu , Yi Yu

The chemical master equation (CME) is frequently used in systems biology to quantify the effects of stochastic fluctuations that arise due to biomolecular species with low copy numbers. The CME is a system of ordinary differential equations…

Quantitative Methods · Quantitative Biology 2017-10-25 Ankit Gupta , Jan Mikelson , Mustafa Khammash

Motivated by applications in tissue-wide association studies (TWAS), we develop a flexible and theoretically grounded empirical Bayes approach for integrating %vector-valued outcomes data obtained from different sources. We propose a linear…

Methodology · Statistics 2026-02-17 Antik Chakraborty , Fei Xue

We combine Tyler's robust estimator of the dispersion matrix with nonlinear shrinkage. This approach delivers a simple and fast estimator of the dispersion matrix in elliptical models that is robust against both heavy tails and high…

Methodology · Statistics 2023-05-31 Simon Hediger , Jeffrey Näf , Michael Wolf