English
Related papers

Related papers: Large Dimensional Analysis and Optimization of Rob…

200 papers

There has been a surge of interest in developing robust estimators for models with heavy-tailed and bounded variance data in statistics and machine learning, while few works impose unbounded variance. This paper proposes two type of robust…

Machine Learning · Statistics 2022-10-12 Lihu Xu , Fang Yao , Qiuran Yao , Huiming Zhang

Over the past decades, there has been a surge of interest in studying low-dimensional structures within high-dimensional data. Statistical factor models $-$ i.e., low-rank plus diagonal covariance structures $-$ offer a powerful framework…

Machine Learning · Statistics 2025-05-20 Daniel Cederberg

We address structured covariance estimation in elliptical distributions by assuming that the covariance is a priori known to belong to a given convex set, e.g., the set of Toeplitz or banded matrices. We consider the General Method of…

Machine Learning · Statistics 2023-07-19 Ilya Soloveychik , Ami Wiesel

We elucidate the problem of estimating large-dimensional covariance matrices in the presence of correlations between samples. To this end, we generalize the Marcenko-Pastur equation and the Ledoit-Peche shrinkage estimator using methods of…

Mathematical Physics · Physics 2022-04-06 Zdzislaw Burda , Andrzej Jarosz

We provide a new computationally-efficient class of estimators for risk minimization. We show that these estimators are robust for general statistical models: in the classical Huber epsilon-contamination model and in heavy-tailed settings.…

Machine Learning · Statistics 2018-04-23 Adarsh Prasad , Arun Sai Suggala , Sivaraman Balakrishnan , Pradeep Ravikumar

We address the problem of robust sparse estimation of the precision matrix for heavy-tailed distributions in high-dimensional settings. In such high-dimensional contexts, we observe that the covariance matrix can be approximated by a…

Methodology · Statistics 2025-03-06 Zhengke Lu , Long Feng

This paper aims at presenting a simulative analysis of the main properties of a new $R$-estimator of shape matrices in Complex Elliptically Symmetric (CES) distributed observations. First proposed by Hallin, Oja and Paindaveine for the…

Signal Processing · Electrical Eng. & Systems 2020-06-23 Stefano Fortunati , Alexandre Renaux , Frédéric Pascal

Elliptically symmetric distributions are widely used in portfolio modeling, as well as in signal processing applications for modeling impulsive background noises. Of particular interest are algorithms for covariance estimation and subspace…

Statistics Theory · Mathematics 2016-12-01 Christophe Culan , Claude Adnet

We propose a new class of robust and Fisher-consistent estimators for mixture models. These estimators can be used to construct robust model-based clustering procedures. We study in detail the case of multivariate normal mixtures and…

Methodology · Statistics 2021-06-09 Juan D. Gonzalez , Ricardo Maronna , Victor J. Yohai , Ruben H. Zamar

In many statistical signal processing applications, the estimation of nuisance parameters and parameters of interest is strongly linked to the resulting performance. Generally, these applications deal with complex data. This paper focuses…

Applications · Statistics 2016-08-24 Melanie Mahot , Philippe Forster , Frederic Pascal , Jean-Philippe Ovarlez

Analyzing large samples of high-dimensional data under dependence is a challenging statistical problem as long time series may have change points, most importantly in the mean and the marginal covariances, for which one needs valid tests.…

Methodology · Statistics 2022-11-07 Fabian Mies , Ansgar Steland

In this paper, a general class of regularized $M$-estimators of scatter matrix are proposed which are suitable also for low or insufficient sample support (small $n$ and large $p$) problems. The considered class constitutes a natural…

Applications · Statistics 2015-06-19 Esa Ollila , David E. Tyler

We propose a flexible class of models based on scale mixture of uniform distributions to construct shrinkage priors for covariance matrix estimation. This new class of priors enjoys a number of advantages over the traditional scale mixture…

Methodology · Statistics 2011-10-07 Hao Wang , Natesh S. Pillai

In this paper, we propose the application of shrinkage strategies to estimate coefficients in the Bell regression models when prior information about the coefficients is available. The Bell regression models are well-suited for modeling…

Statistics Theory · Mathematics 2024-01-03 Solmaz Seifollahi , Hossein Bevrani , Zakariya Yahya Algamal

The principal support vector machines method (Li et al., 2011) is a powerful tool for sufficient dimension reduction that replaces original predictors with their low-dimensional linear combinations without loss of information. However, the…

Machine Learning · Statistics 2019-12-02 Jun Jin , Chao Ying , Zhou Yu

This paper proposes an original approach to better understanding the behavior of robust scatter matrix $M$-estimators. Scatter matrices are of particular interest for many signal processing applications since the resulting performance…

Methodology · Statistics 2018-11-07 Gordana Draskovic , Frederic Pascal

Covariance estimation for matrix-valued data has received an increasing interest in applications. Unlike previous works that rely heavily on matrix normal distribution assumption and the requirement of fixed matrix size, we propose a class…

Methodology · Statistics 2022-04-20 Yichi Zhang , Weining Shen , Dehan Kong

This paper investigates regularized estimation of Kronecker-structured covariance matrices (CM) for polarization radar in sea clutter scenarios where the data are assumed to follow the complex, elliptically symmetric (CES) distributions…

Signal Processing · Electrical Eng. & Systems 2022-02-08 Lei Xie , Zishu He , Jun Tong , Tianle Liu , Jun Li , Jiangtao Xi

In this paper, we study robust covariance estimation under the approximate factor model with observed factors. We propose a novel framework to first estimate the initial joint covariance matrix of the observed data and the factors, and then…

Methodology · Statistics 2016-02-03 Jianqing Fan , Weichen Wang , Yiqiao Zhong

Meta-analyses frequently include trials that report multiple effect sizes based on a common set of study participants. These effect sizes will generally be correlated. Cluster-robust variance-covariance estimators are a fruitful approach…

Methodology · Statistics 2022-03-07 Thilo Welz , Wolfgang Viechtbauer , Markus Pauly