English
Related papers

Related papers: Robust Parameter Estimation for the Lee-Carter Fam…

200 papers

We provide a new computationally-efficient class of estimators for risk minimization. We show that these estimators are robust for general statistical models: in the classical Huber epsilon-contamination model and in heavy-tailed settings.…

Machine Learning · Statistics 2018-04-23 Adarsh Prasad , Arun Sai Suggala , Sivaraman Balakrishnan , Pradeep Ravikumar

Missing Not At Random (MNAR) values lead to significant biases in the data, since the probability of missingness depends on the unobserved values.They are ''not ignorable'' in the sense that they often require defining a model for the…

Statistics Theory · Mathematics 2020-06-11 Aude Sportisse , Claire Boyer , Julie Josse

We study the fundamental problem of Principal Component Analysis in a statistical distributed setting in which each machine out of $m$ stores a sample of $n$ points sampled i.i.d. from a single unknown distribution. We study algorithms for…

Machine Learning · Computer Science 2017-02-28 Dan Garber , Ohad Shamir , Nathan Srebro

Several researchers have described two-part models with patient-specific stochastic processes for analysing longitudinal semicontinuous data. In theory, such models can offer greater flexibility than the standard two-part model with…

Applications · Statistics 2017-03-28 Sean Yiu , Brian Tom

We discuss the problem of estimating the number of principal components in Principal Com- ponents Analysis (PCA). Despite of the importance of the problem and the multitude of solutions proposed in the literature, it comes as a surprise…

Methodology · Statistics 2016-07-06 Piotr Sobczyk , Malgorzata Bogdan , Julie Josse

Functional data analysis is a fast evolving branch of statistics. Estimation procedures for the popular functional linear model either suffer from lack of robustness or are computationally burdensome. To address these shortcomings, a…

Methodology · Statistics 2021-08-27 Ioannis Kalogridis , Stefan Van Aelst

In this paper we propose a novel optimization framework to systematically solve robust PCA problem with rigorous theoretical guarantee, based on which we investigate very computationally economic updating algorithms.

Machine Learning · Computer Science 2021-11-25 Kai Liu , Yarui Cao

The Classical Tukey-Huber Contamination Model (CCM) is a usual framework to describe the mechanism of outliers generation in robust statistics. In a data set with $n$ observations and $p$ variables, under the CCM, an outlier is a unit, even…

Statistics Theory · Mathematics 2014-07-15 Claudio Agostinelli , Victor J. Yohai

When modeling multivariate data, one might have an extra parameter of contextual information that could be used to treat some observations as more similar to others. For example, images of faces can vary by age, and one would expect the…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Ajay Gupta , Adrian Barbu

In a longitudinal metabolomics study, multiple metabolites are measured from several observations at many time points. Interest lies in reducing the dimensionality of such data and in highlighting influential metabolites which change over…

Applications · Statistics 2013-12-10 Gift Nyamundanda , Isobel Claire Gormley , Lorraine Brennan

Efficient representations of data are essential for processing, exploration, and human understanding, and Principal Component Analysis (PCA) is one of the most common dimensionality reduction techniques used for the analysis of large,…

Computation · Statistics 2023-11-06 Olga Dorabiala , Aleksandr Aravkin , J. Nathan Kutz

This paper investigates the intrinsic group structures within the framework of large-dimensional approximate factor models, which portrays homogeneous effects of the common factors on the individuals that fall into the same group. To this…

Methodology · Statistics 2025-03-18 Yong He , Dong Liu , Guangming Pan , Yiming Wang

In this article we investigate a state-space representation of the Lee-Carter model which is a benchmark stochastic mortality model for forecasting age-specific death rates. Existing relevant literature focuses mainly on mortality…

Computational Finance · Quantitative Finance 2015-08-04 Man Chung Fung , Gareth W. Peters , Pavel V. Shevchenko

This article studies the robustness of the eigenvalue ordering, an important issue when estimating the leading eigen-subspace by principal component analysis (PCA). In Yata and Aoshima (2010), cross-data-matrix PCA (CDM-PCA) was proposed…

Methodology · Statistics 2025-03-24 Hung Hung , Su-Yun Huang

Recent developments in system identification have brought attention to regularized kernel-based methods. This type of approach has been proven to compare favorably with classic parametric methods. However, current formulations are not…

Systems and Control · Computer Science 2016-11-25 Giulio Bottegal , Aleksandr Y. Aravkin , Håkan Hjalmarsson , Gianluigi Pillonetto

Sequential or online dimensional reduction is of interests due to the explosion of streaming data based applications and the requirement of adaptive statistical modeling, in many emerging fields, such as the modeling of energy end-use…

Machine Learning · Statistics 2014-07-17 Zhaoyi Kang , Costas J. Spanos

Robust estimation approaches are of fundamental importance for statistical modelling. To reduce susceptibility to outliers, we propose a robust estimation procedure with t-process under functional ANOVA model. Besides common mean structure…

Methodology · Statistics 2018-12-19 Chen Zhang , Zimu Chen , Zhanfeng Wang , Yaohua Wu

Principal component analysis (PCA) is a fundamental tool in multivariate statistics, yet its sensitivity to outliers and limitations in distributed environments restrict its effectiveness in modern large-scale applications. To address these…

Methodology · Statistics 2025-10-16 Hung Hung , Zhi-Yu Jou , Su-Yun Huang , Shinto Eguchi

Factor Analysis based on multivariate $t$ distribution ($t$fa) is a useful robust tool for extracting common factors on heavy-tailed or contaminated data. However, $t$fa is only applicable to vector data. When $t$fa is applied to matrix…

Machine Learning · Statistics 2024-01-05 Xuan Ma , Jianhua Zhao , Changchun Shang , Fen Jiang , Philip L. H. Yu

Robust inferential methods based on divergences measures have shown an appealing trade-off between efficiency and robustness in many different statistical models. In this paper, minimum density power divergence estimators (MDPDEs) for the…

Statistics Theory · Mathematics 2023-12-06 A. Felipe , M. Jaenada , P. Miranda , L. Pardo