English
Related papers

Related papers: Robust subspace recovery by Tyler's M-estimator

200 papers

We assume data sampled from a mixture of d-dimensional linear subspaces with spherically symmetric distributions within each subspace and an additional outlier component with spherically symmetric distribution within the ambient space (for…

Machine Learning · Statistics 2015-07-24 Gilad Lerman , Teng Zhang

We consider the robust multi-dimensional scaling (RMDS) problem in this paper. The goal is to localize point locations from pairwise distances that may be corrupted by outliers. Inspired by classic MDS theories, and nonconvex works for the…

Machine Learning · Statistics 2025-01-07 Tong Deng , Tianming Wang

This paper aims to recover a multi-subspace matrix from permuted data: given a matrix, in which the columns are drawn from a union of low-dimensional subspaces and some columns are corrupted by permutations on their entries, recover the…

Machine Learning · Computer Science 2024-12-18 Liangqi Xie , Jicong Fan

Successful applications of sparse models in computer vision and machine learning imply that in many real-world applications, high dimensional data is distributed in a union of low dimensional subspaces. Nevertheless, the underlying…

Computer Vision and Pattern Recognition · Computer Science 2014-04-22 Xiao Bian , Hamid Krim

We investigate two important properties of M-estimator, namely, robustness and tractability, in linear regression setting, when the observations are contaminated by some arbitrary outliers. Specifically, robustness means the statistical…

Statistics Theory · Mathematics 2019-06-07 Ruizhi Zhang , Yajun Mei , Jianjun Shi , Huan Xu

We propose distributed solutions to the problem of Robust Subspace Recovery (RSR). Our setting assumes a huge dataset in an ad hoc network without a central processor, where each node has access only to one chunk of the dataset.…

Numerical Analysis · Mathematics 2018-11-07 Vahan Huroyan , Gilad Lerman

We consider the problem of robustifying high-dimensional structured estimation. Robust techniques are key in real-world applications which often involve outliers and data corruption. We focus on trimmed versions of structurally regularized…

Machine Learning · Statistics 2017-08-22 Eunho Yang , Aurelie Lozano , Aleksandr Aravkin

In this work, we address the following matrix recovery problem: suppose we are given a set of data points containing two parts, one part consists of samples drawn from a union of multiple subspaces and the other part consists of outliers.…

Information Theory · Computer Science 2014-04-01 Guangcan Liu , Huan Xu , Shuicheng Yan

Generalized Linear Models are routinely used in data analysis. The classical procedures for estimation are based on Maximum Likelihood and it is well known that the presence of outliers can have a large impact on this estimator. Robust…

Computation · Statistics 2017-10-02 Marina Valdora , Claudio Agostinelli , Victor J. Yohai

An estimated state-space model can possibly be improved by further iterations with estimation data. This contribution specifically studies if models obtained by subspace estimation can be improved by subsequent re-estimation of the B, C,…

Systems and Control · Electrical Eng. & Systems 2020-03-16 Suat Gumussoy , Ahmet Arda Ozdemir , Tomas McKelvey , Lennart Ljung , Mladen Gibanica , Rajiv Singh

In many linear inverse problems, we want to estimate an unknown vector belonging to a high-dimensional (or infinite-dimensional) space from few linear measurements. To overcome the ill-posed nature of such problems, we use a low-dimension…

Information Theory · Computer Science 2017-07-18 Yann Traonmilin , Gilles Puy , Rémi Gribonval , Mike Davies

This paper considers the problem of robustly estimating a structured covariance matrix with an elliptical underlying distribution with known mean. In applications where the covariance matrix naturally possesses a certain structure, taking…

Applications · Statistics 2016-06-29 Ying Sun , Prabhu Babu , Daniel P. Palomar

Tensor completion recovers a multi-dimensional array from a limited number of measurements. Using the recently proposed tensor ring (TR) decomposition, in this paper we show that a d-order tensor of dimensional size n and TR rank r can be…

Machine Learning · Computer Science 2020-03-17 Huyan Huang , Yipeng Liu , Ce Zhu

The advancement of sensing technology has driven the widespread application of high-dimensional data. However, issues such as missing entries during acquisition and transmission negatively impact the accuracy of subsequent tasks. Tensor…

Image and Video Processing · Electrical Eng. & Systems 2025-04-09 Jie Yang , Chang Su , Yuhan Zhang , Jianjun Zhu , Jianli Wang

We propose a neural network for unsupervised anomaly detection with a novel robust subspace recovery layer (RSR layer). This layer seeks to extract the underlying subspace from a latent representation of the given data and removes outliers…

Machine Learning · Computer Science 2022-01-19 Chieh-Hsin Lai , Dongmian Zou , Gilad Lerman

Outlier detection in a large-scale database is a significant and complex issue in knowledge discovering field. As the data distributions are obscure and uncertain in high dimensional space, most existing solutions try to solve the issue…

Artificial Intelligence · Computer Science 2014-05-06 Zhana Bao

Robust subspace estimation is fundamental to many machine learning and data analysis tasks. Iteratively Reweighted Least Squares (IRLS) is an elegant and empirically effective approach to this problem, yet its theoretical properties remain…

Machine Learning · Statistics 2026-03-11 Gilad Lerman , Kang Li , Tyler Maunu , Teng Zhang

Suppose a given observation matrix can be decomposed as the sum of a low-rank matrix and a sparse matrix (outliers), and the goal is to recover these individual components from the observed sum. Such additive decompositions have…

Machine Learning · Statistics 2010-12-07 Daniel Hsu , Sham M. Kakade , Tong Zhang

Phase retrieval in real or complex Hilbert spaces is the task of recovering a vector, up to an overall unimodular multiplicative constant, from magnitudes of linear measurements. In this paper, we assume that the vector is normalized, but…

Probability · Mathematics 2019-11-19 Dylan Domel-White , Bernhard G. Bodmann

We study the following basic machine learning task: Given a fixed set of $d$-dimensional input points for a linear regression problem, we wish to predict a hidden response value for each of the points. We can only afford to attain the…

Machine Learning · Computer Science 2018-06-07 Michał Dereziński , Manfred K. Warmuth