English
Related papers

Related papers: Robust subspace recovery by Tyler's M-estimator

200 papers

We consider a fundamental problem in unsupervised learning called \emph{subspace recovery}: given a collection of $m$ points in $\mathbb{R}^n$, if many but not necessarily all of these points are contained in a $d$-dimensional subspace $T$…

Computational Complexity · Computer Science 2013-12-05 Moritz Hardt , Ankur Moitra

This work analyzes the subspace-constrained Tyler's estimator (STE), a method designed to recover a low-dimensional subspace from a dataset that may be heavily corrupted by outliers. The STE has previously been shown to be competitive for…

Statistics Theory · Mathematics 2025-12-09 Gilad Lerman , Teng Zhang

This paper will serve as an introduction to the body of work on robust subspace recovery. Robust subspace recovery involves finding an underlying low-dimensional subspace in a dataset that is possibly corrupted with outliers. While this…

Machine Learning · Computer Science 2018-11-07 Gilad Lerman , Tyler Maunu

We present the subspace-constrained Tyler's estimator (STE) designed for recovering a low-dimensional subspace within a dataset that may be highly corrupted with outliers. STE is a fusion of the Tyler's M-estimator (TME) and a variant of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Feng Yu , Teng Zhang , Gilad Lerman

We study the basic problem of robust subspace recovery. That is, we assume a data set that some of its points are sampled around a fixed subspace and the rest of them are spread in the whole ambient space, and we aim to recover the fixed…

Machine Learning · Statistics 2015-03-19 Teng Zhang , Gilad Lerman

This work presents a fast and non-convex algorithm for robust subspace recovery. The data sets considered include inliers drawn around a low-dimensional subspace of a higher dimensional ambient space, and a possibly large portion of…

Machine Learning · Computer Science 2018-11-07 Gilad Lerman , Tyler Maunu

Learning from data in the presence of outliers is a fundamental problem in statistics. In this work, we study robust statistics in the presence of overwhelming outliers for the fundamental problem of subspace recovery. Given a dataset where…

Data Structures and Algorithms · Computer Science 2020-02-11 Prasad Raghavendra , Morris Yau

Consider a dataset of vector-valued observations that consists of noisy inliers, which are explained well by a low-dimensional subspace, along with some number of outliers. This work describes a convex optimization problem, called REAPER,…

Information Theory · Computer Science 2015-07-24 Gilad Lerman , Michael McCoy , Joel A. Tropp , Teng Zhang

We study the problem of robust subspace recovery (RSR) in the presence of adversarial outliers. That is, we seek a subspace that contains a large portion of a dataset when some fraction of the data points are arbitrarily corrupted. We first…

Machine Learning · Computer Science 2019-04-09 Tyler Maunu , Gilad Lerman

Rare data in a large-scale database are called outliers that reveal significant information in the real world. The subspace-based outlier detection is regarded as a feasible approach in very high dimensional space. However, the outliers…

Artificial Intelligence · Computer Science 2014-05-06 Zhana Bao

We assume i.i.d. data sampled from a mixture distribution with K components along fixed d-dimensional linear subspaces and an additional outlier component. For p>0, we study the simultaneous recovery of the K fixed subspaces by minimizing…

Machine Learning · Statistics 2015-03-19 Gilad Lerman , Teng Zhang

The statistical problem of estimating the effective dimension-reduction (EDR) subspace in the multi-index regression model with deterministic design and additive noise is considered. A new procedure for recovering the directions of the EDR…

Statistics Theory · Mathematics 2007-06-13 Arnak Dalalyan , Anatoly Juditsky , Vladimir Spokoiny

We consider the problem of simultaneously finding lower-dimensional subspace structures in a given $m$-tuple of possibly corrupted, high-dimensional data sets all of the same size. We refer to this problem as simultaneous robust subspace…

Representation Theory · Mathematics 2022-02-22 Calin Chindris , Daniel Kline

In this work we address the subspace recovery problem. Given a set of data samples (vectors) approximately drawn from a union of multiple subspaces, our goal is to segment the samples into their respective subspaces and correct the possible…

Information Theory · Computer Science 2013-01-29 Guangcan Liu , Zhouchen Lin , Shuicheng Yan , Ju Sun , Yong Yu , Yi Ma

The subspace approximation problem with outliers, for given $n$ points in $d$ dimensions $x_{1},\ldots, x_{n} \in R^{d}$, an integer $1 \leq k \leq d$, and an outlier parameter $0 \leq \alpha \leq 1$, is to find a $k$-dimensional linear…

Computational Geometry · Computer Science 2020-07-01 Amit Deshpande , Rameshwar Pratap

Traditional sampling theories consider the problem of reconstructing an unknown signal $x$ from a series of samples. A prevalent assumption which often guarantees recovery from the given measurements is that $x$ lies in a known subspace.…

Cellular Automata and Lattice Gases · Physics 2009-03-30 Yonina C. Eldar , Moshe Mishali

Modern data sets, such as those in healthcare and e-commerce, are often derived from many individuals or systems but have insufficient data from each source alone to separately estimate individual, often high-dimensional, model parameters.…

Machine Learning · Computer Science 2024-11-14 Maryann Rui , Thibaut Horel , Munther Dahleh

This paper considers the approximate reconstruction of points, x \in R^D, which are close to a given compact d-dimensional submanifold, M, of R^D using a small number of linear measurements of x. In particular, it is shown that a number of…

Information Theory · Computer Science 2012-04-17 Mark A. Iwen , Mauro Maggioni

$3$D structure recovery from a collection of $2$D images requires the estimation of the camera locations and orientations, i.e. the camera motion. For large, irregular collections of images, existing methods for the location estimation…

Computer Vision and Pattern Recognition · Computer Science 2015-06-05 Onur Ozyesil , Amit Singer

In this paper, we analyse the recovery properties of nonconvex regularized $M$-estimators, under the assumption that the true parameter is of soft sparsity. In the statistical aspect, we establish the recovery bound for any stationary point…

Statistics Theory · Mathematics 2019-11-20 Xin Li , Dongya Wu , Chong Li , Jinhua Wang , Jen-Chih Yao
‹ Prev 1 2 3 10 Next ›