English
Related papers

Related papers: List Decodable Subspace Recovery

200 papers

Subspace learning is an important problem, which has many applications in image and video processing. It can be used to find a low-dimensional representation of signals and images. But in many applications, the desired signal is heavily…

Computer Vision and Pattern Recognition · Computer Science 2017-07-13 Shervin Minaee , Yao Wang

We study the classic $k$-means/median clustering, which are fundamental problems in unsupervised learning, in the setting where data are partitioned across multiple sites, and where we are allowed to discard a small portion of the data by…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-12 Jiecao Chen , Erfan Sadeqi Azer , Qin Zhang

We consider the problem of outlier robust PCA (OR-PCA) where the goal is to recover principal directions despite the presence of outlier data points. That is, given a data matrix $M^*$, where $(1-\alpha)$ fraction of the points are noisy…

Machine Learning · Computer Science 2017-02-21 Yeshwanth Cherapanamjeri , Prateek Jain , Praneeth Netrapalli

Learning non-linear systems from noisy, limited, and/or dependent data is an important task across various scientific fields including statistics, engineering, computer science, mathematics, and many more. In general, this learning task is…

Information Theory · Computer Science 2018-11-27 Lam Si Tung Ho , Hayden Schaeffer , Giang Tran , Rachel Ward

In the problem of compressive phase retrieval, one wants to recover an approximately $k$-sparse signal $x \in \mathbb{C}^n$, given the magnitudes of the entries of $\Phi x$, where $\Phi \in \mathbb{C}^{m \times n}$. This problem has…

Information Theory · Computer Science 2020-02-19 Vasileios Nakos

Principal component analysis (PCA) is one of the most fundamental procedures in exploratory data analysis and is the basic step in applications ranging from quantitative finance and bioinformatics to image analysis and neuroscience.…

Data Structures and Algorithms · Computer Science 2019-05-13 Fedor V. Fomin , Petr A. Golovach , Fahad Panolan , Kirill Simonov

In this work we address the subspace recovery problem. Given a set of data samples (vectors) approximately drawn from a union of multiple subspaces, our goal is to segment the samples into their respective subspaces and correct the possible…

Information Theory · Computer Science 2013-01-29 Guangcan Liu , Zhouchen Lin , Shuicheng Yan , Ju Sun , Yong Yu , Yi Ma

We consider the problem of recovering signals from their power spectral density. This is a classical problem referred to in literature as the phase retrieval problem, and is of paramount importance in many fields of applied sciences. In…

Information Theory · Computer Science 2013-11-12 Kishore Jaganathan , Samet Oymak , Babak Hassibi

Many machine learning problems encode their data as a matrix with a possibly very large number of rows and columns. In several applications like neuroscience, image compression or deep reinforcement learning, the principal subspace of such…

Recovering linear subspaces from data is a fundamental and important task in statistics and machine learning. Motivated by heterogeneity in Federated Learning settings, we study a basic formulation of this problem: the principal component…

Machine Learning · Computer Science 2022-10-26 John Duchi , Vitaly Feldman , Lunjia Hu , Kunal Talwar

PCA is one of the most widely used dimension reduction techniques. A related easier problem is "subspace learning" or "subspace estimation". Given relatively clean data, both are easily solved via singular value decomposition (SVD). The…

Information Theory · Computer Science 2020-06-25 Namrata Vaswani , Thierry Bouwmans , Sajid Javed , Praneeth Narayanamurthy

This paper proposes a framework for simultaneous dimensionality reduction and regression in the presence of outliers in data by applying low-rank and sparse matrix decomposition. For multivariate data corrupted with outliers, it is…

Signal Processing · Electrical Eng. & Systems 2024-07-10 Farwa Abbas , Hussain Ahmad

Learning from previously collected datasets of expert data offers the promise of acquiring robotic policies without unsafe and costly online explorations. However, a major challenge is a distributional shift between the states in the…

Machine Learning · Computer Science 2022-07-19 Alfredo Reichlin , Giovanni Luca Marchetti , Hang Yin , Ali Ghadirzadeh , Danica Kragic

We consider the problem of finding the matching map between two sets of $d$-dimensional noisy feature-vectors. The distinctive feature of our setting is that we do not assume that all the vectors of the first set have their corresponding…

Statistics Theory · Mathematics 2023-03-10 Arshak Minasyan , Tigran Galstyan , Sona Hunanyan , Arnak Dalalyan

Subspace clustering is the problem of clustering data that lie close to a union of linear subspaces. In the abstract form of the problem, where no noise or other corruptions are present, the data are assumed to lie in general position…

Computer Vision and Pattern Recognition · Computer Science 2020-02-13 Manolis C. Tsakiris , Rene Vidal

In the paper, we propose an analytical and numerical approach to identify scalar parameters (coefficients, orders of fractional derivatives) in the multi-term fractional differential operator in time, $\mathbf{D}_t$. To this end, we analyze…

Analysis of PDEs · Mathematics 2026-04-07 Andrii Hulianytskyi , Sergei Pereverzyev , Sergii Siryk , Nataliya Vasylyeva

List recovery is a fundamental task for error-correcting codes, vastly generalizing unique decoding from worst-case errors and list decoding. Briefly, one is given ''soft information'' in the form of input lists S_1,...,S_n of bounded size,…

Information Theory · Computer Science 2025-10-10 Nicolas Resch , S. Venkitesh

Given a real-valued function $f$ defined over a manifold $M$ embedded in $\mathbb{R}^d$, we are interested in recovering structural information about $f$ from the sole information of its values on a finite sample $P$. Existing methods…

Computational Geometry · Computer Science 2015-04-08 Mickaël Buchet , Frédéric Chazal , Tamal K. Dey , Fengtao Fan , Steve Y. Oudot , Yusu Wang

The population recovery problem asks one to recover an unknown distribution over $n$-bit strings given access to independent noisy samples of strings drawn from the distribution. Recently, Ban et al. [BCF+19] studied the problem where the…

Data Structures and Algorithms · Computer Science 2020-11-05 Shyam Narayanan

We assume i.i.d. data sampled from a mixture distribution with K components along fixed d-dimensional linear subspaces and an additional outlier component. For p>0, we study the simultaneous recovery of the K fixed subspaces by minimizing…

Machine Learning · Statistics 2015-03-19 Gilad Lerman , Teng Zhang