English
Related papers

Related papers: Probabilistic Recovery of Multiple Subspaces in Po…

200 papers

For a certain class of distributions, we prove that the linear programming relaxation of $k$-medoids clustering---a variant of $k$-means clustering where means are replaced by exemplars from within the dataset---distinguishes points drawn…

Machine Learning · Statistics 2014-02-04 Abhinav Nellore , Rachel Ward

Outlier feature matches and loop-closures that survived front-end data association can lead to catastrophic failures in the back-end optimization of large-scale point cloud based 3D reconstruction. To alleviate this problem, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2019-05-24 Ziquan Lan , Zi Jian Yew , Gim Hee Lee

The joint sparse recovery problem is a generalization of the single measurement vector problem which is widely studied in Compressed Sensing and it aims to recovery a set of jointly sparse vectors. i.e. have nonzero entries concentrated at…

Information Theory · Computer Science 2017-01-10 Changlong Wang , Jigen Peng

In high-dimensional statistics, variable selection recovers the latent sparse patterns from all possible covariate combinations. This paper proposes a novel optimization method to solve the exact L0-regularized regression problem, which is…

Methodology · Statistics 2022-06-02 Mingzhang Yin , Nhat Ho , Bowei Yan , Xiaoning Qian , Mingyuan Zhou

We study the following basic machine learning task: Given a fixed set of $d$-dimensional input points for a linear regression problem, we wish to predict a hidden response value for each of the points. We can only afford to attain the…

Machine Learning · Computer Science 2018-06-07 Michał Dereziński , Manfred K. Warmuth

We consider the problem of recovering elements of a low-dimensional model from linear measurements. From signal and image processing to inverse problems in data science, this question has been at the center of many applications. Lately,…

Signal Processing · Electrical Eng. & Systems 2025-05-15 Yann Traonmilin , Jean François Aujol , Antoine Guennec

The problem of finding suitable point embedding or geometric configurations given only Euclidean distance information of point pairs arises both as a core task and as a sub-problem in a variety of machine learning applications. In this…

Machine Learning · Computer Science 2024-10-23 Ipsita Ghosh , Abiy Tasissa , Christian Kümmerle

Dimension reduction algorithms are a crucial part of many data science pipelines, including data exploration, feature creation and selection, and denoising. Despite their wide utilization, many non-linear dimension reduction algorithms are…

Machine Learning · Statistics 2024-08-06 Ryan Murray , Adam Pickarski

Lower dimensional signal representation schemes frequently assume that the signal of interest lies in a single vector space. In the context of the recently developed theory of compressive sensing (CS), it is often assumed that the signal of…

Information Theory · Computer Science 2014-03-18 Thakshila Wimalajeewa , Yonina C. Eldar , Pramod K. Varshney

We give a dimensionality reduction procedure to approximate the sum of distances of a given set of $n$ points in $R^d$ to any "shape" that lies in a $k$-dimensional subspace. Here, by "shape" we mean any set of points in $R^d$. Our…

Data Structures and Algorithms · Computer Science 2021-06-25 Zhili Feng , Praneeth Kacham , David P. Woodruff

We introduce the {\it diffusion $K$-means} clustering method on Riemannian submanifolds, which maximizes the within-cluster connectedness based on the diffusion distance. The diffusion $K$-means constructs a random walk on the similarity…

Statistics Theory · Mathematics 2020-03-17 Xiaohui Chen , Yun Yang

In this paper, we present a method for denoising and reconstruction of low-dimensional manifold in high-dimensional space. We suggest a multidimensional extension of the Locally Optimal Projection algorithm which was introduced by Lipman et…

Numerical Analysis · Mathematics 2022-11-17 Shira Faigenbaum-Golovin , David Levin

Point cloud is a collection of 3D coordinates that are discrete geometric samples of an object's 2D surfaces. Imperfection in the acquisition process means that point clouds are often corrupted with noise. Building on recent advances in…

Signal Processing · Electrical Eng. & Systems 2018-12-20 Chinthaka Dinesh , Gene Cheung , Ivan V. Bajic

In this paper, we investigate the problem of recovering the frequency components of a mixture of $K$ complex sinusoids from a random subset of $N$ equally-spaced time-domain samples. Because of the random subset, the samples are effectively…

Signal Processing · Electrical Eng. & Systems 2023-11-10 Mohammad Bokaei , Saeed Razavikia , Stefano Rini , Arash Amini , Hamid Behrouzi

We consider the problem of estimating the discrete clustering structures under the Sub-Gaussian Mixture Model. Our main results establish a hidden integrality property of a semidefinite programming (SDP) relaxation for this problem: while…

Machine Learning · Statistics 2021-10-05 Yingjie Fei , Yudong Chen

This paper concerns the minimax center of a collection of linear subspaces. When the subspaces are $k$-dimensional subspaces of $\mathbb{R}^n$, this can be cast as finding the center of a minimum enclosing ball on a Grassmann manifold,…

Machine Learning · Computer Science 2020-03-30 Timothy Marrinan , P. -A. Absil , Nicolas Gillis

We study the non-convex optimization landscape for maximum likelihood estimation in the discrete orbit recovery model with Gaussian noise. This model is motivated by applications in molecular microscopy and image processing, where each…

Statistics Theory · Mathematics 2021-03-02 Zhou Fan , Yi Sun , Tianhao Wang , Yihong Wu

Point clouds have been recognized as a crucial data structure for 3D content and are essential in a number of applications such as virtual and mixed reality, autonomous driving, cultural heritage, etc. In this paper, we propose a set of…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Maurice Quach , Giuseppe Valenzise , Frederic Dufaux

Robust subspace estimation is fundamental to many machine learning and data analysis tasks. Iteratively Reweighted Least Squares (IRLS) is an elegant and empirically effective approach to this problem, yet its theoretical properties remain…

Machine Learning · Statistics 2026-03-11 Gilad Lerman , Kang Li , Tyler Maunu , Teng Zhang

We study the problem of reconstructing a block-sparse signal from compressively sampled measurements. In certain applications, in addition to the inherent block-sparse structure of the signal, some prior information about the block support,…

Information Theory · Computer Science 2019-02-25 Sajad Daei , Farzan Haddadi , Arash Amini