English
Related papers

Related papers: Estimation of Algebraic Sets: Extending PCA Beyond…

200 papers

Probabilistic Component Latent Analysis (PLCA) is a statistical modeling method for feature extraction from non-negative data. It has been fruitfully applied to various research fields of information retrieval. However, the EM-solved…

Methodology · Statistics 2017-03-16 D. Cazau , G. Nuel

We present a new algorithm for Independent Component Analysis (ICA) which has provable performance guarantees. In particular, suppose we are given samples of the form $y = Ax + \eta$ where $A$ is an unknown $n \times n$ matrix and $x$ is a…

Machine Learning · Computer Science 2012-11-13 Sanjeev Arora , Rong Ge , Ankur Moitra , Sushant Sachdeva

We consider the problem of fitting a set of points in Euclidean space by an algebraic hypersurface. We assume that points on a true hypersurface, described by a polynomial equation, are corrupted by zero mean independent Gaussian noise, and…

Computation · Statistics 2015-08-21 Konstantin Usevich , Ivan Markovsky

We consider the problem of positioning a cloud of points in the Euclidean space $\mathbb{R}^d$, using noisy measurements of a subset of pairwise distances. This task has applications in various areas, such as sensor network localization and…

Statistics Theory · Mathematics 2012-11-22 Adel Javanmard , Andrea Montanari

We show how to solve a number of problems in numerical linear algebra, such as least squares regression, $\ell_p$-regression for any $p \geq 1$, low rank approximation, and kernel regression, in time $T(A) \poly(\log(nd))$, where for a…

Machine Learning · Computer Science 2019-12-13 Xiaofei Shi , David P. Woodruff

Identifying low-dimensional latent structures within high-dimensional data has long been a central topic in the machine learning community, driven by the need for data compression, storage, transmission, and deeper data understanding.…

Machine Learning · Statistics 2025-03-28 Ye Tian , Sanyou Wu , Long Feng

Recovering an unknown complex signal from the magnitude of linear combinations of the signal is referred to as phase retrieval. We present an exact performance analysis of a recently proposed convex-optimization-formulation for this…

Information Theory · Computer Science 2018-01-23 Fariborz Salehi , Ehsan Abbasi , Babak Hassibi

Semi-algebraic set is a subset of the real space defined by polynomial equations and inequalities. In this paper, we consider the problem of deciding whether two given points in a semi-algebraic set are connected. We restrict to the case…

Symbolic Computation · Computer Science 2024-06-13 Cordian Riener , Robin Schabert , Thi Xuan Vu

The truncated moment problem consists of determining whether a given finitedimensional vector of real numbers y is obtained by integrating a basis of the vector space of polynomials of bounded degree with respect to a non-negative measure…

Algebraic Geometry · Mathematics 2023-02-15 Didier Henrion , Simone Naldi , Mohab Safey El Din

Decomposing an algebraic variety into irreducible or equidimensional components is a fundamental task in classical algebraic geometry and has various applications in modern geometry engineering. Several researchers studied the problem and…

Commutative Algebra · Mathematics 2010-12-07 Zhenyi Ji , Yongbin Li

The problem of recovering a matrix of low rank from an incomplete and possibly noisy set of linear measurements arises in a number of areas. In order to derive rigorous recovery results, the measurement map is usually modeled…

Information Theory · Computer Science 2015-07-28 Maryia Kabanava , Richard Kueng , Holger Rauhut , Ulrich Terstiege

In this paper we study the matrix completion problem: Suppose $X \in {\mathbb R}^{n_r \times n_c}$ is unknown except for a known upper bound $r$ on its rank. By measuring a small number $m \ll n_r n_c$ of elements of $X$, is it possible to…

Machine Learning · Statistics 2020-05-22 Shantanu Prasad Burnwal , Mathukumalli Vidyasagar

Principal component analysis (PCA) is a well-known tool in multivariate statistics. One significant challenge in using PCA is the choice of the number of components. In order to address this challenge, we propose an exact distribution-based…

Methodology · Statistics 2015-06-02 Yunjin Choi , Jonathan Taylor , Robert Tibshirani

We consider the problem of approximating the reachable set of a discrete-time polynomial system from a semialgebraic set of initial conditions under general semialgebraic set constraints. Assuming inclusion in a given simple set like a box…

Optimization and Control · Mathematics 2019-06-06 Victor Magron , Pierre-Loic Garoche , Didier Henrion , Xavier Thirioux

This paper focuses on the noiseless complete dictionary learning problem, where the goal is to represent a set of given signals as linear combinations of a small number of atoms from a learned dictionary. There are two main challenges faced…

Machine Learning · Computer Science 2025-03-06 Geyu Liang , Gavin Zhang , Salar Fattahi , Richard Y. Zhang

A procedure and theoretical results are presented for the problem of determining a minimal robust positively invariant (RPI) set for a linear discrete-time system subject to unknown, bounded disturbances. The procedure computes, via the…

Systems and Control · Computer Science 2016-07-22 Paul Trodden

In many applications we seek to recover signals from linear measurements far fewer than the ambient dimension, given the signals have exploitable structures such as sparse vectors or low rank matrices. In this paper we work in a general…

Information Theory · Computer Science 2023-11-14 Xuemei Chen

This paper introduces a Projected Principal Component Analysis (Projected-PCA), which employs principal component analysis to the projected (smoothed) data matrix onto a given linear space spanned by covariates. When it applies to…

Methodology · Statistics 2016-01-18 Jianqing Fan , Yuan Liao , Weichen Wang

We derive efficient algorithms for coarse approximation of algebraic hypersurfaces, useful for estimating the distance between an input polynomial zero set and a given query point. Our methods work best on sparse polynomials of high degree…

Algebraic Geometry · Mathematics 2013-12-24 Eleanor Anthony , Sheridan Grant , Peter Gritzmann , J. Maurice Rojas

On the heels of compressed sensing, a remarkable new field has very recently emerged. This field addresses a broad range of problems of significant practical interest, namely, the recovery of a data matrix from what appears to be…

Information Theory · Computer Science 2009-03-19 Emmanuel J. Candes , Yaniv Plan