English

Representation of big data by dimension reduction

Information Theory 2017-02-02 v1 Machine Learning math.IT Machine Learning

Abstract

Suppose the data consist of a set SS of points xj,1jJx_j, 1 \leq j \leq J, distributed in a bounded domain DRND \subset R^N, where NN and JJ are large numbers. In this paper an algorithm is proposed for checking whether there exists a manifold M\mathbb{M} of low dimension near which many of the points of SS lie and finding such M\mathbb{M} if it exists. There are many dimension reduction algorithms, both linear and non-linear. Our algorithm is simple to implement and has some advantages compared with the known algorithms. If there is a manifold of low dimension near which most of the data points lie, the proposed algorithm will find it. Some numerical results are presented illustrating the algorithm and analyzing its performance compared to the classical PCA (principal component analysis) and Isomap.

Keywords

Cite

@article{arxiv.1702.00027,
  title  = {Representation of big data by dimension reduction},
  author = {A. G. Ramm and C. Van},
  journal= {arXiv preprint arXiv:1702.00027},
  year   = {2017}
}
R2 v1 2026-06-22T18:05:47.293Z