English

Multidimensional Scaling, Sammon Mapping, and Isomap: Tutorial and Survey

Machine Learning 2020-09-18 v1 Computer Vision and Pattern Recognition Machine Learning

Abstract

Multidimensional Scaling (MDS) is one of the first fundamental manifold learning methods. It can be categorized into several methods, i.e., classical MDS, kernel classical MDS, metric MDS, and non-metric MDS. Sammon mapping and Isomap can be considered as special cases of metric MDS and kernel classical MDS, respectively. In this tutorial and survey paper, we review the theory of MDS, Sammon mapping, and Isomap in detail. We explain all the mentioned categories of MDS. Then, Sammon mapping, Isomap, and kernel Isomap are explained. Out-of-sample embedding for MDS and Isomap using eigenfunctions and kernel mapping are introduced. Then, Nystrom approximation and its use in landmark MDS and landmark Isomap are introduced for big data embedding. We also provide some simulations for illustrating the embedding by these methods.

Keywords

Cite

@article{arxiv.2009.08136,
  title  = {Multidimensional Scaling, Sammon Mapping, and Isomap: Tutorial and Survey},
  author = {Benyamin Ghojogh and Ali Ghodsi and Fakhri Karray and Mark Crowley},
  journal= {arXiv preprint arXiv:2009.08136},
  year   = {2020}
}

Comments

To appear as a part of an upcoming academic book on dimensionality reduction and manifold learning

R2 v1 2026-06-23T18:36:27.004Z