English
Related papers

Related papers: Supervised Manifold Learning via Random Forest Geo…

200 papers

Dimensionality reduction methods are employed to decrease data dimensionality, either to enhance machine learning performance or to facilitate data visualization in two or three-dimensional spaces. These methods typically fall into two…

Machine Learning · Computer Science 2025-08-26 Berat Dogan

We analyze the performance of a class of manifold-learning algorithms that find their output by minimizing a quadratic form under some normalization constraints. This class consists of Locally Linear Embedding (LLE), Laplacian Eigenmap,…

Machine Learning · Statistics 2008-06-17 Y. Goldberg , A. Zakai , D. Kushnir , Y. Ritov

An ultimate objective in continual learning is to preserve knowledge learned in preceding tasks while learning new tasks. To mitigate forgetting prior knowledge, we propose a novel knowledge distillation technique that takes into the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Kaushik Roy , Christian Simon , Peyman Moghadam , Mehrtash Harandi

Motion planning with constraints is an important part of many real-world robotic systems. In this work, we study manifold learning methods to learn such constraints from data. We explore two methods for learning implicit constraint…

This work proposes an algorithm for explicitly constructing a pair of neural networks that linearize and reconstruct an embedded submanifold, from finite samples of this manifold. Our such-generated neural networks, called Flattening…

Machine Learning · Computer Science 2023-09-11 Michael Psenka , Druv Pai , Vishal Raman , Shankar Sastry , Yi Ma

Recently, there has been much interest in spectral approaches to learning manifolds---so-called kernel eigenmap methods. These methods have had some successes, but their applicability is limited because they are not robust to noise. To…

Machine Learning · Computer Science 2012-06-22 Byron Boots , Geoff Gordon

Unsupervised representation learning (URL), which learns compact embeddings of high-dimensional data without supervision, has made remarkable progress recently. However, the development of URLs for different requirements is independent,…

Machine Learning · Computer Science 2024-04-18 Siyuan Li , Zicheng Liu , Zelin Zang , Di Wu , Zhiyuan Chen , Stan Z. Li

We introduce a data-driven approach to building reduced dynamical models through manifold learning; the reduced latent space is discovered using Diffusion Maps (a manifold learning technique) on time series data. A second round of Diffusion…

We present a generative learning framework for probabilistic sampling based on an extension of the Probabilistic Learning on Manifolds (PLoM) approach, which is designed to generate statistically consistent realizations of a random vector…

Machine Learning · Statistics 2025-06-04 Dimitris G Giovanis , Nikolaos Evangelou , Ioannis G Kevrekidis , Roger G Ghanem

Diffusion Maps framework is a kernel based method for manifold learning and data analysis that defines diffusion similarities by imposing a Markovian process on the given dataset. Analysis by this process uncovers the intrinsic geometric…

Machine Learning · Statistics 2015-11-20 Moshe Salhov , Amit Bermanis , Guy Wolf , Amir Averbuch

How can we design neural networks that allow for stable universal approximation of maps between topologically interesting manifolds? The answer is with a coordinate projection. Neural networks based on topological data analysis (TDA) use…

Machine Learning · Computer Science 2022-10-04 Michael Puthawala , Matti Lassas , Ivan Dokmanic , Pekka Pankka , Maarten de Hoop

In this paper we consider the problem of semi-supervised learning with deep Convolutional Neural Networks (ConvNets). Semi-supervised learning is motivated on the observation that unlabeled data is cheap and can be used to improve the…

Computer Vision and Pattern Recognition · Computer Science 2016-06-13 Mehdi Sajjadi , Mehran Javanmardi , Tolga Tasdizen

Manifold learning builds on the "manifold hypothesis," which posits that data in high-dimensional datasets are drawn from lower-dimensional manifolds. Current tools generate global embeddings of data, rather than the local maps used to…

Machine Learning · Computer Science 2025-08-28 Serena Hughes , Timothy Hamilton , Tom Kolokotrones , Eric J. Deeds

Extensive research has produced robust methods for unsupervised data visualization. Yet supervised visualization$\unicode{x2013}$where expert labels guide representations$\unicode{x2013}$remains underexplored, as most supervised approaches…

Machine Learning · Computer Science 2025-05-20 Adrien Aumon , Shuang Ni , Myriam Lizotte , Guy Wolf , Kevin R. Moon , Jake S. Rhodes

We propose a novel method of introducing structure into existing machine learning techniques by developing structure-based similarity and distance measures. To learn structural information, low-dimensional structure of the data is captured…

Machine Learning · Statistics 2011-10-27 Joseph Wang , Venkatesh Saligrama , David A. Castañón

Research on manifold learning within a density ridge estimation framework has shown great potential in recent work for both estimation and de-noising of manifolds, building on the intuitive and well-defined notion of principal curves and…

Machine Learning · Statistics 2016-04-11 Jonas Nordhaug Myhre , Matineh Shaker , Devrim Kaba , Robert Jenssen , Deniz Erdogmus

System identification has greatly benefited from deep learning techniques, particularly for modeling complex, nonlinear dynamical systems with partially unknown physics where traditional approaches may not be feasible. However, deep…

Machine Learning · Computer Science 2025-04-17 Marco Forgione , Ankush Chakrabarty , Dario Piga , Matteo Rufolo , Alberto Bemporad

Recent advances in diffusion-based generative modeling have demonstrated significant promise in tackling long-horizon, sparse-reward tasks by leveraging offline datasets. While these approaches have achieved promising results, their…

Machine Learning · Computer Science 2025-06-03 Kyowoon Lee , Jaesik Choi

Invoking the manifold assumption in machine learning requires knowledge of the manifold's geometry and dimension, and theory dictates how many samples are required. However, in applications data are limited, sampling may not be uniform, and…

Machine Learning · Computer Science 2023-03-02 Luciano Dyballa , Steven W. Zucker

Recent advances suggest that encoding images through Symmetric Positive Definite (SPD) matrices and then interpreting such matrices as points on Riemannian manifolds can lead to increased classification performance. Taking into account…

Computer Vision and Pattern Recognition · Computer Science 2014-08-27 Azadeh Alavi , Arnold Wiliem , Kun Zhao , Brian C. Lovell , Conrad Sanderson