English
Related papers

Related papers: Learning on manifolds without manifold learning

200 papers

Semi-supervised learning has emerged as an appealing strategy to train deep models with limited supervision. Most prior literature under this learning paradigm resorts to dual-based architectures, typically composed of a teacher-student…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Martin Van Waerebeke , Gregory Lodygensky , Jose Dolz

A common belief in high-dimensional data analysis is that data are concentrated on a low-dimensional manifold. This motivates simultaneous dimension reduction and regression on manifolds. We provide an algorithm for learning gradients on…

Statistics Theory · Mathematics 2010-02-24 Sayan Mukherjee , Qiang Wu , Ding-Xuan Zhou

In the realm of robotics, numerous downstream robotics tasks leverage machine learning methods for processing, modeling, or synthesizing data. Often, this data comprises variables that inherently carry geometric constraints, such as the…

Robotics · Computer Science 2024-04-30 Noémie Jaquier , Leonel Rozo , Tamim Asfour

Recently, there has been much interest in spectral approaches to learning manifolds---so-called kernel eigenmap methods. These methods have had some successes, but their applicability is limited because they are not robust to noise. To…

Machine Learning · Computer Science 2012-06-22 Byron Boots , Geoff Gordon

In this paper, we extend the Generalized Finite Difference Method (GFDM) on unknown compact submanifolds of the Euclidean domain, identified by randomly sampled data that (almost surely) lie on the interior of the manifolds. Theoretically,…

Numerical Analysis · Mathematics 2023-07-18 Shixiao W. Jiang , Rongji Li , Qile Yan , John Harlim

Supervised manifold learning methods for data classification map data samples residing in a high-dimensional ambient space to a lower-dimensional domain in a structure-preserving way, while enhancing the separation between different classes…

Computer Vision and Pattern Recognition · Computer Science 2016-04-20 Elif Vural , Christine Guillemot

The increasing use of machine-learning (ML) enabled systems in critical tasks fuels the quest for novel verification and validation techniques yet grounded in accepted system assurance principles. In traditional system development,…

Machine Learning · Computer Science 2020-02-11 Taejoon Byun , Sanjai Rayadurgam

There has been an emerging trend in non-Euclidean statistical analysis of aiming to recover a low dimensional structure, namely a manifold, underlying the high dimensional data. Recovering the manifold requires the noise to be of certain…

Machine Learning · Statistics 2024-06-11 Zhigang Yao , Yuqing Xia

Consider an i.i.d. sample from an unknown density function supported on an unknown manifold embedded in a high dimensional Euclidean space. We tackle the problem of learning a distance between points, able to capture both the geometry of…

Probability · Mathematics 2019-12-30 Pablo Groisman , Matthieu Jonckheere , Facundo Sapienza

We are interested in derivative-free optimization of high-dimensional functions. The sample complexity of existing methods is high and depends on problem dimensionality, unlike the dimensionality-independent rates of first-order methods.…

Machine Learning · Computer Science 2020-04-28 Ozan Sener , Vladlen Koltun

This paper studies the approximation of generalized ridge functions, namely of functions which are constant along some submanifolds of $\mathbb{R}^N$. We introduce the notion of linear-sleeve functions, whose function values only depend on…

Numerical Analysis · Mathematics 2017-01-26 Sandra Keiper

We present a framework for learning probability distributions on topologically non-trivial manifolds, utilizing normalizing flows. Current methods focus on manifolds that are homeomorphic to Euclidean space, enforce strong structural priors…

Machine Learning · Computer Science 2022-07-12 Dimitris Kalatzis , Johan Ziruo Ye , Alison Pouplin , Jesper Wohlert , Søren Hauberg

The impact of convolution neural networks (CNNs) in the supervised settings provided tremendous increment in performance. The representations learned from CNN's operated on hyperspherical manifold led to insightful outcomes in face…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Lalith Bharadwaj Baru , Sai Vardhan Kanumolu , Akshay Patel Shilhora , Madhu G

Hyperspherical Prototypical Learning (HPL) is a supervised approach to representation learning that designs class prototypes on the unit hypersphere. The prototypes bias the representations to class separation in a scale invariant and known…

Machine Learning · Computer Science 2025-04-18 Martin Lindström , Borja Rodríguez-Gálvez , Ragnar Thobaben , Mikael Skoglund

In this paper, we tackle a critical issue in nonparametric inference for systems of interacting particles on Riemannian manifolds: the identifiability of the interaction functions. Specifically, we define the function spaces on which the…

Numerical Analysis · Mathematics 2024-09-11 Sui Tang , Malik Tuerkoen , Hanming Zhou

We study the machine learning task for models with operators mapping between the Wasserstein space of probability measures and a space of functions, like e.g. in mean-field games/control problems. Two classes of neural networks, based on…

Optimization and Control · Mathematics 2023-09-19 Huyên Pham , Xavier Warin

How can a reinforcement learning (RL) agent prepare to solve downstream tasks if those tasks are not known a priori? One approach is unsupervised skill discovery, a class of algorithms that learn a set of policies without access to a reward…

Machine Learning · Computer Science 2021-10-07 Benjamin Eysenbach , Ruslan Salakhutdinov , Sergey Levine

Semisupervised methods inevitably invoke some assumption that links the marginal distribution of the features to the regression function of the label. Most commonly, the cluster or manifold assumptions are used which imply that the…

Statistics Theory · Mathematics 2011-12-02 Martin Azizyan , Aarti Singh , Larry Wasserman

Although many machine learning algorithms involve learning subspaces with particular characteristics, optimizing a parameter matrix that is constrained to represent a subspace can be challenging. One solution is to use Riemannian…

Machine Learning · Computer Science 2017-03-10 Stephen Giguere , Francisco Garcia , Sridhar Mahadevan

Manifold hypotheses are typically used for tasks such as dimensionality reduction, interpolation, or improving classification performance. In the less common problem of manifold estimation, the task is to characterize the geometric…

Machine Learning · Computer Science 2019-06-19 Bharathkumar Ramachandra , Benjamin Dutton , Ranga Raju Vatsavai