English
Related papers

Related papers: Autoencoders for a manifold learning problem with …

200 papers

Analyzing high-dimensional data with manifold learning algorithms often requires searching for the nearest neighbors of all observations. This presents a computational bottleneck in statistical manifold learning when observations of…

Machine Learning · Computer Science 2022-03-11 Fan Cheng , Anastasios Panagiotelis , Rob J Hyndman

High dimensional data is often assumed to be concentrated on or near a low-dimensional manifold. Autoencoders (AE) is a popular technique to learn representations of such data by pushing it through a neural network with a low dimension…

Machine Learning · Computer Science 2020-10-06 Amos Gropp , Matan Atzmon , Yaron Lipman

The problem of extending a function $f$ defined on a training data $\mathcal{C}$ on an unknown manifold $\mathbb{X}$ to the entire manifold and a tubular neighborhood of this manifold is considered in this paper. For $\mathbb{X}$ embedded…

Machine Learning · Computer Science 2016-07-26 Charles K. Chui , H. N. Mhaskar

Measuring the similarity between data points often requires domain knowledge, which can in parts be compensated by relying on unsupervised methods such as latent-variable models, where similarity/distance is estimated in a more compact…

Machine Learning · Statistics 2020-08-13 Nutan Chen , Alexej Klushyn , Francesco Ferroni , Justin Bayer , Patrick van der Smagt

Complex systems manifest a small number of instabilities and bifurcations that are canonical in nature, resulting in universal pattern forming characteristics as a function of some parametric dependence. Such parametric instabilities are…

Machine Learning · Computer Science 2021-06-10 Manu Kalia , Steven L. Brunton , Hil G. E. Meijer , Christoph Brune , J. Nathan Kutz

It is established that the existence of non-isotropic vector field which Jacobi operator of maximal rank is an obstacle for the existence of non-trivial second-order symmetric parallel tensor field. In turns out that presence of such…

Differential Geometry · Mathematics 2018-10-16 Piotr Dacko

Given a "data manifold" $M\subset \mathbb{R}^n$ and "latent space" $\mathbb{R}^\ell$, an autoencoder is a pair of continuous maps consisting of an "encoder" $E\colon \mathbb{R}^n\to \mathbb{R}^\ell$ and "decoder" $D\colon \mathbb{R}^\ell\to…

Machine Learning · Computer Science 2025-11-12 Matthew D. Kvalheim , Eduardo D. Sontag

Constant-curvature Riemannian manifolds (CCMs) have been shown to be ideal embedding spaces in many application domains, as their non-Euclidean geometry can naturally account for some relevant properties of data, like hierarchy and…

Machine Learning · Computer Science 2019-05-27 Daniele Grattarola , Lorenzo Livi , Cesare Alippi

Deep generative models have made tremendous advances in image and signal representation learning and generation. These models employ the full Euclidean space or a bounded subset as the latent space, whose flat geometry, however, is often…

Machine Learning · Computer Science 2020-08-17 Stefan Schonsheck , Jie Chen , Rongjie Lai

Recently manifold learning algorithm for dimensionality reduction attracts more and more interests, and various linear and nonlinear, global and local algorithms are proposed. The key step of manifold learning algorithm is the neighboring…

Methodology · Statistics 2017-04-14 Lin Ma , Caifa Zhou , Xi Liu , Yubin Xu

The challenge of approximating functions in infinite-dimensional spaces from finite samples is widely regarded as formidable. We delve into the challenging problem of the numerical approximation of Sobolev-smooth functions defined on…

Optimization and Control · Mathematics 2024-10-11 Massimo Fornasier , Pascal Heid , Giacomo Enrico Sodini

We study the deformation of the input space by a trained autoencoder via the Jacobians of the trained weight matrices. In doing so, we prove bounds for the mean squared errors for points in the input space, under assumptions regarding the…

Machine Learning · Computer Science 2021-07-15 Susama Agarwala , Benjamin Dees , Andrew Gearhart , Corey Lowman

Autoencoders represent an effective approach for computing the underlying factors characterizing datasets of different types. The latent representation of autoencoders have been studied in the context of enabling interpolation between data…

Machine Learning · Computer Science 2020-10-23 Alon Oring , Zohar Yakhini , Yacov Hel-Or

Autoencoders have achieved great success in various computer vision applications. The autoencoder learns appropriate low dimensional image representations through the self-supervised paradigm, i.e., reconstruction. Existing studies mainly…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Jianzhang Zheng , Hao Shen , Jian Yang , Xuan Tang , Mingsong Chen , Hui Yu , Jielong Guo , Xian Wei

It is shown that applying manifold learning techniques to Poincar\'e sections of high-dimensional, chaotic dynamical systems can uncover their low-dimensional topological organization. Manifold learning provides a low-dimensional embedding…

Dynamical Systems · Mathematics 2021-05-21 Evangelos Siminos

Manifold alignment (MA) involves a set of techniques for learning shared representations across domains, yet many traditional MA methods are incapable of performing out-of-sample extension, limiting their real-world applicability. We…

Machine Learning · Computer Science 2025-09-30 Jake S. Rhodes , Adam G. Rustad , Marshall S. Nielsen , Morgan Chase McClellan , Dallan Gardner , Dawson Hedges

The problem of identifying geometric structure in data is a cornerstone of (unsupervised) learning. As a result, Geometric Representation Learning has been widely applied across scientific and engineering domains. In this work, we…

Machine Learning · Computer Science 2025-06-03 Imran Nasim , Melanie Weber

Autoencoders are unsupervised machine learning circuits whose learning goal is to minimize a distortion measure between inputs and outputs. Linear autoencoders can be defined over any field and only real-valued linear autoencoder have been…

Neural and Evolutionary Computing · Computer Science 2014-03-19 Pierre Baldi , Zhiqin Lu

The joint optimization of the reconstruction and classification error is a hard non convex problem, especially when a non linear mapping is utilized. In order to overcome this obstacle, a novel optimization strategy is proposed, in which a…

Machine Learning · Computer Science 2022-11-07 Ioannis A. Nellas , Sotiris K. Tasoulis , Vassilis P. Plagianakos , Spiros V. Georgakopoulos

Safe multi-agent motion planning (MAMP) under task-induced constraints is a critical challenge in robotics. Many real-world scenarios require robots to navigate dynamic environments while adhering to manifold constraints imposed by tasks.…

Robotics · Computer Science 2025-11-06 Qingyi Chen , Ruiqi Ni , Jun Kim , Ahmed H. Qureshi