English
Related papers

Related papers: Learning Low-Dimensional Nonlinear Structures from…

200 papers

Non-linear manifold learning enables high-dimensional data analysis, but requires out-of-sample-extension methods to process new data points. In this paper, we propose a manifold learning algorithm based on deep learning to create an…

Machine Learning · Statistics 2015-06-26 Gal Mishne , Uri Shaham , Alexander Cloninger , Israel Cohen

Manifold embedding algorithms map high-dimensional data down to coordinates in a much lower-dimensional space. One of the aims of dimension reduction is to find intrinsic coordinates that describe the data manifold. The coordinates returned…

Machine Learning · Statistics 2021-07-30 Samson Koelle , Hanyu Zhang , Marina Meila , Yu-Chia Chen

The main objective of this paper is to find algorithms accompanied by explicit error bounds for phase retrieval from noisy magnitudes of frame coefficients when the underlying frame has a low redundancy. We achieve these goals with frames…

Functional Analysis · Mathematics 2014-12-23 Bernhard G. Bodmann , Nathaniel Hammen

Majority of the current dimensionality reduction or retrieval techniques rely on embedding the learned feature representations onto a computable metric space. Once the learned features are mapped, a distance metric aids the bridging of gaps…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Muhammad Kamran Janjua , Shah Nawaz , Alessandro Calefati , Ignazio Gallo

Data sites selected from modeling high-dimensional problems often appear scattered in non-paternalistic ways. Except for sporadic clustering at some spots, they become relatively far apart as the dimension of the ambient space grows. These…

Numerical Analysis · Mathematics 2021-09-28 Shao-Bo Lin , Xiangyu Chang , Xingping Sun

Modern information processing relies on the axiom that high-dimensional data lie near low-dimensional geometric structures. This paper revisits the problem of data-driven learning of these geometric structures and puts forth two new…

Machine Learning · Statistics 2018-03-06 Tong Wu , Waheed U. Bajwa

Kernel methods are a cornerstone of classical machine learning. The idea of using quantum computers to compute kernels has recently attracted attention. Quantum embedding kernels (QEKs) constructed by embedding data into the Hilbert space…

Fourier embedding has shown great promise in removing spectral bias during neural network training. However, it can still suffer from high generalization errors, especially when the labels or measurements are noisy. We demonstrate that…

Machine Learning · Computer Science 2024-09-04 Halyun Jeong , Jihun Han

Manifold learning techniques have become increasingly valuable as data continues to grow in size. By discovering a lower-dimensional representation (embedding) of the structure of a dataset, manifold learning algorithms can substantially…

Neural and Evolutionary Computing · Computer Science 2020-01-31 Andrew Lensen , Mengjie Zhang , Bing Xue

We introduce a data-driven order reduction method for nonlinear control systems, drawing on recent progress in machine learning and statistical dimensionality reduction. The method rests on the assumption that the nonlinear system behaves…

Optimization and Control · Mathematics 2016-04-04 Jake Bouvrie , Boumediene Hamzi

This paper introduces an efficient multi-linear nonparametric (kernel-based) approximation framework for data regression and imputation, and its application to dynamic magnetic-resonance imaging (dMRI). Data features are assumed to reside…

Signal Processing · Electrical Eng. & Systems 2023-04-07 Duc Thien Nguyen , Konstantinos Slavakis

The discovering of low-dimensional manifolds in high-dimensional data is one of the main goals in manifold learning. We propose a new approach to identify the effective dimension (intrinsic dimension) of low-dimensional manifolds. The scale…

Statistics Theory · Mathematics 2008-03-17 Xiaohui Wang , J. S. Marron

We developed a Nonlinear Level-set Learning (NLL) method for dimensionality reduction in high-dimensional function approximation with small data. This work is motivated by a variety of design tasks in real-world engineering applications,…

Functional Analysis · Mathematics 2019-06-20 Guannan Zhang , Jiaxin Zhang , Jacob Hinkle

In this paper, we develop a finite mixture of convolutional distributions, a statistical model to analyze continuous data distributed approximately on a mixture of low-dimensional affine subspaces. The observations are assumed independent…

Statistics Theory · Mathematics 2026-04-21 Sunrit Chakraborty , XuanLong Nguyen

Noise poses a challenge for learning dynamical-system models because already small variations can distort the dynamics described by trajectory data. This work builds on operator inference from scientific machine learning to infer…

Machine Learning · Computer Science 2021-07-27 Wayne Isaac Tan Uy , Yuepeng Wang , Yuxiao Wen , Benjamin Peherstorfer

Learning kernels in operators from data lies at the intersection of inverse problems and statistical learning, providing a powerful framework for capturing non-local dependencies in function spaces and high-dimensional settings. In contrast…

Statistics Theory · Mathematics 2025-06-24 Sichong Zhang , Xiong Wang , Fei Lu

In recent years, manifold learning has become increasingly popular as a tool for performing non-linear dimensionality reduction. This has led to the development of numerous algorithms of varying degrees of complexity that aim to recover man…

Machine Learning · Statistics 2013-06-03 Dominique Perraul-Joncas , Marina Meila

Finding an embedding space for a linear approximation of a nonlinear dynamical system enables efficient system identification and control synthesis. The Koopman operator theory lays the foundation for identifying the nonlinear-to-linear…

Machine Learning · Computer Science 2020-04-28 Yunzhu Li , Hao He , Jiajun Wu , Dina Katabi , Antonio Torralba

Autoencoders, which consist of an encoder and a decoder, are widely used in machine learning for dimension reduction of high-dimensional data. The encoder embeds the input data manifold into a lower-dimensional latent space, while the…

Numerical Analysis · Mathematics 2024-03-29 Juliane Braunsmann , Marko Rajković , Martin Rumpf , Benedikt Wirth

Manifold learning is a hot research topic in the field of computer science and has many applications in the real world. A main drawback of manifold learning methods is, however, that there is no explicit mappings from the input data…

Computer Vision and Pattern Recognition · Computer Science 2010-01-18 Hong Qiao , Peng Zhang , Di Wang , Bo Zhang