English
Related papers

Related papers: Nonlinear Supervised Dimensionality Reduction via …

200 papers

Interpolation of data on non-Euclidean spaces is an active research area fostered by its numerous applications. This work considers the Hermite interpolation problem: finding a sufficiently smooth manifold curve that interpolates a…

Numerical Analysis · Mathematics 2024-02-27 Axel Séguin , Daniel Kressner

Super-resolution of LiDAR range images is crucial to improving many downstream tasks such as object detection, recognition, and tracking. While deep learning has made a remarkable advances in super-resolution techniques, typical…

Robotics · Computer Science 2022-03-15 Youngsun Kwon , Minhyuk Sung , Sung-Eui Yoon

Merging the two cultures of deep and statistical learning provides insights into structured high-dimensional data. Traditional statistical modeling is still a dominant strategy for structured tabular data. Deep learning can be viewed…

Methodology · Statistics 2021-10-25 Anindya Bhadra , Jyotishka Datta , Nick Polson , Vadim Sokolov , Jianeng Xu

Neural implicit fields have recently emerged as a useful representation for 3D shapes. These fields are commonly represented as neural networks which map latent descriptors and 3D coordinates to implicit function values. The latent…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Hsueh-Ti Derek Liu , Francis Williams , Alec Jacobson , Sanja Fidler , Or Litany

Manifold learning (ML) aims to seek low-dimensional embedding from high-dimensional data. The problem is challenging on real-world datasets, especially with under-sampling data, and we find that previous methods perform poorly in this case.…

Machine Learning · Computer Science 2022-07-27 Zelin Zang , Siyuan Li , Di Wu , Ge Wang , Lei Shang , Baigui Sun , Hao Li , Stan Z. Li

Continual learning of deep neural networks is a key requirement for scaling them up to more complex applicative scenarios and for achieving real lifelong learning of these architectures. Previous approaches to the problem have considered…

Machine Learning · Computer Science 2020-06-25 Jary Pomponi , Simone Scardapane , Vincenzo Lomonaco , Aurelio Uncini

Learning the manifold structure of remote sensing images is of paramount relevance for modeling and understanding processes, as well as to encapsulate the high dimensionality in a reduced set of informative features for subsequent…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Gulsen Taskin , Gustau Camps-Valls

Learning-based single image super-resolution (SISR) methods are continuously showing superior effectiveness and efficiency over traditional model-based methods, largely due to the end-to-end training. However, different from model-based…

Image and Video Processing · Electrical Eng. & Systems 2020-03-24 Kai Zhang , Luc Van Gool , Radu Timofte

Manifold regularization is a commonly used technique in semi-supervised learning. It enforces the classification rule to be smooth with respect to the data-manifold. Here, we derive sample complexity bounds based on pseudo-dimension for…

Machine Learning · Computer Science 2020-07-31 Alexander Mey , Tom Viering , Marco Loog

Most modern learning problems are highly overparameterized, meaning that there are many more parameters than the number of training data points, and as a result, the training loss may have infinitely many global minima (parameter vectors…

Machine Learning · Computer Science 2019-06-11 Navid Azizan , Sahin Lale , Babak Hassibi

We present a novel view of nonlinear manifold learning using derivative-free optimization techniques. Specifically, we propose an extension of the classical multi-dimensional scaling (MDS) method, where instead of performing gradient…

Existing dimensionality reduction methods are adept at revealing hidden underlying manifolds arising from high-dimensional data and thereby producing a low-dimensional representation. However, the smoothness of the manifolds produced by…

Machine Learning · Statistics 2018-07-16 Kelum Gajamannage , Randy Paffenroth , Erik M. Bollt

It is often of interest to infer lower-dimensional structure underlying complex data. As a flexible class of non-linear structures, it is common to focus on Riemannian manifolds. Most existing manifold learning algorithms replace the…

Machine Learning · Statistics 2026-01-27 David B Dunson , Nan Wu

Manifold learning aims to discover and represent low-dimensional structures underlying high-dimensional data while preserving critical topological and geometric properties. Existing methods often fail to capture local details with global…

Machine Learning · Computer Science 2025-05-08 Ren Wang , Pengcheng Zhou

We consider the problem of reconstructing an embedding of a compact connected Riemannian manifold in a Euclidean space up to an almost isometry, given the information on intrinsic distances between points from its ``sufficiently large''…

Optimization and Control · Mathematics 2024-01-26 Nikita Puchkin , Vladimir Spokoiny , Eugene Stepanov , Dario Trevisan

This work proposes an algorithm for explicitly constructing a pair of neural networks that linearize and reconstruct an embedded submanifold, from finite samples of this manifold. Our such-generated neural networks, called Flattening…

Machine Learning · Computer Science 2023-09-11 Michael Psenka , Druv Pai , Vishal Raman , Shankar Sastry , Yi Ma

One of the prevailing trends in the machine- and deep-learning community is to gravitate towards the use of increasingly larger models in order to keep pushing the state-of-the-art performance envelope. This tendency makes access to the…

Machine Learning · Computer Science 2023-05-29 Shadi Sartipi , Edgar A. Bernal

To gain insight into the mechanisms behind machine learning methods, it is crucial to establish connections among the features describing data points. However, these correlations often exhibit a high-dimensional and strongly nonlinear…

Machine Learning · Computer Science 2025-03-04 Lorenzo Basile , Santiago Acevedo , Luca Bortolussi , Fabio Anselmi , Alex Rodriguez

Based on the manifold hypothesis, real-world data often lie on a low-dimensional manifold, while normalizing flows as a likelihood-based generative model are incapable of finding this manifold due to their structural constraints. So, one…

Machine Learning · Computer Science 2022-06-08 Seyedeh Fatemeh Razavi , Mohammad Mahdi Mehmanchi , Reshad Hosseini , Mostafa Tavassolipour

Nonlinear manifold learning algorithms, such as diffusion maps, have been fruitfully applied in recent years to the analysis of large and complex data sets. However, such algorithms still encounter challenges when faced with real data. One…

Mathematical Physics · Physics 2015-05-25 Carmeline J. Dsilva , Ronen Talmon , Ronald R. Coifman , Ioannis G. Kevrekidis