English
Related papers

Related papers: Learning Low-Dimensional Nonlinear Structures from…

200 papers

We apply recent advances in machine learning and computer vision to a central problem in materials informatics: The statistical representation of microstructural images. We use activations in a pre-trained convolutional neural network to…

Computational Physics · Physics 2018-12-04 Nicholas Lubbers , Turab Lookman , Kipton Barros

This article proposes an active learning method for high dimensional data, based on intrinsic data geometries learned through diffusion processes on graphs. Diffusion distances are used to parametrize low-dimensional structures on the…

Machine Learning · Computer Science 2019-05-31 Mauro Maggioni , James M. Murphy

Recently, there has been much interest in spectral approaches to learning manifolds---so-called kernel eigenmap methods. These methods have had some successes, but their applicability is limited because they are not robust to noise. To…

Machine Learning · Computer Science 2011-12-30 Byron Boots , Geoffrey J. Gordon

Modern machine learning systems are increasingly trained on large amounts of data embedded in high-dimensional spaces. Often this is done without analyzing the structure of the dataset. In this work, we propose a framework to study the…

Machine Learning · Computer Science 2023-04-27 Carlos Hurtado , Sarath Shekkizhar , Javier Ruiz-Hidalgo , Antonio Ortega

We establish a general form of explicit, input-dependent, measure-valued warpings for learning nonstationary kernels. While stationary kernels are ubiquitous and simple to use, they struggle to adapt to functions that vary in smoothness…

Machine Learning · Computer Science 2020-10-12 Anthony Tompkins , Rafael Oliveira , Fabio Ramos

We develop a stochastic approximation framework for learning nonlinear operators between infinite-dimensional spaces utilizing general Mercer operator-valued kernels. Our framework encompasses two key classes: (i) compact kernels, which…

Machine Learning · Statistics 2026-01-13 Jia-Qi Yang , Lei Shi

To accelerate kernel methods, we propose a near input sparsity time algorithm for sampling the high-dimensional feature space implicitly defined by a kernel transformation. Our main contribution is an importance sampling method for…

Data Structures and Algorithms · Computer Science 2020-07-15 David P. Woodruff , Amir Zandieh

We propose a new method for input variable selection in nonlinear regression. The method is embedded into a kernel regression machine that can model general nonlinear functions, not being a priori limited to additive models. This is the…

Machine Learning · Computer Science 2018-09-05 Magda Gregorová , Jason Ramapuram , Alexandros Kalousis , Stéphane Marchand-Maillet

Datasets such as images, text, or movies are embedded in high-dimensional spaces. However, in important cases such as images of objects, the statistical structure in the data constrains samples to a manifold of dramatically lower…

Machine Learning · Computer Science 2019-10-29 Stefano Recanatesi , Matthew Farrell , Madhu Advani , Timothy Moore , Guillaume Lajoie , Eric Shea-Brown

This paper proposes a novel approach for learning a data-driven quadratic manifold from high-dimensional data, then employing this quadratic manifold to derive efficient physics-based reduced-order models. The key ingredient of the approach…

Numerical Analysis · Mathematics 2022-12-29 Rudy Geelen , Stephen Wright , Karen Willcox

Recently, deep learning has been widely applied in functional data analysis (FDA) with notable empirical success. However, the infinite dimensionality of functional data necessitates an effective dimension reduction approach for functional…

Machine Learning · Statistics 2025-05-13 Zhongjie Shi , Jun Fan , Linhao Song , Ding-Xuan Zhou , Johan A. K. Suykens

Spectral Embedding (SE) has often been used to map data points from non-linear manifolds to linear subspaces for the purpose of classification and clustering. Despite significant advantages, the subspace structure of data in the original…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Hira Yaseen , Arif Mahmood

Nonlinear manifold learning from unorganized data points is a very challenging unsupervised learning and data visualization problem with a great variety of applications. In this paper we present a new algorithm for manifold learning and…

Machine Learning · Computer Science 2016-08-31 Zhenyue Zhang , Hongyuan Zha

We introduce a new approach for estimating the invariant density of a multidimensional diffusion when dealing with high-frequency observations blurred by independent noises. We consider the intermediate regime, where observations occur at…

Statistics Theory · Mathematics 2024-04-19 Raphaël Maillet , Grégoire Szymanski

Data living on manifolds commonly appear in many applications. Often this results from an inherently latent low-dimensional system being observed through higher dimensional measurements. We show that under certain conditions, it is possible…

Machine Learning · Statistics 2018-07-05 Ariel Schwartz , Ronen Talmon

Kernel-based subspace clustering, which addresses the nonlinear structures in data, is an evolving area of research. Despite noteworthy progressions, prevailing methodologies predominantly grapple with limitations relating to (i) the…

Machine Learning · Computer Science 2025-01-22 Kunpeng Xu , Lifei Chen , Shengrui Wang

Existing dimensionality reduction methods are adept at revealing hidden underlying manifolds arising from high-dimensional data and thereby producing a low-dimensional representation. However, the smoothness of the manifolds produced by…

Machine Learning · Statistics 2018-07-16 Kelum Gajamannage , Randy Paffenroth , Erik M. Bollt

This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible. Computational imaging, especially non-line-of-sight (NLOS) imaging, the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Lianfang Wang , Kuilin Qin , Xueying Liu , Huibin Chang , Yong Wang , Yuping Duan

This paper addresses a kernel-based learning problem for a network of agents locally observing a latent multidimensional, nonlinear phenomenon in a noisy environment. We propose a learning algorithm that requires only mild a priori…

Multiagent Systems · Computer Science 2024-04-16 Krzysztof Kowalczyk , Paweł Wachel , Cristian R. Rojas

The recovery of the intrinsic geometric structures of data collections is an important problem in data analysis. Supervised extensions of several manifold learning approaches have been proposed in the recent years. Meanwhile, existing…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Cem Ornek , Elif Vural