English
Related papers

Related papers: Learning Low-Dimensional Nonlinear Structures from…

200 papers

Graph embedding techniques are useful to characterize spectral signature relations for hyperspectral images. However, such images consists of disjoint classes due to spatial details that are often ignored by existing graph computing tools.…

Computer Vision and Pattern Recognition · Computer Science 2012-11-29 Dalton Lunga 'and' Okan Ersoy

Recently, non-stationary spectral kernels have drawn much attention, owing to its powerful feature representation ability in revealing long-range correlations and input-dependent characteristics. However, non-stationary spectral kernels are…

Machine Learning · Computer Science 2020-03-02 Jian Li , Yong Liu , Weiping Wang

We present a novel framework for learning cost-efficient latent representations in problems with high-dimensional state spaces through nonlinear dimension reduction. By enriching linear state approximations with low-order polynomial terms…

Numerical Analysis · Mathematics 2026-05-27 Rudy Geelen , Laura Balzano , Karen Willcox

One fundamental goal of high-dimensional statistics is to detect or recover planted structure (such as a low-rank matrix) hidden in noisy data. A growing body of work studies low-degree polynomials as a restricted model of computation for…

Statistics Theory · Mathematics 2022-06-22 Tselil Schramm , Alexander S. Wein

We propose a novel probabilistic dimensionality reduction framework that can naturally integrate the generative model and the locality information of data. Based on this framework, we present a new model, which is able to learn a smooth…

Machine Learning · Statistics 2016-10-18 Li Wang

In this paper, we consider the fundamental problem of approximation of functions on a low-dimensional manifold embedded in a high-dimensional space, with noise affecting both in the data and values of the functions. Due to the curse of…

Numerical Analysis · Mathematics 2020-12-29 Shira Faigenbaum-Golovin , David Levin

Neural implicit functions have achieved impressive results for reconstructing 3D shapes from single images. However, the image features for describing 3D point samplings of implicit functions are less effective when significant variations…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Yixin Zhuang , Yunzhe Liu , Yujie Wang , Baoquan Chen

Invoking the manifold assumption in machine learning requires knowledge of the manifold's geometry and dimension, and theory dictates how many samples are required. However, in applications data are limited, sampling may not be uniform, and…

Machine Learning · Computer Science 2023-03-02 Luciano Dyballa , Steven W. Zucker

Data-driven control algorithms use observations of system dynamics to construct an implicit model for the purpose of control. However, in practice, data-driven techniques often require excessive sample sizes, which may be infeasible in…

Systems and Control · Electrical Eng. & Systems 2023-01-10 Adam J. Thorpe , Cyrus Neary , Franck Djeumou , Meeko M. K. Oishi , Ufuk Topcu

Alternative machine learning approaches that are computationally light with low latency and can work with only a small training dataset are needed for applications where the insatiable demand of deep learning methods for computing power and…

Optics · Physics 2021-07-29 Tingyi Zhou , Fabien Scalzo , Bahram Jalali

Recent advances in the theory of Neural Operators (NOs) have enabled fast and accurate computation of the solutions to complex systems described by partial differential equations (PDEs). Despite their great success, current NO-based…

Machine Learning · Computer Science 2024-03-18 Ashutosh Singh , Ricardo Augusto Borsoi , Deniz Erdogmus , Tales Imbiriba

We study the behavior of two kernel based sensor fusion algorithms, nonparametric canonical correlation analysis (NCCA) and alternating diffusion (AD), under the nonnull setting that the clean datasets collected from two sensors are modeled…

Machine Learning · Statistics 2021-11-23 Xiucai Ding , Hau-Tieng Wu

Learning operators between infinitely dimensional spaces is an important learning task arising in wide applications in machine learning, imaging science, mathematical modeling and simulations, etc. This paper studies the nonparametric…

Machine Learning · Statistics 2022-01-04 Hao Liu , Haizhao Yang , Minshuo Chen , Tuo Zhao , Wenjing Liao

Manifold learning is a fundamental problem in machine learning with numerous applications. Most of the existing methods directly learn the low-dimensional embedding of the data in some high-dimensional space, and usually lack the…

Machine Learning · Computer Science 2021-03-16 Yufan Zhou , Changyou Chen , Jinhui Xu

Transfer learning for feature extraction can be used to exploit deep representations in contexts where there is very few training data, where there are limited computational resources, or when tuning the hyper-parameters needed for training…

Depth measures have gained popularity in the statistical literature for defining level sets in complex data structures like multivariate data, functional data, and graphs. Despite their versatility, integrating depth measures into…

Neural operators learn mappings between function spaces, which is practical for learning solution operators of PDEs and other scientific modeling applications. Among them, the Fourier neural operator (FNO) is a popular architecture that…

Machine Learning · Computer Science 2024-06-11 Miguel Liu-Schiaffini , Julius Berner , Boris Bonev , Thorsten Kurth , Kamyar Azizzadenesheli , Anima Anandkumar

In this abstract paper, we introduce a new kernel learning method by a nonparametric density estimator. The estimator consists of a group of k-centroids clusterings. Each clustering randomly selects data points with randomly selected…

Machine Learning · Computer Science 2017-08-02 Xiao-Lei Zhang

Many signal processing and machine learning applications are built from evaluating a kernel on pairs of signals, e.g. to assess the similarity of an incoming query to a database of known signals. This nonlinear evaluation can be simplified…

Signal Processing · Electrical Eng. & Systems 2021-03-16 Vincent Schellekens , Laurent Jacques

Low-dimensional embedding, manifold learning, clustering, classification, and anomaly detection are among the most important problems in machine learning. The existing methods usually consider the case when each instance has a fixed,…

Machine Learning · Computer Science 2012-02-20 Barnabas Poczos , Liang Xiong , Jeff Schneider