English
Related papers

Related papers: Nonlinear manifold approximation using composition…

200 papers

It is known that unsupervised nonlinear dimensionality reduction and clustering is sensitive to the selection of hyperparameters, particularly for deep learning based methods, which hinders its practical use. How to select a proper network…

Machine Learning · Computer Science 2022-08-30 Xiao-Lei Zhang

This paper discusses a methodology for determining a functional representation of a random process from a collection of scattered pointwise samples. The present work specifically focuses onto random quantities lying in a high dimensional…

Numerical Analysis · Mathematics 2014-01-03 Lionel Mathelin

We consider a family of linear systems $A_\mu \alpha=C$ with system matrix $A_\mu$ depending on a parameter $\mu$ and for simplicity parameter-independent right-hand side $C$. These linear systems typically result from the…

Numerical Analysis · Mathematics 2013-07-17 Fabien Casenave , Alexandre Ern , Tony Lelièvre , Guillaume Sylvand

In this work we introduce a manifold learning-based method for uncertainty quantification (UQ) in systems describing complex spatiotemporal processes. Our first objective is to identify the embedding of a set of high-dimensional data…

Data Analysis, Statistics and Probability · Physics 2022-05-18 Katiana Kontolati , Dimitrios Loukrezis , Ketson R. M. dos Santos , Dimitrios G. Giovanis , Michael D. Shields

We developed a Nonlinear Level-set Learning (NLL) method for dimensionality reduction in high-dimensional function approximation with small data. This work is motivated by a variety of design tasks in real-world engineering applications,…

Functional Analysis · Mathematics 2019-06-20 Guannan Zhang , Jiaxin Zhang , Jacob Hinkle

Given a collection of $m$ sets from a universe $\mathcal{U}$, the Maximum Set Coverage problem consists of finding $k$ sets whose union has largest cardinality. This problem is NP-Hard, but the solution can be approximated by a polynomial…

Data Structures and Algorithms · Computer Science 2023-12-13 Stephen Jaud , Anthony Wirth , Farhana Choudhury

Deep Neural Networks (DNNs) have already become a crucial computational approach to revealing the spatial patterns in the human brain; however, there are three major shortcomings in utilizing DNNs to detect the spatial patterns in…

Machine Learning · Computer Science 2022-05-26 Wei Zhang , Yu Bao

We present a nonlinear (in the sense of McKean) generalization of Hamiltonian Monte Carlo (HMC) termed nonlinear HMC (nHMC) capable of sampling from nonlinear probability measures of mean-field type. When the underlying confinement…

Probability · Mathematics 2023-09-22 Nawaf Bou-Rabee , Katharina Schuh

Nonlinear function estimation is core to modern machine learning applications. In this paper, to perform nonlinear function estimation, we reduce a nonlinear inverse problem to a linear one using a polynomial kernel expansion. These kernels…

Information Theory · Computer Science 2019-10-02 Hangjin Liu , You , Zhou , Ahmad Beirami , Dror Baron

The aim of this paper is twofold: In the first part, we leverage recent results on scenario design to develop randomized algorithmsfor approximating the image set of a nonlinear mapping, that is, a (possibly noisy) mapping of a set via a…

Optimization and Control · Mathematics 2015-07-30 Fabrizio Dabbene , Didier Henrion , Constantino Lagoa , Pavel Shcherbakov

Fitting an unknown number of hyperplanes to data is a fundamental yet challenging problem in machine learning, characterized by its non-convexity, non-differentiability, and unknown model order. Existing approaches often struggle with local…

Machine Learning · Computer Science 2026-05-28 Zhiqin Cheng , Yu Zhan , Mingjin Zhang , Lingbo Liu , Liang Lin

In recent years, manifold methods have moved into focus as tools for dimension reduction. Assuming that the high-dimensional data actually lie on or close to a low-dimensional nonlinear manifold, these methods have shown convincing results…

Machine Learning · Statistics 2020-12-23 Moritz Herrmann , Fabian Scheipl

Learning from data in the presence of outliers is a fundamental problem in statistics. Until recently, no computationally efficient algorithms were known to compute the mean of a high dimensional distribution under natural assumptions in…

Data Structures and Algorithms · Computer Science 2021-01-22 Yeshwanth Cherapanamjeri , Sidhanth Mohanty , Morris Yau

In this paper, we propose and analyze a multiscale method for a class of quasilinear elliptic problems of nonmonotone type with spatially multiscale coefficient. The numerical approach is inspired by the Localized Orthogonal Decomposition…

Numerical Analysis · Mathematics 2025-07-28 Maher Khrais , Barbara Verfürth

We present a scalable low dimensional manifold model for the reconstruction of noisy and incomplete hyperspectral images. The model is based on the observation that the spatial-spectral blocks of a hyperspectral image typically lie close to…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Wei Zhu , Zuoqiang Shi , Stanley Osher

In this article, we study the Euclidean minimum spanning tree problem in an imprecise setup. The problem is known as the \emph{Minimum Spanning Tree Problem with Neighborhoods} in the literature. We study the problem where the neighborhoods…

Computational Geometry · Computer Science 2021-04-12 Sanjana Dey , Ramesh K. Jallu , Subhas C. Nandy

We propose a novel algorithm for the task of supervised discriminative distance learning by nonlinearly embedding vectors into a low dimensional Euclidean space. We work in the challenging setting where supervision is with constraints on…

Computer Vision and Pattern Recognition · Computer Science 2015-09-30 Gaurav Sharma , Bernt Schiele

We relate the problem of best low-rank approximation in the spectral norm for a matrix $A$ to Kolmogorov $n$-widths and corresponding optimal spaces. We characterize all the optimal spaces for the image of the Euclidean unit ball under $A$…

Numerical Analysis · Mathematics 2021-05-25 Michael S. Floater , Carla Manni , Espen Sande , Hendrik Speleers

For the past 30 years or so, machine learning has stimulated a great deal of research in the study of approximation capabilities (expressive power) of a multitude of processes, such as approximation by shallow or deep neural networks,…

Machine Learning · Computer Science 2025-01-07 Hrushikesh Mhaskar

With the aim of estimating the abundance map from observations only, linear unmixing approaches are not always suitable to spectral images, especially when the number of bands is too small or when the spectra of the observed data are too…

Image and Video Processing · Electrical Eng. & Systems 2025-03-27 Antoine Bottenmuller , Florent Magaud , Arnaud Demortière , Etienne Decencière , Petr Dokladal