English
Related papers

Related papers: Nonlinear dimension reduction for surrogate modeli…

200 papers

Unsupervised machine learning lacks ground truth by definition. This poses a major difficulty when designing metrics to evaluate the performance of such algorithms. In sharp contrast with supervised learning, for which plenty of quality…

Machine Learning · Computer Science 2023-03-20 Raúl Lara-Cabrera , Ángel González-Prieto , Diego Pérez-López , Diego Trujillo , Fernando Ortega

A dimension reduction method based on the "Nonlinear Level set Learning" (NLL) approach is presented for the pointwise prediction of functions which have been sparsely sampled. Leveraging geometric information provided by the Implicit…

Machine Learning · Statistics 2021-08-10 Anthony Gruber , Max Gunzburger , Lili Ju , Yuankai Teng , Zhu Wang

Ridge functions have recently emerged as a powerful set of ideas for subspace-based dimension reduction. In this paper we begin by drawing parallels between ridge subspaces, sufficient dimension reduction and active subspaces, contrasting…

Methodology · Statistics 2019-01-04 Pranay Seshadri , Shaowu Yuchi , Geoffrey T. Parks

We propose a dimension reduction technique for Bayesian inverse problems with nonlinear forward operators, non-Gaussian priors, and non-Gaussian observation noise. The likelihood function is approximated by a ridge function, i.e., a map…

Probability · Mathematics 2022-01-31 Olivier Zahm , Tiangang Cui , Kody Law , Alessio Spantini , Youssef Marzouk

This article introduces a functional method for lower-dimensional smooth representations in terms of time-varying dissimilarities. The method incorporates dissimilarity representation in multidimensional scaling and smoothness approach of…

Methodology · Statistics 2025-05-02 Liting Li

This manuscript is superseded by Constantine, Dow, and Wang's "Active Subspaces in Theory and Practice: Applications to Kriging Surfaces" [SIAM J. of Sci. Comput., 36 (2014), pp. A1500-A1524]. Many multivariate functions encountered in…

Numerical Analysis · Mathematics 2014-08-26 Paul G. Constantine , Qiqi Wang

This paper presents a quadratic formula-based nonlinear representation for a given single-variable function f(x), $-1 \leq x \leq 1$. First, we construct the explicit polynomial coefficient functions a(x), b(x), and c(x) using a…

Numerical Analysis · Mathematics 2025-12-09 Ziqin He , Can Chen , Min Hyung Cho , Jingfang Huang , Yichao Wu

We propose a new technique for obtaining reduced order models for nonlinear dynamical systems. Specifically, we advocate the use of the recently developed Dynamic Mode Decomposition (DMD), an equation-free method, to approximate the…

Numerical Analysis · Mathematics 2016-02-17 Alessandro Alla , J. Nathan Kutz

We present a dimension-incremental algorithm for the nonlinear approximation of high-dimensional functions in an arbitrary bounded orthonormal product basis. Our goal is to detect a suitable truncation of the basis expansion of the…

Numerical Analysis · Mathematics 2023-04-28 Lutz Kämmerer , Daniel Potts , Fabian Taubert

Analyzing high-dimensional data presents challenges due to the "curse of dimensionality'', making computations intensive. Dimension reduction techniques, categorized as linear or non-linear, simplify such data. Non-linear methods are…

Machine Learning · Statistics 2025-04-15 Praveen T. W. Hettige , Benjamin W. Ong

There is growing interest in learning Fourier domain sampling strategies (particularly for magnetic resonance imaging, MRI) using optimization approaches. For non-Cartesian sampling patterns, the system models typically involve non-uniform…

Image and Video Processing · Electrical Eng. & Systems 2023-02-07 Guanhua Wang , Jeffrey A. Fessler

A new package for nonlinear least squares fitting is introduced in this paper. This package implements a recently developed algorithm that, for certain types of nonlinear curve fitting, reduces the number of nonlinear parameters to be…

Statistics Theory · Mathematics 2024-02-07 J. A. F. Torvisco , R. Benítez , M. R. Arias , J. Cabello Sánchez

Nonlinear dimensionality reduction or, equivalently, the approximation of high-dimensional data using a low-dimensional nonlinear manifold is an active area of research. In this paper, we will present a thematically different approach to…

Machine Learning · Computer Science 2019-12-21 Kelum Gajamannage , Randy Paffenroth

We present a new approach for nonlinear dimensionality reduction, specifically designed for computationally expensive mathematical models. We leverage autoencoders to discover a one-dimensional neural active manifold (NeurAM) capturing the…

Numerical Analysis · Mathematics 2025-10-31 Andrea Zanoni , Gianluca Geraci , Matteo Salvador , Alison L. Marsden , Daniele E. Schiavazzi

Gaussian graphical models are widely utilized to infer and visualize networks of dependencies between continuous variables. However, inferring the graph is difficult when the sample size is small compared to the number of variables. To…

Statistics Theory · Mathematics 2016-09-30 Emilie Devijver , Mélina Gallopin

We present a stochastic inexact Gauss-Newton method for the solution of nonlinear least-squares. To reduce the computational cost with respect to the classical method, at each iteration the proposed algorithm approximately minimizes the…

Optimization and Control · Mathematics 2025-06-05 Stefania Bellavia , Greta Malaspina , Benedetta Morini

The goal of supervised representation learning is to construct effective data representations for prediction. Among all the characteristics of an ideal nonparametric representation of high-dimensional complex data, sufficiency, low…

Machine Learning · Computer Science 2022-09-02 Jian Huang , Yuling Jiao , Xu Liao , Jin Liu , Zhou Yu

Unsupervised feature selection is an important method to reduce dimensions of high dimensional data without labels, which is benefit to avoid ``curse of dimensionality'' and improve the performance of subsequent machine learning tasks, like…

Machine Learning · Computer Science 2020-12-29 Yanyong Huang , Zongxin Shen , Fuxu Cai , Tianrui Li , Fengmao Lv

We introduce and investigate matrix approximation by decomposition into a sum of radial basis function (RBF) components. An RBF component is a generalization of the outer product between a pair of vectors, where an RBF function replaces the…

Machine Learning · Computer Science 2021-06-25 Elizaveta Rebrova , Yu-Hang Tang

Surrogate models provide a low computational cost alternative to evaluating expensive functions. The construction of accurate surrogate models with large numbers of independent variables is currently prohibitive because it requires a large…

Machine Learning · Computer Science 2017-08-10 Mohamed Amine Bouhlel , Joaquim R. R. A. Martins