English
Related papers

Related papers: Nonlinear manifold approximation using composition…

200 papers

Dimensionality reduction is an effective method for learning high-dimensional data, which can provide better understanding of decision boundaries in human-readable low-dimensional subspace. Linear methods, such as principal component…

Machine Learning · Computer Science 2020-07-09 Koji Maruhashi , Heewon Park , Rui Yamaguchi , Satoru Miyano

A primary spectral submanifold (SSM) is the unique smoothest nonlinear continuation of a nonresonant spectral subspace $E$ of a dynamical system linearized at a fixed point. Passing from the full nonlinear dynamics to the flow on an…

Dynamical Systems · Mathematics 2023-06-28 George Haller , Bálint Kaszás , Aihui Liu , Joar Axås

The problem of measuring the best linear approximation of a nonlinear system by means of multilevel excitation sequences is analyzed. A comparison between different types of sequences applied at the input of Wiener systems is provided by…

Signal Processing · Electrical Eng. & Systems 2017-10-20 A. De Angelis , J. Schoukens , K. R. Godfrey , P. Carbone

We are interested in finding a solution to the tensor complementarity problem with a strong M-tensor, which we call the M-tensor complementarity problem. We propose a lower dimensional linear equation approach to solve that problem. At each…

Optimization and Control · Mathematics 2020-07-28 Dong-Hui Li , Cui-Dan Chen , Hong-Bo Guan

We study the optimal approximation of the solution of an operator equation by certain n-term approximations with respect to specific classes of frames. We study worst case errors and the optimal order of convergence and define suitable…

Numerical Analysis · Mathematics 2007-05-23 Stephan Dahlke , Erich Novak , Winfried Sickel

In the study of high-dimensional data, it is often assumed that the data set possesses an underlying lower-dimensional structure. A practical model for this structure is an embedded compact manifold with boundary. Since the underlying…

Machine Learning · Statistics 2025-08-22 Pei-Cheng Kuo , Nan Wu

We consider the problem of subspace estimation in a Bayesian setting. Since we are operating in the Grassmann manifold, the usual approach which consists of minimizing the mean square error (MSE) between the true subspace $U$ and its…

Methodology · Statistics 2015-05-27 Olivier Besson , Nicolas Dobigeon , Jean-Yves Tourneret

We study approximation and statistical learning properties of deep ReLU networks under structural assumptions that mitigate the curse of dimensionality. We prove minimax-optimal uniform approximation rates for $s$-H\"older smooth functions…

Statistics Theory · Mathematics 2026-02-06 Thomas Nagler , Sophie Langer

We propose and discuss a new computational method for the numerical approximation of reachable sets for nonlinear control systems. It is based on the support vector machine algorithm and represents the set approximation as a sublevel set of…

Optimization and Control · Mathematics 2014-12-11 Martin Rasmussen , Janosch Rieger , Kevin Webster

This paper investigates the stability of the least squares approximation $P_m^n$ within the univariate polynomial space of degree $m$, denoted by ${\mathbb P}_m$. The approximation $P_m^n$ entails identifying a polynomial in ${\mathbb P}_m$…

Numerical Analysis · Mathematics 2026-02-17 Zhiqiang Xu , Xinyue Zhang

Probabilistic Manifold Decomposition (PMD)\cite{doi:10.1137/25M1738863}, developed in our earlier work, provides a nonlinear model reduction by embedding high-dimensional dynamics onto low-dimensional probabilistic manifolds. The PMD has…

Numerical Analysis · Mathematics 2026-01-13 Jiaming Guo , Dunhui Xiao

Motivated by the problem of nonparametric inference in high level digital image analysis, we introduce a general extrinsic approach for data analysis on Hilbert manifolds with a focus on means of probability distributions on such sample…

Statistics Theory · Mathematics 2013-02-11 Leif Ellingson , Vic Patrangenaru , Frits Ruymgaart

This paper establishes a nearly optimal algorithm for estimating the frequencies and amplitudes of a mixture of sinusoids from noisy equispaced samples. We derive our algorithm by viewing line spectral estimation as a sparse recovery…

Information Theory · Computer Science 2013-04-02 Gongguo Tang , Badri Narayan Bhaskar , Benjamin Recht

This paper proposes a new inexact manifold proximal linear (IManPL) algorithm for solving nonsmooth, nonconvex composite optimization problems over an embedded submanifold. At each iteration, IManPL solves a convex subproblem inexactly,…

Optimization and Control · Mathematics 2025-11-11 Zhong Zheng , Xin Yu , Shiqian Ma , Lingzhou Xue

Partial differential equations (PDEs) involving high contrast and oscillating coefficients are common in scientific and industrial applications. Numerical approximation of these PDEs is a challenging task that can be addressed, for example,…

Numerical Analysis · Mathematics 2024-05-08 Miranda Boutilier , Konstantin Brenner , Larissa Miguez

Sparse autoencoders are a standard tool for uncovering interpretable latent representations in neural networks. Yet, their interpretation depends on the inputs, making their isolated study incomplete. Polynomials offer a solution; they…

Machine Learning · Computer Science 2025-10-21 Thomas Dooms , Ward Gauderis

Function approximation from input and output data is one of the most investigated problems in signal processing. This problem has been tackled with various signal processing and machine learning methods. Although tensors have a rich history…

Statistics Theory · Mathematics 2023-02-16 Christina Auer , Thomas Paireder , Oliver Ploder , Oliver Lang , Mario Huemer

Many applications, such as system identification, classification of time series, direct and inverse problems in partial differential equations, and uncertainty quantification lead to the question of approximation of a non-linear operator…

Numerical Analysis · Mathematics 2022-12-05 Hrushikesh Mhaskar

We adapt previous research on category theory and topological unsupervised learning to develop a functorial perspective on manifold learning, also known as nonlinear dimensionality reduction. We first characterize manifold learning…

Machine Learning · Computer Science 2022-11-04 Dan Shiebler

Adaptive multilevel finite element methods are developed and analyzed for certain elliptic systems arising in geometric analysis and general relativity. This class of nonlinear elliptic systems of tensor equations on manifolds is first…

Numerical Analysis · Mathematics 2010-01-12 Michael Holst