English
Related papers

Related papers: Nonlinear approximation in bounded orthonormal pro…

200 papers

Several problems in modeling and control of stochastically-driven dynamical systems can be cast as regularized semi-definite programs. We examine two such representative problems and show that they can be formulated in a similar manner. The…

Optimization and Control · Mathematics 2019-12-30 Armin Zare , Hesameddin Mohammadi , Neil K. Dhingra , Tryphon T. Georgiou , Mihailo R. Jovanović

In recent years, manifold methods have moved into focus as tools for dimension reduction. Assuming that the high-dimensional data actually lie on or close to a low-dimensional nonlinear manifold, these methods have shown convincing results…

Machine Learning · Statistics 2020-12-23 Moritz Herrmann , Fabian Scheipl

Multivariate function approximation is a fundamental problem in machine learning. Classic multivariate function approximations rely on hand-crafted basis functions (e.g., polynomial basis and Fourier basis), which limits their approximation…

Machine Learning · Computer Science 2026-03-17 Wei-Hao Wu , Ting-Zhu Huang , Xi-Le Zhao , Yisi Luo , Deyu Meng

Maximizing submodular objectives under constraints is a fundamental problem in machine learning and optimization. We study the maximization of a nonnegative, non-monotone $\gamma$-weakly DR-submodular function over a down-closed convex…

Machine Learning · Computer Science 2026-01-05 Hareshkumar Jadav , Ranveer Singh , Vaneet Aggarwal

We introduce a novel data-driven order reduction method for nonlinear control systems, drawing on recent progress in machine learning and statistical dimensionality reduction. The method rests on the assumption that the nonlinear system…

Optimization and Control · Mathematics 2011-06-15 Jake Bouvrie , Boumediene Hamzi

The discovery of particle filtering methods has enabled the use of nonlinear filtering in a wide array of applications. Unfortunately, the approximation error of particle filters typically grows exponentially in the dimension of the…

Statistics Theory · Mathematics 2015-09-10 Patrick Rebeschini , Ramon van Handel

We provide general adaptive upper bounds for estimating nonparametric functionals based on second order U-statistics arising from finite dimensional approximation of the infinite dimensional models. We then provide examples of functionals…

Statistics Theory · Mathematics 2021-06-07 Lin Liu , Rajarshi Mukherjee , James Robins , Eric Tchetgen Tchetgen

We introduce a data-driven order reduction method for nonlinear control systems, drawing on recent progress in machine learning and statistical dimensionality reduction. The method rests on the assumption that the nonlinear system behaves…

Optimization and Control · Mathematics 2016-04-04 Jake Bouvrie , Boumediene Hamzi

It is proposed the algorithm that find a basis of the ideal and a basis of the space of all root functionals by using the extension operation for bounded root functionals, when the number of polynomials is equal to the number of variables,…

Algebraic Geometry · Mathematics 2008-06-01 Timur R. Seifullin

Nonlinear function estimation is core to modern machine learning applications. In this paper, to perform nonlinear function estimation, we reduce a nonlinear inverse problem to a linear one using a polynomial kernel expansion. These kernels…

Information Theory · Computer Science 2019-10-02 Hangjin Liu , You , Zhou , Ahmad Beirami , Dror Baron

This paper presents a Carleman-Fourier linearization method for nonlinear dynamical systems with periodic vector fields involving multiple fundamental frequencies. By employing Fourier basis functions, the nonlinear dynamical system is…

Dynamical Systems · Mathematics 2024-11-19 Panpan Chen , Nader Motee , Qiyu Sun

Radial Basis Function Networks (RBFNs) are used primarily to solve curve-fitting problems and for non-linear system modeling. Several algorithms are known for the approximation of a non-linear curve from a sparse data set by means of RBFNs.…

Neural and Evolutionary Computing · Computer Science 2009-09-25 Carlo Drioli , Davide Rocchesso

The effectiveness of non-parametric, kernel-based methods for function estimation comes at the price of high computational complexity, which hinders their applicability in adaptive, model-based control. Motivated by approximation techniques…

Statistics Theory · Mathematics 2023-03-17 Anna Scampicchio , Elena Arcari , Melanie N. Zeilinger

Sparse polynomial approximation has become indispensable for approximating smooth, high- or infinite-dimensional functions from limited samples. This is a key task in computational science and engineering, e.g., surrogate modelling in…

Numerical Analysis · Mathematics 2023-11-08 Ben Adcock , Simone Brugiapaglia , Nick Dexter , Sebastian Moraga

Sufficient dimension reduction is a powerful tool to extract core information hidden in the high-dimensional data and has potentially many important applications in machine learning tasks. However, the existing nonlinear sufficient…

Machine Learning · Computer Science 2022-10-11 Siqi Liang , Yan Sun , Faming Liang

Enhancing the existing solution for pricing of fixed income instruments within Black-Karasinski model structure, with neural network at various parameterisation points to demonstrate that the method is able to achieve superior outcomes for…

Computational Finance · Quantitative Finance 2024-04-16 Anna Knezevic

The optimal selection of experimental conditions is essential to maximizing the value of data for inference and prediction, particularly in situations where experiments are time-consuming and expensive to conduct. We propose a general…

Machine Learning · Statistics 2012-12-04 Xun Huan , Youssef M. Marzouk

A linear functional of an object from a convex symmetric set can be optimally estimated, in a worst-case sense, by a linear functional of observations made on the object. This well-known fact is extended here to a nonlinear setting: other…

Functional Analysis · Mathematics 2025-12-25 Simon Foucart

Purpose of writing this paper is to solve a transcendental function containing a product of a variable and its double exponential by a unique method of approximation. If the value of the said product is given, then its inverse function is…

Numerical Analysis · Mathematics 2025-11-25 Narinder Kumar Wadhawan

In a previous paper [Adcock & Huybrechs, 2019] we described the numerical approximation of functions using redundant sets and frames. Redundancy in the function representation offers enormous flexibility compared to using a basis, but…

Numerical Analysis · Mathematics 2020-07-13 Ben Adcock , Daan Huybrechs