English
Related papers

Related papers: Learning multivariate functions with low-dimension…

200 papers

The focus of this article is the approximation of functions which are analytic on a compact interval except at the endpoints. Typical numerical methods for approximating such functions depend upon the use of particular conformal maps from…

Numerical Analysis · Mathematics 2014-05-05 Ben Adcock , Mark Richardson

Nonlinear expressions are often approximated by piecewise affine (PWA) functions to simplify analysis or reduce computational costs. To reduce computational complexity, multivariate functions can be represented as compositions of functions…

Systems and Control · Electrical Eng. & Systems 2024-02-27 Jonah J. Glunt , Jacob A. Siefert , Andrew F. Thompson , Herschel C. Pangborn

Low-rank matrix approximations, such as the truncated singular value decomposition and the rank-revealing QR decomposition, play a central role in data analysis and scientific computing. This work surveys and extends recent research which…

Numerical Analysis · Mathematics 2014-04-29 Nathan Halko , Per-Gunnar Martinsson , Joel A. Tropp

Low-rank decomposition has emerged as a vital tool for enhancing parameter efficiency in neural network architectures, gaining traction across diverse applications in machine learning. These techniques significantly lower the number of…

Machine Learning · Computer Science 2025-03-18 Yiping Ji , Hemanth Saratchandran , Cameron Gordon , Zeyu Zhang , Simon Lucey

We propose, and illustrate via a neural network example, two different approaches to coarse-graining large heterogeneous networks. Both approaches are inspired from, and use tools developed in, methods for uncertainty quantification in…

Adaptation and Self-Organizing Systems · Physics 2016-11-03 Minseok Choi , Tom Bertalan , Carlo R. Laing , Ioannis G. Kevrekidis

This work investigates a new approach to find closed form analytical approximate solution of linear initial value problems. Classical Bernoulli polynomials have been used to derive a finite set of orthonormal polynomials and a finite…

Numerical Analysis · Mathematics 2020-07-27 Udaya Pratap Singh

There are many uses for linear fitting; the context here is interpolation and denoising of data, as when you have calibration data and you want to fit a smooth, flexible function to those data. Or you want to fit a flexible function to…

Data Analysis, Statistics and Probability · Physics 2021-09-22 David W. Hogg , Soledad Villar

In the paper we consider the problem of multivariate function approximation in polynomial basis. In order to solve this problem, we adjust the least squares method (LSM) by adding information about derivatives of the function. This…

Numerical Analysis · Mathematics 2018-02-06 Gleb Ryzhakov , Ivan Oseledets

Multi-dimensional functional data arises in numerous modern scientific experimental and observational studies. In this paper we focus on longitudinal functional data, a structured form of multidimensional functional data. Operating within a…

Methodology · Statistics 2019-09-20 John Shamshoian , Damla Senturk , Shafali Jeste , Donatello Telesca

We present a twofold contribution to the numerical simulation of Lindblad equations. First, an adaptive numerical approach to approximate Lindblad equations using low-rank dynamics is described: a deterministic low-rank approximation of the…

Quantum Physics · Physics 2015-12-30 Claude Le Bris , Pierre Rouchon , Julien Roussel

In a previous paper [1] it was discussed the viability of functional analysis using as a basis a couple of generic functions, and hence vectorial decomposition. Here we complete the paradigm exploiting one of the analysis methodologies…

Numerical Analysis · Computer Science 2013-11-26 Sossio Vergara

We extend the well-known Shannon decomposition of Boolean functions to more general classes of functions. Such decompositions, which we call pivotal decompositions, express the fact that every unary section of a function only depends upon…

Rings and Algebras · Mathematics 2014-06-10 Jean-Luc Marichal , Bruno Teheux

We present a description of the function space and the smoothness class associated with a convolutional network using the machinery of reproducing kernel Hilbert spaces. We show that the mapping associated with a convolutional network…

Machine Learning · Statistics 2020-11-17 Meyer Scetbon , Zaid Harchaoui

As demonstrated in many areas of real-life applications, neural networks have the capability of dealing with high dimensional data. In the fields of optimal control and dynamical systems, the same capability was studied and verified in many…

Machine Learning · Computer Science 2020-12-04 Wei Kang , Qi Gong

In the analysis of High-Energy Physics data, it is frequently desired to separate resonant signals from a smooth, non-resonant background. This paper introduces a new technique - functional decomposition (FD) - to accomplish this task. It…

Data Analysis, Statistics and Probability · Physics 2018-05-15 Ryan Edgar , Dante Amidei , Christopher Grud , Karishma Sekhon

Black-box model structures are dominated by large multivariate functions. Usually a generic basis function expansion is used, e.g. a polynomial basis, and the parameters of the function are tuned given the data. This is a pragmatic and…

Systems and Control · Electrical Eng. & Systems 2021-05-19 Jan Decuyper , Koen Tiels , Siep Weiland , Johan Schoukens

We propose a functional view of matrix decomposition problems on graphs such as geometric matrix completion and graph regularized dimensionality reduction. Our unifying framework is based on the key idea that using a reduced basis to…

Machine Learning · Computer Science 2021-02-08 Abhishek Sharma , Maks Ovsjanikov

We study the approximation of functions which are invariant with respect to certain permutations of the input indices using flow maps of dynamical systems. Such invariant functions includes the much studied translation-invariant ones…

Machine Learning · Computer Science 2022-08-19 Qianxiao Li , Ting Lin , Zuowei Shen

The high-dimensional data setting, in which p >> n, is a challenging statistical paradigm that appears in many real-world problems. In this setting, learning a compact, low-dimensional representation of the data can substantially help…

Machine Learning · Computer Science 2018-08-07 Micol Marchetti-Bowick , Benjamin J. Lengerich , Ankur P. Parikh , Eric P. Xing

Nonlinear state-space modelling is a very powerful black-box modelling approach. However powerful, the resulting models tend to be complex, described by a large number of parameters. In many cases interpretability is preferred over…

Systems and Control · Electrical Eng. & Systems 2020-06-24 Jan Decuyper , Koen Tiels , Mark C. Runacres , Johan Schoukens