English
Related papers

Related papers: Eignets for function approximation on manifolds

200 papers

For many machine learning problem settings, particularly with structured inputs such as sequences or sets of objects, a distance measure between inputs can be specified more naturally than a feature representation. However, most standard…

Machine Learning · Statistics 2018-05-28 Lingfei Wu , Ian En-Hsu Yen , Fangli Xu , Pradeep Ravikumar , Michael Witbrock

We present an algorithm for approximating a function defined over a $d$-dimensional manifold utilizing only noisy function values at locations sampled from the manifold with noise. To produce the approximation we do not require any…

Machine Learning · Statistics 2020-08-13 Barak Sober , Yariv Aizenbud , David Levin

Kernel methods represent one of the most powerful tools in machine learning to tackle problems expressed in terms of function values and derivatives due to their capability to represent and model complex relations. While these methods show…

Statistics Theory · Mathematics 2015-11-06 Bharath K. Sriperumbudur , Zoltan Szabo

We introduce a simple, general, and convergent scheme to compute generalized eigenfunctions of self-adjoint operators with continuous spectra on rigged Hilbert spaces. Our approach does not require prior knowledge about the eigenfunctions,…

Numerical Analysis · Mathematics 2024-10-14 Matthew J. Colbrook , Andrew Horning , Tianyiwa Xie

Many applications require the calculation of integrals of multidimensional functions. A general and popular procedure is to estimate integrals by averaging multiple evaluations of the function. Often, each evaluation of the function entails…

Machine Learning · Statistics 2021-03-31 Kartic Subr

We show that any smooth bi-Lipschitz $h$ can be represented exactly as a composition $h_m \circ ... \circ h_1$ of functions $h_1,...,h_m$ that are close to the identity in the sense that each $\left(h_i-\mathrm{Id}\right)$ is Lipschitz, and…

Machine Learning · Computer Science 2018-04-17 Peter L. Bartlett , Steven N. Evans , Philip M. Long

Motivated by conforming finite element methods for elliptic problems of second order, we analyze the approximation of the gradient of a target function by continuous piecewise polynomial functions over a simplicial mesh. The main result is…

Numerical Analysis · Mathematics 2018-03-07 Andreas Veeser

This paper concerns the universal approximation property with neural networks in variable Lebesgue spaces. We show that, whenever the exponent function of the space is bounded, every function can be approximated with shallow neural networks…

Functional Analysis · Mathematics 2020-07-09 Ángela Capel , Jesús Ocáriz

We develop a framework for function classes generated by parametric ridge kernels: one-dimensional kernels composed with affine projections and averaged over a parameter measure. The induced kernels are positive definite, and the resulting…

Functional Analysis · Mathematics 2025-08-26 James Tian

This work considers an Inertial version of Bregman Proximal Gradient algorithm (IBPG) for minimizing the sum of two single-valued functions in finite dimension. We suppose that one of the functions is proper, closed, and convex but…

Optimization and Control · Mathematics 2025-01-30 Jean-Jacques Godeme

We study the approximation of functions that map a Euclidean domain $\Omega\subset \mathbb{R}^{d}$ into an $n$-dimensional Riemannian manifold $(M,g)$ minimizing an elliptic, semilinear energy in a function set $H\subset W^{1,2}(\Omega,M)$.…

Numerical Analysis · Mathematics 2018-05-25 Hanne Hardering

This paper addresses the problem of finding a B-term wavelet representation of a given discrete function $f \in \real^n$ whose distance from f is minimized. The problem is well understood when we seek to minimize the Euclidean distance…

Data Structures and Algorithms · Computer Science 2007-07-23 Sudipto Guha , Boulos Harb

In this paper, we present a sharper version of the results in the paper Dimension independent bounds for general shallow networks; Neural Networks, \textbf{123} (2020), 142-152. Let $\mathbb{X}$ and $\mathbb{Y}$ be compact metric spaces. We…

Machine Learning · Computer Science 2023-12-12 Hrushikesh Mhaskar , Tong Mao

Many interesting functions arising in applications map into Riemannian manifolds. We present an algorithm, using the manifold exponential and logarithm, for approximating such functions. Our approach extends approximation techniques for…

Numerical Analysis · Mathematics 2026-01-27 Simon Jacobsson , Raf Vandebril , Joeri van der Veken , Nick Vannieuwenhoven

In much of the literature on function approximation by deep networks, the function is assumed to be defined on some known domain, such as a cube or a sphere. In practice, the data might not be dense on these domains, and therefore, the…

Machine Learning · Computer Science 2020-08-21 Hrushikesh Mhaskar

We present a constructive universal approximation theorem for learning machines equipped with joint-group-equivariant feature maps, called the joint-equivariant machines, based on the group representation theory. ``Constructive'' here…

Machine Learning · Computer Science 2025-06-10 Sho Sonoda , Yuka Hashimoto , Isao Ishikawa , Masahiro Ikeda

If f is a smooth function on a Hodge manifold, we construct a canonical sequence of real algebraic functions that converge to f in the smooth topology. The definition of of the approximants is inspired by Berezin-Toeplitz quantization. The…

Differential Geometry · Mathematics 2010-11-23 Alessandro Ghigi

Random feature approximation is arguably one of the most popular techniques to speed up kernel methods in large scale algorithms and provides a theoretical approach to the analysis of deep neural networks. We analyze generalization…

Machine Learning · Computer Science 2023-08-30 Mike Nguyen , Nicole Mücke

We introduce a novel type of approximation spaces for functions with values in a nonlinear manifold. The discrete functions are constructed by piecewise polynomial interpolation in a Euclidean embedding space, and then projecting pointwise…

Numerical Analysis · Mathematics 2018-03-20 Philipp Grohs , Hanne Hardering , Oliver Sander , Markus Sprecher

Let $M$ be a complete Riemannian manifold, $N\in \NN$ and $p\ge 1$. We prove that almost everywhere on $x=(x_1,...,x_N)\in M^N$ for Lebesgue measure in $M^N$, the measure $\di \mu(x)=\f1N\sum_{k=1}^N\d_{x_k}$ has a unique $p$-mean $e_p(x)$.…

Probability · Mathematics 2012-07-16 Marc Arnaudon , Laurent Miclo