English
Related papers

Related papers: Approximating maps into manifolds with lower curva…

200 papers

We contribute to a better understanding of the class of functions that can be represented by a neural network with ReLU activations and a given architecture. Using techniques from mixed-integer optimization, polyhedral theory, and tropical…

Machine Learning · Computer Science 2024-07-18 Christoph Hertrich , Amitabh Basu , Marco Di Summa , Martin Skutella

Recently manifold learning algorithm for dimensionality reduction attracts more and more interests, and various linear and nonlinear, global and local algorithms are proposed. The key step of manifold learning algorithm is the neighboring…

Methodology · Statistics 2017-04-14 Lin Ma , Caifa Zhou , Xi Liu , Yubin Xu

The techniques and analysis presented in this thesis provide new methods to solve optimization problems posed on Riemannian manifolds. These methods are applied to the subspace tracking problem found in adaptive signal processing and…

Optimization and Control · Mathematics 2013-05-09 Steven Thomas Smith

In this work we consider the problem of estimating function-on-scalar regression models when the functions are observed over multi-dimensional or manifold domains and with potentially multivariate output. We establish the minimax rates of…

Statistics Theory · Mathematics 2019-02-21 Matthew Reimherr , Bharath Sriperumbudur , Hyun Bin Kang

In this paper, we extend the proximal point algorithm for vector optimization from the Euclidean space to the Riemannian context. Under suitable assumptions on the objective function the well definition and full convergence of the method to…

Optimization and Control · Mathematics 2015-12-21 G. C. Bento , O. P. Ferreira , Y. R. L. Pereira

We consider the problem of approximating an affinely structured matrix, for example a Hankel matrix, by a low-rank matrix with the same structure. This problem occurs in system identification, signal processing and computer algebra, among…

Numerical Analysis · Mathematics 2014-06-25 Mariya Ishteva , Konstantin Usevich , Ivan Markovsky

This paper considers optimization problems on Riemannian manifolds and analyzes iteration-complexity for gradient and subgradient methods on manifolds with non-negative curvature. By using tools from the Riemannian convex analysis and…

Numerical Analysis · Mathematics 2016-09-19 G. C. Bento , O. P. Ferreira , J. G. Melo

The objective of the paper is to describe Besov spaces on general compact Riemannian manifolds in terms of the best approximation by eigenfunctions of elliptic differential operators.

Functional Analysis · Mathematics 2015-03-16 Isaac Z. Pesenson

This paper formulates the problem of Extremum Seeking for optimization of cost functions defined on Riemannian manifolds. We extend the conventional extremum seeking algorithms for optimization problems in Euclidean spaces to optimization…

Optimization and Control · Mathematics 2014-12-10 Farzin Taringoo , Peter M. Dower , Dragan Nesic , Ying Tan

We propose an inexact optimization algorithm on Riemannian manifolds, motivated by quadratic discrimination tasks in high-dimensional, low-sample-size (HDLSS) imaging settings. In such applications, gradient evaluations are often biased due…

Optimization and Control · Mathematics 2025-07-08 Uday Talwar , Meredith K. Kupinski , Afrooz Jalilzadeh

For compact self-adjoint operators in Hilbert spaces, two algorithms are proposed to provide fully computable a posteriori error estimate for eigenfunction approximation. Both algorithms apply well to the case of tight clusters and multiple…

Numerical Analysis · Mathematics 2022-07-19 Xuefeng Liu , Tomáš Vejchodský

In computational practice, most attention is paid to rational approximations of functions and approximations by the sum of exponents. We consider a wide enough class of nonlinear approximations characterized by a set of two required…

Numerical Analysis · Mathematics 2023-01-18 Petr N. Vabishchevich

In this paper, we consider the problem of manifold approximation with affine subspaces. Our objective is to discover a set of low dimensional affine subspaces that represents manifold data accurately while preserving the manifold's…

Machine Learning · Computer Science 2015-09-08 Sofia Karygianni , Pascal Frossard

This paper develops a functional-analytic framework for approximating the push-forward induced by an analytic map from finitely many samples. Instead of working directly with the map, we study the push-forward on the space of locally…

Numerical Analysis · Mathematics 2026-04-22 Isao Ishikawa

In this paper, we provide a generalization of the forward-backward splitting algorithm for minimizing the sum of a proper convex lower semicontinuous function and a differentiable convex function whose gradient satisfies a locally…

Optimization and Control · Mathematics 2023-06-29 Luis M. Briceno-Arias , Francisco José Silva , Xianjin Yang

The purpose of the paper is to provide a characterization of the error of the best polynomial approximation of composite functions in weighted spaces. Such a characterization is essential for the convergence analysis of numerical methods…

Numerical Analysis · Mathematics 2023-08-14 Luisa Fermo , Concetta Laurita , Maria Grazia Russo

We study the convergence issue for the gradient algorithm (employing general step sizes) for optimization problems on general Riemannian manifolds (without curvature constraints). Under the assumption of the local convexity/quasi-convexity…

Optimization and Control · Mathematics 2019-10-08 Chong Li , Xiangmei Wang , Jinhua Wang , Jen-Chih Yao

Motivated by numerical methods for solving parametric partial differential equations, this paper studies the approximation of multivariate analytic functions by algebraic polynomials. We introduce various anisotropic model classes based on…

Numerical Analysis · Mathematics 2020-01-17 Andrea Bonito , Ronald DeVore , Diane Guignard , Peter Jantsch , Guergana Petrova

This paper integrates manifold learning techniques within a \emph{Gaussian process upper confidence bound} algorithm to optimize an objective function on a manifold. Our approach is motivated by applications where a full representation of…

Machine Learning · Statistics 2023-11-10 Hwanwoo Kim , Daniel Sanz-Alonso , Ruiyi Yang

This paper demonstrates that the space of piecewise smooth functions can be well approximated by the space of functions defined by a set of simple (non-linear) operations on smooth uniform splines. The examples include bivariate functions…

Numerical Analysis · Mathematics 2024-05-13 David Levin