English
Related papers

Related papers: Best Simultaneous Approximation of Functions and a…

200 papers

Most real-world problems have huge state and/or action spaces. Therefore, a naive application of existing tabular solution methods is not tractable on such problems. Nonetheless, these solution methods are quite useful if an agent has…

Machine Learning · Computer Science 2018-11-12 Sultan Javed Majeed , Marcus Hutter

We show that in finite-dimensional nonlinear approximations, the best $r$-term approximant of a function $f$ almost always exists over $\mathbb{C}$ but that the same is not true over $\mathbb{R}$, i.e., the infimum $\inf_{f_1,\dots,f_r \in…

Numerical Analysis · Mathematics 2018-09-07 Yang Qi , Mateusz Michałek , Lek-Heng Lim

Many machine learning and optimization algorithms can be cast as instances of stochastic approximation (SA). The convergence rate of these algorithms is known to be slow, with the optimal mean squared error (MSE) of order $O(n^{-1})$. In…

Optimization and Control · Mathematics 2024-09-13 Caio Kalil Lauand , Sean Meyn

This paper introduces a version of the argmax continuous mapping theorem that applies to M-estimation problems in which the objective functions converge to a limiting process with multiple maximizers. The concept of the smallest maximizer…

Statistics Theory · Mathematics 2011-05-09 Emilio Seijo , Bodhisattva Sen

Unitary best approximation to the exponential function on an interval on the imaginary axis has been introduced recently. In the present work two algorithms are considered to compute this best approximant: an algorithm based on rational…

Numerical Analysis · Mathematics 2025-04-15 Tobias Jawecki

We give a number of approximation metatheorems for monotone maximization problems expressible in the first-order logic, in substantially more general settings than the previously known. We obtain * constant-factor approximation algorithm in…

Discrete Mathematics · Computer Science 2021-10-12 Zdeněk Dvořák

Functions with uniform sublevel sets can represent orders, preference relations or other binary relations and thus turn out to be a tool for scalarization that can be used in multicriteria optimization, decision theory, mathematical…

Optimization and Control · Mathematics 2017-12-06 Petra Weidner

We show that proximal minimization algorithms (PMA), majorization minimization (MM), and alternating minimization (AM) are equivalent. Each type of algorithm leads to a decreasing sequence of objective function. New conditions on PMA are…

Numerical Analysis · Mathematics 2015-12-10 Charles L. Byrne , Jong Soo Lee

We consider a general asynchronous Stochastic Approximation (SA) scheme featuring a weighted infinity-norm contractive operator, and prove a bound on its finite-time convergence rate on a single trajectory. Additionally, we specialize the…

Optimization and Control · Mathematics 2020-02-06 Guannan Qu , Adam Wierman

We present a new neural network to approximate convex functions. This network has the particularity to approximate the function with cuts and can be easily adapted to partial convexity. We give an universal approximation theorem in the full…

Optimization and Control · Mathematics 2023-01-27 Xavier Warin

In this paper we introduce two conceptual algorithms for minimising abstract convex functions. Both algorithms rely on solving a proximal-type subproblem with an abstract Bregman distance based proximal term. We prove their convergence when…

Optimization and Control · Mathematics 2026-01-09 Reinier Díaz Millán , Julien Ugon

Consider a sum of convex functions, where the only information known about each individual summand is the location of a minimizer. In this work, we give an exact characterization of the set of possible minimizers of the sum. Our results…

Optimization and Control · Mathematics 2024-03-11 Moslem Zamani , François Glineur , Julien M. Hendrickx

We prove when a Banach ideal of linear operators defined, or characterized, by the transformation of vector-valued sequences is maximal. Known results are recovered as particular cases and new information is obtained. To accomplish this…

Functional Analysis · Mathematics 2022-06-22 Geraldo Botelho , Jamilson R. Campos , Lucas Nascimento

In this note we use recent results concerning the sum theorem for maximal monotone multifunctions in general Banach spaces to find new characterizations and properties of regular maximal monotone multifunctions and then use these to…

Functional Analysis · Mathematics 2008-12-16 Andrei Verona , Maria Elena Verona

We address the problem of the best uniform approximation by linear combinations of a finite system of functions. If the system is Chebyshev and the problem is unconstrained, then the classical Remez algorithm provides a fast and precise…

Numerical Analysis · Mathematics 2025-07-08 Vladimir Yu. Protasov , Rinat Kamalov

A synchronizing word of a deterministic finite complete automaton is a word whose action maps every state to a single one. Finding a shortest or a short synchronizing word is a central computational problem in the theory of synchronizing…

Formal Languages and Automata Theory · Computer Science 2022-07-13 Marek Szykuła , Adam Zyzik

We consider scalar equilibrium problems governed by a bifunction in a finite-dimensional framework. By using classical arguments in Convex Analysis, we show that under suitable generalized convexity assumptions imposed on the bifunction,…

Optimization and Control · Mathematics 2024-01-02 Valerian-Alin Fodor , Nicolae Popovici

The optimization problem concerning the determination of the minimizer for the sum of convex functions holds significant importance in the realm of distributed and decentralized optimization. In scenarios where full knowledge of the…

Optimization and Control · Mathematics 2024-09-24 Kananart Kuwaranancharoen , Shreyas Sundaram

In the classical best approximation pair (BAP) problem, one is given two nonempty, closed, convex and disjoint subsets in a finite- or an infinite-dimensional Hilbert space, and the goal is to find a pair of points, each from each subset,…

Optimization and Control · Mathematics 2025-09-09 Daniel Reem , Yair Censor

We consider approximation by functions with finite support and characterize its approximation spaces in terms of interpolation spaces and Lorentz spaces.

Classical Analysis and ODEs · Mathematics 2017-07-05 Bo Ling , Yongping Liu