English
Related papers

Related papers: Global and fine approximation of convex functions

200 papers

The universal approximation theorem, in one of its most general versions, says that if we consider only continuous activation functions $\sigma$, then a standard feedforward neural network with one hidden layer is able to approximate any…

Machine Learning · Computer Science 2020-02-18 Kai Fong Ernest Chong

Let $X$ be a separable Banach space with a separating polynomial. We show that there exists $C\geq 1$ (depending only on $X$) such that for every Lipschitz function $f:X\rightarrow\mathbb{R}$, and every $\epsilon>0$, there exists a…

Functional Analysis · Mathematics 2011-01-04 D. Azagra , R. Fry , L. Keener

We consider minimization of functions that are compositions of convex or prox-regular functions (possibly extended-valued) with smooth vector functions. A wide variety of important optimization problems fall into this framework. We describe…

Optimization and Control · Mathematics 2015-04-24 A. S. Lewis , S. J. Wright

We generalize Newton-type methods for minimizing smooth functions to handle a sum of two convex functions: a smooth function and a nonsmooth function with a simple proximal mapping. We show that the resulting proximal Newton-type methods…

Machine Learning · Statistics 2014-03-19 Jason D. Lee , Yuekai Sun , Michael A. Saunders

This note establishes smooth approximation from above for J-plurisubharmonic functions on an almost complex manifold (X,J). The following theorem is proved. Suppose X is J-pseudoconvex, i.e., X admits a smooth strictly J-plurisubharmonic…

Complex Variables · Mathematics 2017-12-12 F. Reese Harvey , H. Blaine Lawson, , Szymon Pliś

Let $C$ be a compact convex subset of $\mathbb{R}^n$, $f:C\to\mathbb{R}$ be a convex function, and $m\in\{1, 2, ..., \infty\}$. Assume that, along with $f$, we are given a family of polynomials satisfying Whitney's extension condition for…

Classical Analysis and ODEs · Mathematics 2019-03-05 Daniel Azagra , Carlos Mudarra

This paper conglomerates our findings on the space $C(X)$ of all real valued continuous functions, under different generalizations of the topology of uniform convergence and the $m$-topology. The paper begins with answering all the…

General Topology · Mathematics 2024-11-01 Pratip Nandi , Rakesh Bharati , Atasi Deb Ray , Sudip Kumar Acharyya

We analyze the universal approximation property of Kolmogorov-Arnold Networks (KANs) in terms of their edge functions. If these functions are all affine, then universality clearly fails. How many non-affine functions are needed, in addition…

Machine Learning · Computer Science 2026-05-19 Vugar Ismailov

Operator convex functions defined on the positive half-line play a prominent role in the theory of quantum information, where they are used to define quantum $f$-divergences. Such functions admit integral representations in terms of…

Optimization and Control · Mathematics 2023-05-23 Oisín Faust , Hamza Fawzi

Let X be a separable Banach space which admits a separating polynomial; in particular X a separable Hilbert space. Let $f:X \rightarrow R$ be bounded, Lipschitz, and $C^1$ with uniformly continuous derivative. Then for each {\epsilon}>0,…

Functional Analysis · Mathematics 2010-11-23 D. Azagra , R. Fry , L. Keener

Estimation of convex functions finds broad applications in engineering and science, while convex shape constraint gives rise to numerous challenges in asymptotic performance analysis. This paper is devoted to minimax optimal estimation of…

Statistics Theory · Mathematics 2013-06-11 Teresa M. Lebair , Jinglai Shen , Xiao Wang

We show that for every Lipschitz function $f$ defined on a separable Riemannian manifold $M$ (possibly of infinite dimension), for every continuous $\epsilon:M\to (0,+\infty)$, and for every positive number $r>0$, there exists a $C^\infty$…

Differential Geometry · Mathematics 2007-05-23 D. Azagra , J. Ferrera , F. Lopez-Mesas , Y. Rangel

The classic Riesz representation theorem characterizes all linear and increasing functionals on the space $C_{c}(X)$ of continuous compactly supported functions. A geometric version of this result, which characterizes all linear increasing…

Functional Analysis · Mathematics 2021-05-20 Liran Rotem

On any metric space, I provide an intrinsic characterization of those complex-valued functions which are uniform limits of Lipschitz functions. There are applications to function theory on complete Riemannian manifolds and, in particular,…

Functional Analysis · Mathematics 2021-05-18 L. A. Coburn

Based on the characterization of the polyconvex envelope of isotropic functions by their signed singular value representations, we propose a simple algorithm for the numerical approximation of the polyconvex envelope. Instead of operating…

Numerical Analysis · Mathematics 2023-07-31 Timo Neumeier , Malte A. Peter , Daniel Peterseim , David Wiedemann

This paper deals with approximation of smooth convex functions $f$ on an interval by convex algebraic polynomials which interpolate $f$ at the endpoints of this interval. We call such estimates "interpolatory". One important corollary of…

Classical Analysis and ODEs · Mathematics 2020-04-21 K. A. Kopotun , D. Leviatan , I. Petrova , I. A. Shevchuk

This paper demonstrates that the space of piecewise smooth functions can be well approximated by the space of functions defined by a set of simple (non-linear) operations on smooth uniform splines. The examples include bivariate functions…

Numerical Analysis · Mathematics 2024-05-13 David Levin

We introduce new global and local inexact oracle concepts for a wide class of convex functions in composite convex minimization. Such inexact oracles naturally come from primal-dual framework, barrier smoothing, inexact computations of…

Optimization and Control · Mathematics 2020-02-25 Tianxiao Sun , Ion Necoara , Quoc Tran-Dinh

In the recent paper \cite{Aza:19} D Azagra studies the global shape of continuous convex functions defined on a Banach space $X$. More precisely, when $X$ is separable, it is shown that for every continuous convex function…

Functional Analysis · Mathematics 2020-01-22 Constantin Zalinescu

We prove that if f : R^N --> R is quasiconvex and U is open in the density topology of R^N, then sup_U f = ess sup_U f, while inf_U f = ess inf_U f if and only if the equality holds when U = R^N. The first (second) property is typical of…

Metric Geometry · Mathematics 2019-08-15 Patrick J. Rabier