English
Related papers

Related papers: On regularization in superreflexive Banach spaces …

200 papers

This paper introduces a smoothed proximal Lagrangian method for minimizing a nonconvex smooth function over a convex domain with additional explicit convex nonlinear constraints. Two key features are 1) the proposed method is single-looped,…

Optimization and Control · Mathematics 2024-08-28 Wenqiang Pu , Kaizhao Sun , Jiawei Zhang

We study the problem of minimizing the sum of a smooth convex function and a convex block-separable regularizer and propose a new randomized coordinate descent method, which we call ALPHA. Our method at every iteration updates a random…

Optimization and Control · Mathematics 2015-06-16 Zheng Qu , Peter Richtárik

A regularization algorithm using inexact function values and inexact derivatives is proposed and its evaluation complexity analyzed. This algorithm is applicable to unconstrained problems and to problems with inexpensive constraints (that…

Optimization and Control · Mathematics 2019-04-22 S. Bellavia , G. Gurioli , B. Morini , Ph. L. Toint

This paper is devoted to the approximation of differentiable semialgebraic functions by Nash functions. Approximation by Nash functions is known for semialgebraic functions defined on an affine Nash manifold M, and here we extend it to…

Algebraic Geometry · Mathematics 2013-07-03 Elías Baro , José F. Fernando , Jesús M. Ruiz

It is well known in convex analysis that proximal mappings on Hilbert spaces are $1$-Lipschitz. In the present paper we show that proximal mappings on uniformly convex Banach spaces are uniformly continuous on bounded sets. Moreover, we…

Functional Analysis · Mathematics 2017-11-07 Miroslav Bacak , Ulrich Kohlenbach

This paper addresses the study and characterizations of variational convexity of extended-real-valued functions on Banach spaces. This notion has been recently introduced by Rockafellar, and its importance has been already realized and…

Optimization and Control · Mathematics 2023-08-29 Pham Duy Khanh , Vu Vinh Huy Khoa , Boris S. Mordukhovich , Vo Thanh Phat

We prove two theorems about differentiable functions on the Banach space C(K), where K is compact. (i) If C(K) admits a non-trivial function of class C^m and of bounded support, then all continuous real-valued functions on C(K) may be…

Functional Analysis · Mathematics 2007-05-23 Petr Hajek , Richard Haydon

We propose novel smooth approximations to the classical rounding function, suitable for differentiable optimization and machine learning applications. Our constructions are based on two approaches: (1) localized sigmoid window functions…

Machine Learning · Computer Science 2025-04-29 Stanislav Semenov

Recently, it has become evident that submodularity naturally captures widely occurring concepts in machine learning, signal processing and computer vision. Consequently, there is need for efficient optimization procedures for submodular…

Machine Learning · Computer Science 2013-11-19 Stefanie Jegelka , Francis Bach , Suvrit Sra

This paper studies the problem of approximating a function $f$ in a Banach space $X$ from measurements $l_j(f)$, $j=1,\dots,m$, where the $l_j$ are linear functionals from $X^*$. Most results study this problem for classical Banach spaces…

Numerical Analysis · Mathematics 2016-08-08 Ronald DeVore , Guergana Petrova , Przemyslaw Wojtaszczyk

The two-parametric Mittag-Leffler function (MLF), $E_{\alpha,\beta}$, is fundamental to the study and simulation of fractional differential and integral equations. However, these functions are computationally expensive and their numerical…

Numerical Analysis · Mathematics 2019-12-24 Ibrahim O. Sarumi , Khaled M. Furati , Abdul Q. M. Khaliq

This article delves into the study of the theory of regularized learning in Banach spaces for linear-functional data. It encompasses discussions on representer theorems, pseudo-approximation theorems, and convergence theorems. Regularized…

Machine Learning · Computer Science 2025-03-05 Qi Ye

We show that norms on certain Banach spaces $X$ can be approximated uniformly, and with arbitrary precision, on bounded subsets of $X$ by $C^{\infty}$ smooth norms and polyhedral norms. In particular, we show that this holds for any…

Functional Analysis · Mathematics 2022-06-22 Victor Bible , Richard J. Smith

The approximation properties of the finite element method can often be substantially improved by choosing smooth high-order basis functions. It is extremely difficult to devise such basis functions for partitions consisting of arbitrarily…

Numerical Analysis · Mathematics 2021-01-18 Eky Febrianto , Michael Ortiz , Fehmi Cirak

In this paper, we first study nonsmooth steepest descent method for nonsmooth functions defined on Hilbert space and establish the corresponding algorithm by proximal subgradients. Then, we use this algorithm to find stationary points for…

Optimization and Control · Mathematics 2015-02-25 Zhou Wei , Qing Hai He

In this paper, we provide near-optimal accelerated first-order methods for minimizing a broad class of smooth nonconvex functions that are strictly unimodal on all lines through a minimizer. This function class, which we call the class of…

Optimization and Control · Mathematics 2023-02-27 Oliver Hinder , Aaron Sidford , Nimit S. Sohoni

The direct and inverse theorems are established for the best approximation in the weighted $L^p$ space on the unit sphere of $\RR^{d+1}$, in which the weight functions are invariant under finite reflection groups. The theorems are stated…

Classical Analysis and ODEs · Mathematics 2007-05-23 Yuan Xu

Convex functionals are ubiquitous in applied analysis, appearing as value functions, risk measures, super-hedging prices, and loss functionals in machine learning. In many applications, however, the functional is only observed through…

Functional Analysis · Mathematics 2026-05-12 Anastasis Kratsios

We study linear function approximation in a finite basis under finite-precision arithmetic. In a highly non-orthogonal basis, certain directions are only weakly represented, so that rounding errors can significantly distort the effectively…

Numerical Analysis · Mathematics 2026-03-17 Astrid Herremans , Daan Huybrechs

This paper tackles the unconstrained minimization of a class of nonsmooth and nonconvex functions that can be written as finite max-functions. A gradient and function-based sampling method is proposed which, under special circumstances,…

Optimization and Control · Mathematics 2019-04-03 Elias S. Helou , Sandra A. Santos , Lucas E. A. Simões