Related papers: Some convergent results for Backtracking Gradient …

The main result of this paper is: {\bf Theorem.} Let $f:\mathbb{R}^k\rightarrow \mathbb{R}$ be a $C^{1}$ function, so that $\nabla f$ is locally Lipschitz continuous. Assume moreover that $f$ is $C^2$ near its generalised saddle points. Fix…

In unconstrained optimisation on an Euclidean space, to prove convergence in Gradient Descent processes (GD) $x_{n+1}=x_n-\delta _n \nabla f(x_n)$ it usually is required that the learning rates $\delta _n$'s are bounded: $\delta _n\leq…

While Standard gradient descent is one very popular optimisation method, its convergence cannot be proven beyond the class of functions whose gradient is globally Lipschitz continuous. As such, it is not actually applicable to realistic…

In this paper, we introduce some new iterative optimisation algorithms on Riemannian manifolds and Hilbert spaces which have good global convergence guarantees to local minima. More precisely, these algorithms have the following properties:…

In this paper, we give explicit descriptions of versions of (Local-) Backtracking Gradient Descent and New Q-Newton's method to the Riemannian setting.Here are some easy to state consequences of results in this paper, where X is a general…

We deal with isomorphic Banach-Stone type theorems for closed subspaces of vector-valued continuous functions. Let $\mathbb{F}=\mathbb{R}$ or $\mathbb{C}$. For $i=1,2$, let $E_i$ be a reflexive Banach space over $\mathbb{F}$ with a certain…

Concentration compactness method is a powerful techniques for establishing existence of minimizers for inequalities and of critical points of functionals in general. The paper gives a functional-analytic formulation for the method in Banach…

We characterize the class of separable Banach spaces $X$ such that for every continuous function $f:X\to\mathbb{R}$ and for every continuous function $\epsilon:X\to\mathbb(0,+\infty)$ there exists a $C^1$ smooth function $g:X\to\mathbb{R}$…

A nonempty closed convex bounded subset $C$ of a Banach space is said to have the weak approximate fixed point property if for every continuous map $f:C\to C$ there is a sequence $\{x_n\}$ in $C$ such that $x_n-f(x_n)$ converge weakly to 0.…

Our basic element is a $C^1$ mapping $f:X\to Y$, with $X,Y$ Banach spaces, and with derivative everywhere invertible. So $f$ is a local diffeomorphism at every point. The aim of this paper is to find a sufficient condition for $f$ to be…

In this paper, we introduce the notion of topologically Banach contraction mapping defined on an arbitrary topological space X with the help of a continuous function $g:X\times X\rightarrow \mathbb{R}$ and investigate the existence of fixed…

Given a non-convex twice differentiable cost function f, we prove that the set of initial conditions so that gradient descent converges to saddle points where \nabla^2 f has at least one strictly negative eigenvalue has (Lebesgue) measure…

Fix a constant $0<\alpha <1$. For a $C^1$ function $f:\mathbb{R}^k\rightarrow \mathbb{R}$, a point $x$ and a positive number $\delta >0$, we say that Armijo's condition is satisfied if $f(x-\delta \nabla f(x))-f(x)\leq -\alpha \delta…

We have derived that on certain Banach spaces having a graph structure $G$, the iterations for asymptotically $G$-nonexpansive map will converge weakly towards a fixed point. This result unifies and extends several theorems on fixed points…

We characterize those (continuously-normed) Banach bundles $\mathcal{E}\to X$ with compact Hausdorff base whose spaces $\Gamma(\mathcal{E})$ of global continuous sections are topologically finitely-generated over the function algebra…

We prove a Banach version of Garland's method of proving vanishing of cohomology for groups acting on simplicial complexes. The novelty of this new version is that our new condition applies to every reflexive Banach space. This new version…

We show that if $x$ is a strongly extreme point of a bounded closed convex subset of a Banach space and the identity has a geometrically and topologically good enough local approximation at $x$, then $x$ is already a denting point. It turns…

Let $X$ be a Banach space and let $C$ be a closed convex bounded subset of $X$. It is proved that $C$ is weakly compact if, and only if, $C$ has the {it generic} fixed point property ($\mathcal{G}$-FPP) for the class of $L$-bi-Lipschitz…

Let $X$ be a Banach space with separable dual. It is proved that for every $\varepsilon\in (0,1)$, $X$ embeds isometrically into a Banach space $W$ with a shrinking basis $(w_n)$ which is $(1+ \varepsilon)$-monotone. Moreover, if $X$ has…

A Banach space $X$ has \textit{property $(K)$}, whenever every weak* null sequence in the dual space admits a convex block subsequence $(f_{n})_{n=1}^\infty$ so that $\langle f_{n},x_{n}\rangle\to 0$ as $n\to \infty$ for every weakly null…