English
Related papers

Related papers: On Busemann subgradient methods for stochastic min…

200 papers

We investigate the implementation of a new stochastic Kuramoto-Vicsek-type model for global optimization of nonconvex functions on the sphere. This model belongs to the class of Consensus-Based Optimization. In fact, particles move on the…

Machine Learning · Computer Science 2021-07-29 Massimo Fornasier , Hui Huang , Lorenzo Pareschi , Philippe Sünnen

In this paper, we introduce the tamed stochastic gradient descent method (TSGD) for optimization problems. Inspired by the tamed Euler scheme, which is a commonly used method within the context of stochastic differential equations, TSGD is…

Optimization and Control · Mathematics 2021-06-18 Monika Eisenmann , Tony Stillfjord

We prove convergence of a single time-scale stochastic subgradient method with subgradient averaging for constrained problems with a nonsmooth and nonconvex objective function having the property of generalized differentiability. As a tool…

Optimization and Control · Mathematics 2019-12-17 Andrzej Ruszczynski

A convergence theorem for the continuous weak approximation of the solution of stochastic differential equations by general one step methods is proved, which is an extension of a theorem due to Milstein. As an application, uniform second…

Numerical Analysis · Mathematics 2013-03-19 Kristian Debrabant , Andreas Rößler

In a recent paper, Colliot-Th\'el\`ene, Parimala and Suresh conjectured that a local-global principle holds for projective homogeneous spaces of connected linear algebraic groups over function fields of p-adic curves. In this paper, we show…

Number Theory · Mathematics 2019-08-02 Zhengyao Wu

We establish a weak Harnack inequality for nonlocal $W^{s,1}$-subminimizers in a complete, connected, doubling metric measure space where $0<s<1$. As a corollary, we prove that $W^{s,1}$-subminimizers are semicontinuous, up to a suitable…

Analysis of PDEs · Mathematics 2026-03-24 Panu Lahti , Yuxin Li , Khanh Nguyen

We revisit certain path-lifting and path-continuation properties of abstract maps as described in the work of F. Browder and R. Rheindboldt in 1950-1960s, and apply their elegant theory to exponential maps. We obtain thereby a number of…

Differential Geometry · Mathematics 2021-08-02 Ivan P. Costa e Silva , José L. Flores , Kledilson P. R. Honorato

This paper introduces a novel steepest descent flow in Banach spaces. This extends previous works on generalized gradient descent, notably the work of Charpiat et al., to the setting of Finsler metrics. Such a generalized gradient allows…

Numerical Analysis · Mathematics 2015-12-08 Guillaume Charpiat , Giacomo Nardi , Gabriel Peyré , François-Xavier Vialard

Two BPHZ convergence theorems are proved directly in Euclidean position space, without exponentiating the propagators, making use of the Cluster Convergence Theorem presented previously. The first theorem proves the absolute convergence of…

High Energy Physics - Theory · Physics 2007-05-23 Chris Austin

To compute the spatially distributed dielectric constant from the backscattering data, we study a coefficient inverse problem for a 1D hyperbolic equation. To solve the inverse problem, we establish a new version of Carleman estimate and…

Numerical Analysis · Mathematics 2021-04-26 Michael V. Klibanov , Thuy T. Le , Loc H. Nguyen , Anders Sullivan , Lam Nguyen

We give a convergence proof for the approximation by sparse collocation of Hilbert-space-valued functions depending on countably many Gaussian random variables. Such functions appear as solutions of elliptic PDEs with lognormal diffusion…

Numerical Analysis · Mathematics 2017-03-29 Oliver G. Ernst , Björn Sprungk , Lorenzo Tamellini

We study some methods of subgradient projections for solving a convex feasibility problem with general (not necessarily hyperplanes or half-spaces) convex sets in the inconsistent case and propose a strategy that controls the relaxation…

Optimization and Control · Mathematics 2010-09-21 Dan Butnariu , Yair Censor , Pini Gurfil , Ethan Hadar

Many problems in statistical learning, imaging, and computer vision involve the optimization of a non-convex objective function with singularities at the boundary of the feasible set. For such challenging instances, we develop a new…

Optimization and Control · Mathematics 2019-11-07 Pavel Dvurechensky , Mathias Staudigl , César A. Uribe

While classic work in convex-concave min-max optimization relies on average-iterate convergence results, the emergence of nonconvex applications such as training Generative Adversarial Networks has led to renewed interest in last-iterate…

Optimization and Control · Mathematics 2019-10-29 Jacob Abernethy , Kevin A. Lai , Andre Wibisono

In this paper we address the convergence of stochastic approximation when the functions to be minimized are not convex and nonsmooth. We show that the "mean-limit" approach to the convergence which leads, for smooth problems, to the ODE…

Optimization and Control · Mathematics 2018-05-08 Szymon Majewski , Błażej Miasojedow , Eric Moulines

In this paper, we prove a mean ergodic theorem for nonexpansive mappings in Hadamard (nonpositive curvature metric) spaces, which extends the Baillon nonlinear ergodic theorem. The main result shows that the sequence given by the Karcher…

Functional Analysis · Mathematics 2021-05-07 Hadi Khatibzadeh , Hadi Pouladi

In this paper, is introduced a new proposal of resolvent for equilibrium problems in terms of the Busemann's function. A great advantage of this new proposal is that, in addition to be a natural extension of the proposal in the linear…

Optimization and Control · Mathematics 2021-11-09 G. C. Bento , J. X. Cruz Neto , I. D. L. Melo

This paper introduces and studies the convergence properties of a new class of explicit $\epsilon$-subgradient methods for the task of minimizing a convex function over the set of minimizers of another convex minimization problem. The…

Optimization and Control · Mathematics 2019-04-03 Elias Salomão Helou , Lucas Eduardo Azevedo Simões

A subgradient method is presented for solving general convex optimization problems, the main requirement being that a strictly-feasible point is known. A feasible sequence of iterates is generated, which converges to within user-specified…

Optimization and Control · Mathematics 2016-05-30 James Renegar

We propose a new subgradient method for the minimization of nonsmooth convex functions over a convex set. To speed up computations we use adaptive approximate projections only requiring to move within a certain distance of the exact…

Optimization and Control · Mathematics 2015-03-19 Dirk A. Lorenz , Marc E. Pfetsch , Andreas M. Tillmann
‹ Prev 1 3 4 5 6 7 10 Next ›