English
Related papers

Related papers: On Busemann subgradient methods for stochastic min…

200 papers

Let $E$ be a Banach space such that $E'$ has the Radon-Nikod\'ym property. The aim of this work is to connect relative weak compactness in the $E$-valued martingale Hardy space $H^{1}(\mu,E)$ to a convex compactness criterion in a weaker…

Functional Analysis · Mathematics 2024-10-21 Vasily Melnikov

We consider (stochastic) subgradient methods for strongly convex but potentially nonsmooth non-Lipschitz optimization. We provide new equivalent dual descriptions (in the style of dual averaging) for the classic subgradient method, the…

Optimization and Control · Mathematics 2024-12-31 Benjamin Grimmer , Danlin Li

Let $\mathbb{D}(u)$ be the Dirichlet energy of a map $u$ belonging to the Sobolev space $H^1_{u_0}(\Omega;\mathbb{R}^2)$ and let $A$ be a subclass of $H^1_{u_0}(\Omega;\mathbb{R}^2)$ whose members are subject to the constraint $\det \nabla…

Analysis of PDEs · Mathematics 2024-12-25 Jonathan Bevan , Martin Kružík , Jan Valdman

We discretize the stochastic Allen-Cahn equation with additive noise by means of a spectral Galerkin method in space and a tamed version of the exponential Euler method in time. The resulting error bounds are analyzed for the…

Numerical Analysis · Mathematics 2021-01-20 Meng Cai , Siqing Gan , Xiaojie Wang

We prove minimax theorems for lower semicontinuous functions defined on a Hilbert space. The main tool is the theory of $\Phi$-convex functions and sufficient and necessary conditions for the minimax equality to hold for $\Phi$-convex…

Optimization and Control · Mathematics 2016-06-29 Ewa M. Bednarczuk , Monika Syga

Despite the established convergence theory of Optimistic Gradient Descent Ascent (OGDA) and Extragradient (EG) methods for the convex-concave minimax problems, little is known about the theoretical guarantees of these methods in nonconvex…

Machine Learning · Computer Science 2022-10-19 Pouria Mahdavinia , Yuyang Deng , Haochuan Li , Mehrdad Mahdavi

We develop subgradient- and gradient-based methods for minimizing strongly convex functions under a notion which generalizes the standard Euclidean strong convexity. We propose a unifying framework for subgradient methods which yields two…

Optimization and Control · Mathematics 2016-08-19 Masaru Ito

Bilevel optimization problems are receiving increasing attention in machine learning as they provide a natural framework for hyperparameter optimization and meta-learning. A key step to tackle these problems is the efficient computation of…

Machine Learning · Statistics 2025-05-20 Riccardo Grazzi , Massimiliano Pontil , Saverio Salzo

The aim of this paper is to present an extragradient method for variational inequality associated to a point-to-set vector field in Hadamard manifolds and to study its convergence properties. In order to present our method the concept of…

Optimization and Control · Mathematics 2018-04-26 E. E. A. Batista , G. C. Bento , O. P. Ferreira

In the setting of spaces of homogeneous type, we give a direct proof of the local Tb theorem for singular integral operators. Motivated by questions of S. Hofmann, we extend it to the case when the integrability conditions are lower than 2,…

Classical Analysis and ODEs · Mathematics 2011-01-14 Pascal Auscher , Routin Eddy

We show that quasi-minimizers of non-homogeneous energy functionals on metric measure spaces are locally H\"older continuous and satisfy the Harnack inequality. We assume that the spaces are doubling and support a Poincar\'e inequality. The…

Analysis of PDEs · Mathematics 2010-08-31 Jasun Gong , Juan J. Manfredi , Mikko Parviainen

The Kardar-Parisi-Zhang (KPZ) equation on the real line is well-known to admit Brownian motion with a linear drift as a stationary distribution (modulo additive constants). We show that these solutions are attractive, a result known as a…

Probability · Mathematics 2022-11-15 Christopher Janjigian , Firas Rassoul-Agha , Timo Seppäläinen

Our work is part of the close link between continuous-time dissipative dynamical systems and optimization algorithms, and more precisely here, in the stochastic setting. We aim to study stochastic convex minimization problems through the…

Optimization and Control · Mathematics 2025-02-21 Rodrigo Maulen-Soto , Jalal Fadili , Hedy Attouch , Peter Ochs

A local convergence rate is established for a Gauss orthogonal collocation method applied to optimal control problems with control constraints. If the Hamiltonian possesses a strong convexity property, then the theory yields convergence for…

Numerical Analysis · Mathematics 2018-09-17 William W. Hager , Jun Liu , Subhashree Mohapatra , Anil V. Rao , Xiang-Sheng Wang

The purpose of this article is to study the convergence of a low order finite element approximation for a natural convection problem. We prove that the discretization based on P1 polynomials for every variable (velocity, pressure and…

Numerical Analysis · Mathematics 2022-07-27 Ionut Danaila , Francky Luddens , Cécile Legrand

In this paper we consider convex optimization problems with stochastic composite objective function subject to (possibly) infinite intersection of constraints. The objective function is expressed in terms of expectation operator over a sum…

Optimization and Control · Mathematics 2024-12-03 Ion Necoara , Nitesh Kumar Singh

This article generalises the concept of realised covariation to Hilbert-space-valued stochastic processes. More precisely, based on high-frequency functional data, we construct an estimator of the trace-class operator-valued integrated…

Probability · Mathematics 2020-11-30 Fred Espen Benth , Dennis Schroers , Almut E. D. Veraart

In this paper, we examine the convergence of mirror descent in a class of stochastic optimization problems that are not necessarily convex (or even quasi-convex), and which we call variationally coherent. Since the standard technique of…

Optimization and Control · Mathematics 2018-07-17 Zhengyuan Zhou , Panayotis Mertikopoulos , Nicholas Bambos , Stephen Boyd , Peter Glynn

We propose a new stochastic L-BFGS algorithm and prove a linear convergence rate for strongly convex and smooth functions. Our algorithm draws heavily from a recent stochastic variant of L-BFGS proposed in Byrd et al. (2014) as well as a…

Optimization and Control · Mathematics 2016-04-15 Philipp Moritz , Robert Nishihara , Michael I. Jordan

Local convergence analysis of the proximal point method for special class of nonconvex function on Hadamard manifold is presented in this paper. The well definedness of the sequence generated by the proximal point method is guaranteed.…

Optimization and Control · Mathematics 2010-04-13 G. C. Bento , O. P. Ferreira , P. R. Oliveira