English
Related papers

Related papers: AI-SARAH: Adaptive and Implicit Stochastic Recursi…

200 papers

We study the convergence rate of the proximal incremental aggregated gradient (PIAG) method for minimizing the sum of a large number of smooth component functions (where the sum is strongly convex) and a non-smooth convex function. At each…

Optimization and Control · Mathematics 2016-11-28 Nuri Denizcan Vanli , Mert Gurbuzbalaban , Asu Ozdaglar

In this paper, we propose a stochastic search algorithm for solving general optimization problems with little structure. The algorithm iteratively finds high quality solutions by randomly sampling candidate solutions from a parameterized…

Optimization and Control · Mathematics 2013-01-08 Enlu Zhou , Jiaqiao Hu

We consider a step search method for continuous optimization under a stochastic setting where the function values and gradients are available only through inexact probabilistic zeroth- and first-order oracles. Unlike the stochastic gradient…

Optimization and Control · Mathematics 2023-11-03 Billy Jin , Katya Scheinberg , Miaolan Xie

SARSA is an on-policy algorithm to learn a Markov decision process policy in reinforcement learning. We investigate the SARSA algorithm with linear function approximation under the non-i.i.d.\ data, where a single sample trajectory is…

Machine Learning · Computer Science 2019-11-20 Shaofeng Zou , Tengyu Xu , Yingbin Liang

Inertial algorithms for minimizing nonsmooth and nonconvex functions as the inertial proximal alternating linearized minimization algorithm (iPALM) have demonstrated their superiority with respect to computation time over their non inertial…

Optimization and Control · Mathematics 2022-09-07 Johannes Hertrich , Gabriele Steidl

Stochastic minimax optimization on Riemannian manifolds has recently attracted significant attention due to its broad range of applications, such as robust training of neural networks and robust maximum likelihood estimation. Existing…

Optimization and Control · Mathematics 2026-02-11 Hongye Wang , Chang He , Bo Jiang

In this paper, we propose and analyse a family of generalised stochastic composite mirror descent algorithms. With adaptive step sizes, the proposed algorithms converge without requiring prior knowledge of the problem. Combined with an…

Optimization and Control · Mathematics 2022-11-22 Weijia Shao , Fikret Sivrikaya , Sahin Albayrak

This work proposes an adaptive framework to solve a robust structural shape optimization problem governed by linear elasticity models that account for uncertainties in the loading and material inputs. A posteriori error estimators are…

Optimization and Control · Mathematics 2026-02-06 Oğuz Han Altıntaş , Hamdullah Yücel

For finite-dimensional problems, stochastic approximation methods have long been used to solve stochastic optimization problems. Their application to infinite-dimensional problems is less understood, particularly for nonconvex objectives.…

Optimization and Control · Mathematics 2021-01-14 Caroline Geiersbach , Teresa Scarinci

We propose several adaptive algorithmic methods for problems of non-smooth convex optimization. The first of them is based on a special artificial inexactness. Namely, the concept of inexact ($ \delta, \Delta, L$)-model of objective…

Optimization and Control · Mathematics 2020-08-25 Fedor Stonyakin

We study the convergence issue for the gradient algorithm (employing general step sizes) for optimization problems on general Riemannian manifolds (without curvature constraints). Under the assumption of the local convexity/quasi-convexity…

Optimization and Control · Mathematics 2019-10-08 Chong Li , Xiangmei Wang , Jinhua Wang , Jen-Chih Yao

This paper discusses several (sub)gradient methods attaining the optimal complexity for smooth problems with Lipschitz continuous gradients, nonsmooth problems with bounded variation of subgradients, weakly smooth problems with H\"older…

Optimization and Control · Mathematics 2016-05-02 Masoud Ahookhosh

The paper presents a new descent algorithm for locally Lipschitz continuous functions $f:X\to\mathbb{R}$. The selection of a descent direction at some iteration point $x$ combines an approximation of the set-valued gradient of $f$ on a…

Numerical Analysis · Mathematics 2019-10-25 Jan Mankau , Friedemann Schuricht

A set of accelerated first order algorithms with memory are proposed for minimising strongly convex functions. The algorithms are differentiated by their use of the iterate history for the gradient step. The increased convergence rate of…

Optimization and Control · Mathematics 2018-08-31 Ross Drummond , Stephen Duncan

Online and stochastic gradient methods have emerged as potent tools in large scale optimization with both smooth convex and nonsmooth convex problems from the classes $C^{1,1}(\reals^p)$ and $C^{1,0}(\reals^p)$ respectively. However to our…

Numerical Analysis · Mathematics 2014-10-30 Ziqiang Shi , Rujie Liu

We consider constrained optimization problems with a nonsmooth objective function in the form of mathematical expectation. The Sample Average Approximation (SAA) is used to estimate the objective function and variable sample size strategy…

Optimization and Control · Mathematics 2022-08-09 Natasa Krejic , Natasa Krklec Jerinkic , Tijana Ostojic

Stochastic approximation (SA) is a key method used in statistical learning. Recently, its non-asymptotic convergence analysis has been considered in many papers. However, most of the prior analyses are made under restrictive assumptions…

Machine Learning · Statistics 2019-06-18 Belhal Karimi , Blazej Miasojedow , Eric Moulines , Hoi-To Wai

The incremental gradient method is a prominent algorithm for minimizing a finite sum of smooth convex functions, used in many contexts including large-scale data processing applications and distributed optimization over networks. It is a…

Optimization and Control · Mathematics 2022-02-09 Mert Gürbüzbalaban , Asuman Ozdaglar , Pablo Parrilo

We study the problem of minimizing the average of a very large number of smooth functions, which is of key importance in training supervised learning models. One of the most celebrated methods in this context is the SAGA algorithm. Despite…

Machine Learning · Computer Science 2019-01-28 Xu Qian , Zheng Qu , Peter Richtárik

We consider the problem of minimizing the sum of a Lipschitz differentiable convex function $f$ and a proper closed convex function $h$ that admits efficient linear minimization oracles, subject to multiple smooth convex inequality…

Optimization and Control · Mathematics 2026-05-22 Xiaozhou Wang , Ting Kei Pong , Zev Woodstock