English
Related papers

Related papers: SARAH-based Variance-reduced Algorithm for Stochas…

200 papers

We propose a remarkably general variance-reduced method suitable for solving regularized empirical risk minimization problems with either a large number of training examples, or a large model dimension, or both. In special cases, our method…

Optimization and Control · Mathematics 2020-01-16 Filip Hanzely , Peter Richtárik

This paper investigates the stability and convergence properties of asynchronous stochastic approximation (SA) algorithms, with a focus on extensions relevant to average-reward reinforcement learning. We first extend a stability proof…

Machine Learning · Computer Science 2025-12-10 Huizhen Yu , Yi Wan , Richard S. Sutton

In this work, we investigate the idea of variance reduction by studying its properties with general adaptive mirror descent algorithms in nonsmooth nonconvex finite-sum optimization problems. We propose a simple yet generalized framework…

Machine Learning · Statistics 2022-10-18 Wenjie Li , Zhanyu Wang , Yichen Zhang , Guang Cheng

The spectral risk has wide applications in machine learning, especially in real-world decision-making, where people are not only concerned with models' average performance. By assigning different weights to the losses of different sample…

Optimization and Control · Mathematics 2024-07-23 Yuze Ge , Rujun Jiang

We study optimization algorithms based on variance reduction for stochastic gradient descent (SGD). Remarkable recent progress has been made in this direction through development of algorithms like SAG, SVRG, SAGA. These algorithms have…

Machine Learning · Computer Science 2016-01-26 Sashank J. Reddi , Ahmed Hefny , Suvrit Sra , Barnabás Póczos , Alex Smola

This paper focuses on stochastic proximal gradient methods for optimizing a smooth non-convex loss function with a non-smooth non-convex regularizer and convex constraints. To the best of our knowledge we present the first non-asymptotic…

Optimization and Control · Mathematics 2019-05-27 Michael R. Metel , Akiko Takeda

This work investigates the finite-horizon optimal covariance steering problem for discrete-time linear systems subject to both additive and multiplicative uncertainties as well as state and input chance constraints. In particular, a…

Optimization and Control · Mathematics 2023-01-19 Jacob Knaup , Panagiotis Tsiotras

We overview a series of recent works devoted to variance reduction techniques for numerical stochastic homogenization. Numerical homogenization requires solving a set of problems at the micro scale, the so-called corrector problems. In a…

Numerical Analysis · Mathematics 2016-04-27 Xavier Blanc , Claude Le Bris , Frederic Legoll

In this paper, we consider the problem of minimizing the average of a large number of nonsmooth and convex functions. Such problems often arise in typical machine learning problems as empirical risk minimization, but are computationally…

Machine Learning · Statistics 2018-05-21 Wenjie Huang

We propose a novel stochastic smoothing accelerated gradient (SSAG) method for general constrained nonsmooth convex composite optimization, and analyze the convergence rates. The SSAG method allows various smoothing techniques, and can deal…

Optimization and Control · Mathematics 2026-02-03 Ruyu Wang , Chao Zhang

We consider decentralized time-varying stochastic optimization problems where each of the functions held by the nodes has a finite sum structure. Such problems can be efficiently solved using variance reduction techniques. Our aim is to…

In this paper, we propose a multilevel stochastic framework for the solution of nonconvex unconstrained optimization problems. The proposed approach uses random regularized first-order models that exploit an available hierarchical…

Optimization and Control · Mathematics 2025-11-27 Filippo Marini , Margherita Porcelli , Elisa Riccietti

We develop a novel and single-loop variance-reduced algorithm to solve a class of stochastic nonconvex-convex minimax problems involving a nonconvex-linear objective function, which has various applications in different fields such as…

Optimization and Control · Mathematics 2020-10-27 Quoc Tran-Dinh , Deyi Liu , Lam M. Nguyen

Variational inequalities have recently attracted considerable interest in machine learning as a flexible paradigm for models that go beyond ordinary loss function minimization (such as generative adversarial networks and related deep…

Optimization and Control · Mathematics 2020-02-12 Yu-Guan Hsieh , Franck Iutzeler , Jérôme Malick , Panayotis Mertikopoulos

Nonconvex-concave (NC-C) finite-sum minimax problems have wide applications in signal processing and machine learning tasks. Conventional stochastic gradient algorithms, which rely on uniform sampling for gradient estimation, often suffer…

Optimization and Control · Mathematics 2025-10-14 Xia Jiang , Linglingzhi Zhu , Taoli Zheng , Anthony Man-Cho So

In this paper, we address a manifold constrained nonsmooth optimization problem involving the composition of a weakly convex function and a smooth mapping under the availability of a parametrization of the manifold. To find a stationary…

Optimization and Control · Mathematics 2026-02-03 Keita Kume , Isao Yamada

We study system design problems stated as parameterized stochastic programs with a chance-constraint set. We adopt a Bayesian approach that requires the computation of a posterior predictive integral which is usually intractable. In…

Machine Learning · Statistics 2020-01-07 Prateek Jaiswal , Harsha Honnappa , Vinayak A. Rao

A dynamic sampled stochastic approximated (DS-SA) extragradient method for stochastic variational inequalities (SVI) is proposed that is \emph{robust} with respect to an unknown Lipschitz constant $L$. To the best of our knowledge, it is…

Optimization and Control · Mathematics 2017-08-28 Alfredo Iusem , Alejandro Jofré , Roberto I. Oliveira , Philip Thompson

The article is devoted to some adaptive methods for variational inequalities with relatively smooth and relatively strongly monotone operators. Starting from the recently proposed proximal variant of the extragradient method for this class…

Optimization and Control · Mathematics 2023-08-02 S. S. Ablaev , F. S. Stonyakin , M. S. Alkousa , D. A. Pasechnyuk

Stochastic variance-reduced algorithms such as Stochastic Average Gradient (SAG) and SAGA, and their deterministic counterparts like the Incremental Aggregated Gradient (IAG) method, have been extensively studied in large-scale machine…

Machine Learning · Computer Science 2026-05-22 Feng Zhu , Robert W. Heath , Aritra Mitra