English
Related papers

Related papers: Breaking the Span Assumption Yields Fast Finite-Su…

200 papers

The stochastic composition optimization proposed recently by Wang et al. [2014] minimizes the objective with the compositional expectation form: $\min_x~(\mathbb{E}_iF_i \circ \mathbb{E}_j G_j)(x).$ It summarizes many important applications…

Optimization and Control · Mathematics 2017-05-23 Xiangru Lian , Mengdi Wang , Ji Liu

We apply methods from randomized numerical linear algebra (RandNLA) to develop improved algorithms for the analysis of large-scale time series data. We first develop a new fast algorithm to estimate the leverage scores of an autoregressive…

Methodology · Statistics 2021-11-02 Ali Eshragh , Fred Roosta , Asef Nazari , Michael W. Mahoney

In this paper, we propose a novel sufficient decrease technique for stochastic variance reduced gradient descent methods such as SVRG and SAGA. In order to make sufficient decrease for stochastic optimization, we design a new sufficient…

Machine Learning · Statistics 2018-02-28 Fanhua Shang , Yuanyuan Liu , Kaiwen Zhou , James Cheng , Kelvin K. W. Ng , Yuichi Yoshida

Techniques for reducing the variance of gradient estimates used in stochastic programming algorithms for convex finite-sum problems have received a great deal of attention in recent years. By leveraging dissipativity theory from control, we…

Optimization and Control · Mathematics 2018-06-12 Bin Hu , Stephen Wright , Laurent Lessard

Over the past ten years, driven by large scale optimisation problems arising from machine learning, the development of stochastic optimisation methods have witnessed a tremendous growth. However, despite their popularity, the theoretical…

Optimization and Control · Mathematics 2018-11-05 Clarice Poon , Jingwei Liang , Carola-Bibiane Schönlieb

This paper proposes a simple yet highly accurate prediction-correction algorithm, SHARP, for unconstrained time-varying optimization problems. Its prediction is based on an extrapolation derived from the Lagrange interpolation of past…

Optimization and Control · Mathematics 2025-04-09 Tomoya Kamijima , Naoki Marumo , Akiko Takeda

Variance reduction (VR) methods employ stochastic gradients with decreasing variance, and they have been widely applied to solve large-scale optimization problems in machine learning because of their efficiency. Existing theoretical studies…

Machine Learning · Computer Science 2026-05-28 Yunwen Lei , Zimeng Wang , Xiaoming Yuan

Quantum span program algorithms for function evaluation commonly have reduced query complexity when promised that the input has a certain structure. We design a modified span program algorithm to show these speed-ups persist even without…

Quantum Physics · Physics 2021-06-11 Noel T. Anderson , Jay-U Chung , Shelby Kimmel

In the sliding window model, we are required to maintain the target statistics over the most recent $n$ elements of a data stream, which is captured by a window of size $n$ sliding over the data stream. Exact computation usually requires…

Data Structures and Algorithms · Computer Science 2026-04-28 Ryo Suzuki , Yutaro Yamaguchi

Empirical risk minimization is an important class of optimization problems with many popular machine learning applications, and stochastic variance reduction methods are popular choices for solving them. Among these methods, SVRG and…

Optimization and Control · Mathematics 2019-05-24 Yanli Liu , Fei Feng , Wotao Yin

Despite the recent growth of theoretical studies and empirical successes of neural networks, gradient backpropagation is still the most widely used algorithm for training such networks. On the one hand, we have deterministic or full…

Machine Learning · Computer Science 2023-10-20 Pascal Junior Tikeng Notsawo

Stochastic Gradient (SG) is the defacto iterative technique to solve stochastic optimization (SO) problems with a smooth (non-convex) objective $f$ and a stochastic first-order oracle. SG's attractiveness is due in part to its simplicity of…

Optimization and Control · Mathematics 2024-03-08 David Newton , Raghu Bollapragada , Raghu Pasupathy , Nung Kwan Yip

We study optimization algorithms based on variance reduction for stochastic gradient descent (SGD). Remarkable recent progress has been made in this direction through development of algorithms like SAG, SVRG, SAGA. These algorithms have…

Machine Learning · Computer Science 2016-01-26 Sashank J. Reddi , Ahmed Hefny , Suvrit Sra , Barnabás Póczos , Alex Smola

We develop and analyze a new algorithm for empirical risk minimization, which is the key paradigm for training supervised machine learning models. Our method---SAGD---is based on a probabilistic interpolation of SAGA and gradient descent…

Optimization and Control · Mathematics 2020-04-03 Adel Bibi , Alibek Sailanbayev , Bernard Ghanem , Robert Mansel Gower , Peter Richtárik

In this paper, we propose a new SVRG-style acceleated stochastic algorithm for solving a family of non-convex optimization problems whose objective consists of a sum of $n$ smooth functions and a non-smooth convex function. Our major goal…

Optimization and Control · Mathematics 2019-03-12 Zaiyi Chen , Yi Xu , Haoyuan Hu , Tianbao Yang

Stochastic compositional optimization arises in many important machine learning tasks such as value function evaluation in reinforcement learning and portfolio management. The objective function is the composition of two expectations of…

Machine Learning · Statistics 2020-01-28 Huizhuo Yuan , Xiangru Lian , Ji Liu

We revisit a classical assumption for analyzing stochastic gradient algorithms where the squared norm of the stochastic subgradient (or the variance for smooth problems) is allowed to grow as fast as the squared norm of the optimization…

Optimization and Control · Mathematics 2025-04-15 Ahmet Alacaoglu , Yura Malitsky , Stephen J. Wright

In this paper, we propose a novel sufficient decrease technique for variance reduced stochastic gradient descent methods such as SAG, SVRG and SAGA. In order to make sufficient decrease for stochastic optimization, we design a new…

Machine Learning · Computer Science 2017-06-06 Fanhua Shang , Yuanyuan Liu , James Cheng , Kelvin Kai Wing Ng , Yuichi Yoshida

In this paper, we study the finite-sum convex optimization problem focusing on the general convex case. Recently, the study of variance reduced (VR) methods and their accelerated variants has made exciting progress. However, the step size…

Optimization and Control · Mathematics 2022-01-31 Zijian Liu , Ta Duy Nguyen , Alina Ene , Huy L. Nguyen

This paper presents a stochastic approximation proximal subgradient (SAPS) method for stochastic convex-concave minimax optimization. By accessing unbiased and variance bounded approximate subgradients, we show that this algorithm exhibits…

Optimization and Control · Mathematics 2024-04-01 Yu-Hong Dai , Jiani Wang , Liwei Zhang