English
Related papers

Related papers: Random Reshuffling with Variance Reduction: New An…

200 papers

Stochastic gradient methods for machine learning and optimization problems are usually analyzed assuming data points are sampled \emph{with} replacement. In practice, however, sampling \emph{without} replacement is very common, easier to…

Machine Learning · Computer Science 2016-10-18 Ohad Shamir

Adaptive gradient methods have attracted much attention of machine learning communities due to the high efficiency. However their acceleration effect in practice, especially in neural network training, is hard to analyze, theoretically. The…

Optimization and Control · Mathematics 2020-06-15 Xunpeng Huang , Hao Zhou , Runxin Xu , Zhe Wang , Lei Li

When solving finite-sum minimization problems, two common alternatives to stochastic gradient descent (SGD) with theoretical benefits are random reshuffling (SGD-RR) and shuffle-once (SGD-SO), in which functions are sampled in cycles…

Optimization and Control · Mathematics 2022-06-02 Carles Domingo-Enrich

When using stochastic gradient descent to solve large-scale machine learning problems, a common practice of data processing is to shuffle the training data, partition the data across multiple machines if needed, and then perform several…

Machine Learning · Statistics 2017-10-02 Qi Meng , Wei Chen , Yue Wang , Zhi-Ming Ma , Tie-Yan Liu

Hyperparameter optimization is crucial for obtaining peak performance of machine learning models. The standard protocol evaluates various hyperparameter configurations using a resampling estimate of the generalization error to guide…

Machine Learning · Statistics 2024-11-11 Thomas Nagler , Lennart Schneider , Bernd Bischl , Matthias Feurer

We prove that, under low noise assumptions, the support vector machine with $N\ll m$ random features (RFSVM) can achieve the learning rate faster than $O(1/\sqrt{m})$ on a training set with $m$ samples when an optimized feature map is used.…

Machine Learning · Computer Science 2019-01-09 Yitong Sun , Anna Gilbert , Ambuj Tewari

We study the performance of stochastic gradient descent (SGD) on smooth and strongly-convex finite-sum optimization problems. In contrast to the majority of existing theoretical works, which assume that individual functions are sampled with…

Machine Learning · Computer Science 2021-06-03 Itay Safran , Ohad Shamir

Optimization objectives in the form of a sum of intractable expectations are rising in importance (e.g., diffusion models, variational autoencoders, and many more), a setting also known as "finite sum with infinite data." For these…

Machine Learning · Statistics 2025-05-13 Kyurae Kim , Joohwan Ko , Yi-An Ma , Jacob R. Gardner

The Robbins-Monro stochastic approximation algorithm is a foundation of many algorithmic frameworks for reinforcement learning (RL), and often an efficient approach to solving (or approximating the solution to) complex optimal control…

Optimization and Control · Mathematics 2019-03-19 Andrey Bernstein , Yue Chen , Marcello Colombino , Emiliano Dall'Anese , Prashant Mehta , Sean Meyn

Large-scale machine learning models are trained on clusters of machines that exhibit heterogeneous performance due to hardware variability, network delays, and system-level instabilities. In such environments, time complexity rather than…

Optimization and Control · Mathematics 2026-05-12 Zhirayr Tovmasyan , Artavazd Maranjyan , Peter Richtárik

In this paper, we propose new randomization based algorithms for large scale linear discrete ill-posed problems with general-form regularization: ${\min} \|Lx\|$ subject to ${\min} \|Ax - b\|$, where $L$ is a regularization matrix. Our…

Numerical Analysis · Mathematics 2019-09-24 Zhongxiao Jia , Yanfei Yang

We revisit the stochastic variance-reduced policy gradient (SVRPG) method proposed by Papini et al. (2018) for reinforcement learning. We provide an improved convergence analysis of SVRPG and show that it can find an $\epsilon$-approximate…

Machine Learning · Computer Science 2019-05-30 Pan Xu , Felicia Gao , Quanquan Gu

Shuffling is the process of rearranging a sequence of elements into a random order such that any permutation occurs with equal probability. It is an important building block in a plethora of techniques used in virtually all scientific…

Data Structures and Algorithms · Computer Science 2023-02-08 Manuel Penschuck

Stochastic variance-reduced gradient (SVRG) is a classical optimization method. Although it is theoretically proved to have better convergence performance than stochastic gradient descent (SGD), the generalization performance of SVRG…

Machine Learning · Statistics 2019-08-20 Hao Jin , Dachao Lin , Zhihua Zhang

We consider convex-concave saddle-point problems where the objective functions may be split in many components, and extend recent stochastic variance reduction methods (such as SVRG or SAGA) to provide the first large-scale linearly…

Machine Learning · Computer Science 2016-11-04 P Balamurugan , Francis Bach

For many applications in signal processing and machine learning, we are tasked with minimizing a large sum of convex functions subject to a large number of convex constraints. In this paper, we devise a new random projection method (RPM) to…

Optimization and Control · Mathematics 2024-04-08 Zhichun Yang , Fu-quan Xia , Kai Tu , Man-Chung Yue

Although SGD with random reshuffle has been widely-used in machine learning applications, there is a limited understanding of how model characteristics affect the convergence of the algorithm. In this work, we introduce model incoherence to…

Optimization and Control · Mathematics 2020-07-08 Shaocong Ma , Yi Zhou

Random backpropagation (RBP) is a variant of the backpropagation algorithm for training neural networks, where the transpose of the forward matrices are replaced by fixed random matrices in the calculation of the weight updates. It is…

Machine Learning · Computer Science 2017-12-25 Pierre Baldi , Peter Sadowski , Zhiqin Lu

Variance reduction techniques like SVRG provide simple and fast algorithms for optimizing a convex finite-sum objective. For nonconvex objectives, these techniques can also find a first-order stationary point (with small gradient). However,…

Machine Learning · Computer Science 2019-05-03 Rong Ge , Zhize Li , Weiyao Wang , Xiang Wang

Cubic regularization (CR) is an optimization method with emerging popularity due to its capability to escape saddle points and converge to second-order stationary solutions for nonconvex optimization. However, CR encounters a high sample…

Optimization and Control · Mathematics 2018-10-10 Zhe Wang , Yi Zhou , Yingbin Liang , Guanghui Lan