English
Related papers

Related papers: Mean-field analysis for heavy ball methods: Dropou…

200 papers

When equipped with efficient optimization algorithms, the over-parameterized neural networks have demonstrated high level of performance even though the loss function is non-convex and non-smooth. While many works have been focusing on…

Machine Learning · Computer Science 2021-03-11 Zhiqi Bu , Shiyun Xu , Kan Chen

Understanding the properties of neural networks trained via stochastic gradient descent (SGD) is at the heart of the theory of deep learning. In this work, we take a mean-field view, and consider a two-layer ReLU network trained via SGD for…

Machine Learning · Computer Science 2022-05-02 Alexander Shevchenko , Vyacheslav Kungurtsev , Marco Mondelli

The optimization of multilayer neural networks typically leads to a solution with zero training error, yet the landscape can exhibit spurious local minima and the minima can be disconnected. In this paper, we shed light on this phenomenon:…

Machine Learning · Computer Science 2020-07-24 Alexander Shevchenko , Marco Mondelli

We establish novel generalization bounds for learning algorithms that converge to global minima. We do so by deriving black-box stability results that only depend on the convergence of a learning algorithm and the geometry around the…

Machine Learning · Statistics 2017-10-25 Zachary Charles , Dimitris Papailiopoulos

State-of-the-art training algorithms for deep learning models are based on stochastic gradient descent (SGD). Recently, many variations have been explored: perturbing parameters for better accuracy (such as in Extragradient), limiting SGD…

Machine Learning · Computer Science 2022-03-23 Amirkeivan Mohtashami , Martin Jaggi , Sebastian U. Stich

The Stochastic Gradient Descent method (SGD) and its stochastic variants have become methods of choice for solving finite-sum optimization problems arising from machine learning and data science thanks to their ability to handle large-scale…

Optimization and Control · Mathematics 2024-03-06 Trang H. Tran , Quoc Tran-Dinh , Lam M. Nguyen

Stochastic gradient descent (SGD) with mini-batching is a standard tool in large-scale optimization, yet its theoretical properties under heavy-tailed gradient noise remain largely unexplored. In this paper we study SGD with increasing…

Probability · Mathematics 2026-05-11 Bartosz Glowacki , Rafal Kulik , Philippe Soulier

We study the convergence rate for the last iterate of stochastic gradient descent (SGD) and stochastic heavy ball (SHB) in the parametric setting when the objective function $F$ is globally convex or non-convex whose gradient is…

Optimization and Control · Mathematics 2026-03-11 Marcel Hudiani

We present novel empirical observations regarding how stochastic gradient descent (SGD) navigates the loss landscape of over-parametrized deep neural networks (DNNs). These observations expose the qualitatively different roles of learning…

Machine Learning · Statistics 2018-05-31 Chen Xing , Devansh Arpit , Christos Tsirigotis , Yoshua Bengio

Stochastic gradient algorithms are often unstable when applied to functions that do not have Lipschitz-continuous and/or bounded gradients. Gradient clipping is a simple and effective technique to stabilize the training process for problems…

Optimization and Control · Mathematics 2021-06-11 Vien V. Mai , Mikael Johansson

In the mean field regime, neural networks are appropriately scaled so that as the width tends to infinity, the learning dynamics tends to a nonlinear and nontrivial dynamical limit, known as the mean field limit. This lends a way to study…

Machine Learning · Computer Science 2021-05-12 Huy Tuan Pham , Phan-Minh Nguyen

Heavy ball momentum is crucial in accelerating (stochastic) gradient-based optimization algorithms for machine learning. Existing heavy ball momentum is usually weighted by a uniform hyperparameter, which relies on excessive tuning.…

Machine Learning · Computer Science 2021-10-19 Tao Sun , Huaming Ling , Zuoqiang Shi , Dongsheng Li , Bao Wang

Stochastic gradient descent with momentum (SGDM) has been widely used in many machine learning and statistical applications. Despite the observed empirical benefits of SGDM over traditional SGD, the theoretical understanding of the role of…

Machine Learning · Computer Science 2024-02-02 Kejie Tang , Weidong Liu , Yichen Zhang , Xi Chen

Despite an extensive body of literature on deep learning optimization, our current understanding of what makes an optimization algorithm effective is fragmented. In particular, we do not understand well whether enhanced optimization…

Machine Learning · Computer Science 2024-03-04 Toki Tahmid Inan , Mingrui Liu , Amarda Shehu

Stochastic gradient descent (SGD) is a widely used algorithm in machine learning, particularly for neural network training. Recent studies on SGD for canonical quadratic optimization or linear regression show it attains well generalization…

Machine Learning · Computer Science 2024-09-17 Haihan Zhang , Yuanshi Liu , Qianwen Chen , Cong Fang

Stochastic gradient descent (SGD) has been found to be surprisingly effective in training a variety of deep neural networks. However, there is still a lack of understanding on how and why SGD can train these complex networks towards a…

Machine Learning · Computer Science 2019-01-03 Yi Zhou , Junjie Yang , Huishuai Zhang , Yingbin Liang , Vahid Tarokh

Stochastic gradient descent (SGD) with stochastic momentum is popular in nonconvex stochastic optimization and particularly for the training of deep neural networks. In standard SGD, parameters are updated by improving along the path of the…

Machine Learning · Computer Science 2021-06-08 Jun-Kun Wang , Chi-Heng Lin , Jacob Abernethy

The vast majority of convergence rates analysis for stochastic gradient methods in the literature focus on convergence in expectation, whereas trajectory-wise almost sure convergence is clearly important to ensure that any instantiation of…

Machine Learning · Computer Science 2022-07-12 Jun Liu , Ye Yuan

In this paper, we present a unified algorithm for stochastic optimization that makes use of a "momentum" term; in other words, the stochastic gradient depends not only on the current true gradient of the objective function, but also on the…

Optimization and Control · Mathematics 2025-09-10 Mathukumalli Vidyasagar

Recently, {\it stochastic momentum} methods have been widely adopted in training deep neural networks. However, their convergence analysis is still underexplored at the moment, in particular for non-convex optimization. This paper fills the…

Optimization and Control · Mathematics 2016-05-06 Tianbao Yang , Qihang Lin , Zhe Li