English
Related papers

Related papers: Understanding Short-Range Memory Effects in Deep N…

200 papers

Stochastic learning dynamics based on Langevin or Levy stochastic differential equations (SDEs) in deep neural networks control the variance of noise by varying the size of the mini-batch or directly those of injecting noise. Since the…

Machine Learning · Computer Science 2023-10-05 JInwuk Seok , Changsik Cho

In overparametrized models, the noise in stochastic gradient descent (SGD) implicitly regularizes the optimization trajectory and determines which local minimum SGD converges to. Motivated by empirical studies that demonstrate that training…

Machine Learning · Computer Science 2021-12-07 Alex Damian , Tengyu Ma , Jason D. Lee

Symmetries are prevalent in deep learning and can significantly influence the learning dynamics of neural networks. In this paper, we examine how exponential symmetries -- a broad subclass of continuous symmetries present in the model…

Machine Learning · Computer Science 2024-11-08 Liu Ziyin , Mingze Wang , Hongchao Li , Lei Wu

Understanding the training dynamics of deep learning models is perhaps a necessary step toward demystifying the effectiveness of these models. In particular, how do data from different classes gradually become separable in their feature…

Machine Learning · Computer Science 2021-10-13 Jiayao Zhang , Hua Wang , Weijie J. Su

The stochastic gradient descent (SGD) algorithm has been widely used in statistical estimation for large-scale data due to its computational and memory efficiency. While most existing works focus on the convergence of the objective function…

Machine Learning · Statistics 2023-11-02 Xi Chen , Jason D. Lee , Xin T. Tong , Yichen Zhang

Stochastic Gradient Descent (SGD) has become the method of choice for solving a broad range of machine learning problems. However, some of its learning properties are still not fully understood. We consider least squares learning in…

Machine Learning · Statistics 2020-06-22 Nicole Mücke , Enrico Reiss

Understanding the dynamics of optimization in deep learning is increasingly important as models scale. While stochastic gradient descent (SGD) and its variants reliably find solutions that generalize well, the mechanisms driving this…

Machine Learning · Computer Science 2026-04-07 Wei-Kai Chang , Rajiv Khanna

In this paper, we propose a generalized framework for developing learning-rate-free momentum stochastic gradient descent (SGD) methods in the minimization of nonsmooth nonconvex functions, especially in training nonsmooth neural networks.…

Optimization and Control · Mathematics 2024-06-27 Xiaoyin Hu , Nachuan Xiao , Xin Liu , Kim-Chuan Toh

We study to what extent may stochastic gradient descent (SGD) be understood as a "conventional" learning rule that achieves generalization performance by obtaining a good fit to training data. We consider the fundamental stochastic convex…

Machine Learning · Computer Science 2023-01-13 Tomer Koren , Roi Livni , Yishay Mansour , Uri Sherman

In recent years, various notions of capacity and complexity have been proposed for characterizing the generalization properties of stochastic gradient descent (SGD) in deep learning. Some of the popular notions that correlate well with the…

Optimization and Control · Mathematics 2021-06-15 Mert Gurbuzbalaban , Umut Şimşekli , Lingjiong Zhu

Shortcut learning causes deep learning models to rely on non-essential features within the data. However, its formation in deep neural network training still lacks theoretical understanding. In this paper, we provide a formal definition of…

Artificial Intelligence · Computer Science 2026-05-06 Xiayang Li , Kuo Gai , Shihua Zhang

First-order methods like stochastic gradient descent(SGD) are recently the popular optimization method to train deep neural networks (DNNs), but second-order methods are scarcely used because of the overpriced computing cost in getting the…

Machine Learning · Computer Science 2021-04-01 Jingcheng Zhou , Wei Wei , Zhiming Zheng

We study the convergence properties and escape dynamics of Stochastic Gradient Descent (SGD) in one-dimensional landscapes, separately considering infinite- and finite-variance noise. Our main focus is to identify the time scales on which…

Machine Learning · Computer Science 2026-03-05 Dmitry Dudukalov , Artem Logachov , Vladimir Lotov , Timofei Prasolov , Evgeny Prokopenko , Anton Tarasenko

Mini-batch stochastic gradient methods (SGD) are state of the art for distributed training of deep neural networks. Drastic increases in the mini-batch sizes have lead to key efficiency and scalability gains in recent years. However,…

Machine Learning · Computer Science 2020-02-18 Tao Lin , Sebastian U. Stich , Kumar Kshitij Patel , Martin Jaggi

Stochastic differential equations (SDEs) are one of the most important representations of dynamical systems. They are notable for the ability to include a deterministic component of the system and a stochastic one to represent random…

Machine Learning · Computer Science 2021-05-19 Noura Dridi , Lucas Drumetz , Ronan Fablet

Stochastic Gradient Descent Langevin Dynamics (SGLD) algorithms, which add noise to the classic gradient descent, are known to improve the training of neural networks in some cases where the neural network is very deep. In this paper we…

Computational Finance · Quantitative Finance 2023-01-16 Pierre Bras , Gilles Pagès

Introducing noise in the training of machine learning systems is a powerful way to protect individual privacy via differential privacy guarantees, but comes at a cost to utility. This work looks at whether the inherent randomness of…

Machine Learning · Computer Science 2022-03-01 Stephanie L. Hyland , Shruti Tople

Stochastic Gradient Langevin Dynamics (SGLD) is a popular variant of Stochastic Gradient Descent, where properly scaled isotropic Gaussian noise is added to an unbiased estimate of the gradient at each iteration. This modest change allows…

Machine Learning · Computer Science 2017-06-06 Maxim Raginsky , Alexander Rakhlin , Matus Telgarsky

Large-batch stochastic gradient descent (SGD) is widely used for training in distributed deep learning because of its training-time efficiency, however, extremely large-batch SGD leads to poor generalization and easily converges to sharp…

Machine Learning · Computer Science 2019-06-27 Kosuke Haruki , Taiji Suzuki , Yohei Hamakawa , Takeshi Toda , Ryuji Sakai , Masahiro Ozawa , Mitsuhiro Kimura

Convergence detection of iterative stochastic optimization methods is of great practical interest. This paper considers stochastic gradient descent (SGD) with a constant learning rate and momentum. We show that there exists a transient…

Machine Learning · Computer Science 2020-08-28 Jerry Chee , Ping Li