English
Related papers

Related papers: On the Training Instability of Shuffling SGD with …

200 papers

Large-batch SGD is important for scaling training of deep neural networks. However, without fine-tuning hyperparameter schedules, the generalization of the model may be hampered. We propose to use batch augmentation: replicating instances…

Machine Learning · Computer Science 2019-01-29 Elad Hoffer , Tal Ben-Nun , Itay Hubara , Niv Giladi , Torsten Hoefler , Daniel Soudry

Batch Normalization (BN), a widely-used technique in neural networks, enhances generalization and expedites training by normalizing each mini-batch to the same mean and variance. However, its effectiveness diminishes when confronted with…

Machine Learning · Computer Science 2024-05-28 Bilal Faye , Mustapha Lebbah , Hanane Azzag

Despite its empirical success and recent theoretical progress, there generally lacks a quantitative analysis of the effect of batch normalization (BN) on the convergence and stability of gradient descent. In this paper, we provide such an…

Machine Learning · Computer Science 2019-05-10 Yongqiang Cai , Qianxiao Li , Zuowei Shen

Exciting new work on the generalization bounds for neural networks (NN) given by Neyshabur et al. , Bartlett et al. closely depend on two parameter-depenedent quantities: the Lipschitz constant upper-bound and the stable rank (a softer…

Machine Learning · Statistics 2020-02-21 Amartya Sanyal , Philip H. S. Torr , Puneet K. Dokania

Stochastic gradient descent updates parameters with summation gradient computed from a random data batch. This summation will lead to unbalanced training process if the data we obtained is unbalanced. To address this issue, this paper takes…

Machine Learning · Computer Science 2019-05-22 Tao Yi , Xingxuan Wang

Deep neural networks achieve stellar generalisation on a variety of problems, despite often being large enough to easily fit all their training data. Here we study the generalisation dynamics of two-layer neural networks in a…

Machine Learning · Statistics 2019-06-21 Sebastian Goldt , Madhu S. Advani , Andrew M. Saxe , Florent Krzakala , Lenka Zdeborová

Batch Normalization (BN) has been a standard component in designing deep neural networks (DNNs). Although the standard BN can significantly accelerate the training of DNNs and improve the generalization performance, it has several…

Machine Learning · Computer Science 2020-10-13 Yong Guo , Qingyao Wu , Chaorui Deng , Jian Chen , Mingkui Tan

In adversarial machine learning, deep neural networks can fit the adversarial examples on the training dataset but have poor generalization ability on the test set. This phenomenon is called robust overfitting, and it can be observed when…

Machine Learning · Computer Science 2022-11-01 Jiancong Xiao , Yanbo Fan , Ruoyu Sun , Jue Wang , Zhi-Quan Luo

Some reinforcement learning (RL) algorithms can stitch pieces of experience to solve a task never seen before during training. This oft-sought property is one of the few ways in which RL methods based on dynamic-programming differ from RL…

Machine Learning · Computer Science 2024-03-13 Raj Ghugare , Matthieu Geist , Glen Berseth , Benjamin Eysenbach

This paper presents a new generalization error analysis for Decentralized Stochastic Gradient Descent (D-SGD) based on algorithmic stability. The obtained results overhaul a series of recent works that suggested an increased instability due…

Machine Learning · Computer Science 2024-06-14 Batiste Le Bars , Aurélien Bellet , Marc Tommasi , Kevin Scaman , Giovanni Neglia

It is widely believed that the implicit regularization of SGD is fundamental to the impressive generalization behavior we observe in neural networks. In this work, we demonstrate that non-stochastic full-batch training can achieve…

Machine Learning · Computer Science 2022-04-21 Jonas Geiping , Micah Goldblum , Phillip E. Pope , Michael Moeller , Tom Goldstein

We study the convergence of gradient descent (GD) and stochastic gradient descent (SGD) for training $L$-hidden-layer linear residual networks (ResNets). We prove that for training deep residual networks with certain linear transformations…

Machine Learning · Computer Science 2020-03-03 Difan Zou , Philip M. Long , Quanquan Gu

While significant theoretical progress has been achieved, unveiling the generalization mystery of overparameterized neural networks still remains largely elusive. In this paper, we study the generalization behavior of shallow neural…

Machine Learning · Computer Science 2022-09-21 Yunwen Lei , Rong Jin , Yiming Ying

We study the convergence of the shuffling gradient method, a popular algorithm employed to minimize the finite-sum function with regularization, in which functions are passed to apply (Proximal) Gradient Descent (GD) one by one whose order…

Optimization and Control · Mathematics 2025-05-30 Zijian Liu , Zhengyuan Zhou

Stochastic gradient descent (SGD), a widely used algorithm in deep-learning neural networks has attracted continuing studies for the theoretical principles behind its success. A recent work reports an anomaly (inverse) relation between the…

Adaptation and Self-Organizing Systems · Physics 2023-08-16 Xia Xiong , Yong-Cong Chen , Chunxiao Shi , Ping Ao

The stochastic gradient descent (SGD) algorithm is the algorithm we use to train neural networks. However, it remains poorly understood how the SGD navigates the highly nonlinear and degenerate loss landscape of a neural network. In this…

Machine Learning · Computer Science 2025-06-13 Liu Ziyin , Hongchao Li , Masahito Ueda

What enables Stochastic Gradient Descent (SGD) to achieve better generalization than Gradient Descent (GD) in Neural Network training? This question has attracted much attention. In this paper, we study the distribution of the Stochastic…

Machine Learning · Computer Science 2019-10-28 Abhishek Panigrahi , Raghav Somani , Navin Goyal , Praneeth Netrapalli

Mini-batch stochastic gradient descent (SGD) is state of the art in large scale distributed training. The scheme can reach a linear speedup with respect to the number of workers, but this is rarely seen in practice as the scheme often…

Optimization and Control · Mathematics 2019-05-06 Sebastian U. Stich

Self-paced learning and hard example mining re-weight training instances to improve learning accuracy. This paper presents two improved alternatives based on lightweight estimates of sample uncertainty in stochastic gradient descent (SGD):…

Machine Learning · Statistics 2018-01-09 Haw-Shiuan Chang , Erik Learned-Miller , Andrew McCallum

In this paper, we propose a unified convergence analysis for a class of generic shuffling-type gradient methods for solving finite-sum optimization problems. Our analysis works with any sampling without replacement strategy and covers many…

Optimization and Control · Mathematics 2021-09-21 Lam M. Nguyen , Quoc Tran-Dinh , Dzung T. Phan , Phuong Ha Nguyen , Marten van Dijk