English
Related papers

Related papers: On the Training Instability of Shuffling SGD with …

200 papers

Data imbalance is a common problem in machine learning that can have a critical effect on the performance of a model. Various solutions exist but their impact on the convergence of the learning dynamics is not understood. Here, we elucidate…

Machine Learning · Statistics 2024-02-20 Emanuele Francazi , Marco Baity-Jesi , Aurelien Lucchi

Stochastic Gradient Descent (SGD) and its variants are almost universally used to train neural networks and to fit a variety of other parametric models. An important hyperparameter in this context is the batch size, which determines how…

Optimization and Control · Mathematics 2023-12-05 Stefan Perko

Previous works on stochastic gradient descent (SGD) often focus on its success. In this work, we construct worst-case optimization problems illustrating that, when not in the regimes that the previous works often assume, SGD can exhibit…

Machine Learning · Computer Science 2023-05-30 Liu Ziyin , Botao Li , James B. Simon , Masahito Ueda

Dynamic Sparse Training (DST) methods train neural networks by maintaining sparsity while dynamically adapting the network topology. Despite the promise of reduced computation, DST methods converge significantly slower than dense training,…

Machine Learning · Computer Science 2026-05-28 Mohammed Adnan , Rohan Jain , Tom Jacobs , Ekansh Sharma , Rahul G. Krishnan , Rebekka Burkholz , Yani Ioannou

Many machine learning tasks can be formulated as Regularized Empirical Risk Minimization (R-ERM), and solved by optimization algorithms such as gradient descent (GD), stochastic gradient descent (SGD), and stochastic variance reduction…

Machine Learning · Statistics 2016-09-28 Qi Meng , Yue Wang , Wei Chen , Taifeng Wang , Zhi-Ming Ma , Tie-Yan Liu

Despite being highly over-parametrized, and having the ability to fully interpolate the training data, deep networks are known to generalize well to unseen data. It is now understood that part of the reason for this is that the training…

Machine Learning · Computer Science 2023-02-21 Danil Akhtiamov , Babak Hassibi

Deep Neural Networks (DNNs) have begun to thrive in the field of automation systems, owing to the recent advancements in standardising various aspects such as architecture, optimization techniques, and regularization. In this paper, we take…

Machine Learning · Computer Science 2019-07-10 Anand Krishnamoorthy Subramanian , Nak Young Chong

Machine learning, especially deep neural networks, has been rapidly developed in fields including computer vision, speech recognition and reinforcement learning. Although Mini-batch SGD is one of the most popular stochastic optimization…

Machine Learning · Computer Science 2019-03-12 Xinyu Peng , Li Li , Fei-Yue Wang

This paper focuses on regularizing the training of the convolutional neural network (CNN). We propose a new regularization approach named ``PatchShuffle`` that can be adopted in any classification-oriented CNN models. It is easy to…

Computer Vision and Pattern Recognition · Computer Science 2017-07-25 Guoliang Kang , Xuanyi Dong , Liang Zheng , Yi Yang

Inverse problems aim to reconstruct unseen data from corrupted or perturbed measurements. While most work focuses on improving reconstruction quality, generalization accuracy and robustness are equally important, especially for…

Machine Learning · Computer Science 2025-06-09 Peimeng Guan , Mark A. Davenport

Classical differential private DP-SGD implements individual clipping with random subsampling, which forces a mini-batch SGD approach. We provide a general differential private algorithmic framework that goes beyond DP-SGD and allows any…

Machine Learning · Computer Science 2023-07-26 Marten van Dijk , Phuong Ha Nguyen , Toan N. Nguyen , Lam M. Nguyen

Despite exceptional achievements, training neural networks remains computationally expensive and is often plagued by instabilities that can degrade convergence. While learning rate schedules can help mitigate these issues, finding optimal…

Machine Learning · Computer Science 2026-03-30 Benoit Dherin , Benny Avelin , Anders Karlsson , Hanna Mazzawi , Javier Gonzalvo , Michael Munn

Stochastic Gradient Descent (SGD) is widely used in machine learning problems to efficiently perform empirical risk minimization, yet, in practice, SGD is known to stall before reaching the actual minimizer of the empirical risk. SGD…

Machine Learning · Statistics 2017-02-09 Vivak Patel

The stochastic gradient descent (SGD) method and its variants are algorithms of choice for many Deep Learning tasks. These methods operate in a small-batch regime wherein a fraction of the training data, say $32$-$512$ data points, is…

Machine Learning · Computer Science 2017-02-13 Nitish Shirish Keskar , Dheevatsa Mudigere , Jorge Nocedal , Mikhail Smelyanskiy , Ping Tak Peter Tang

Batch normalization (BN) is a ubiquitous technique for training deep neural networks that accelerates their convergence to reach higher accuracy. However, we demonstrate that BN comes with a fundamental drawback: it incentivizes the model…

Machine Learning · Computer Science 2022-07-05 Saeid Asgari Taghanaki , Ali Gholami , Fereshte Khani , Kristy Choi , Linh Tran , Ran Zhang , Aliasghar Khani

The increasing scale of data propels the popularity of leveraging parallelism to speed up the optimization. Minibatch stochastic gradient descent (minibatch SGD) and local SGD are two popular methods for parallel optimization. The existing…

Machine Learning · Computer Science 2025-10-14 Yunwen Lei , Tao Sun , Mingrui Liu

The minibatch stochastic gradient descent method (SGD) is widely applied in deep learning due to its efficiency and scalability that enable training deep networks with a large volume of data. Particularly in the distributed setting, SGD is…

Machine Learning · Computer Science 2020-11-19 Qiwei Yuan , Weizhe Hua , Yi Zhou , Cunxi Yu

Regularization plays a major role in modern deep learning. From classic techniques such as L1,L2 penalties to other noise-based methods such as Dropout, regularization often yields better generalization properties by avoiding overfitting.…

Machine Learning · Statistics 2021-06-08 Soufiane Hayou , Fadhel Ayed

Mini-batch training of Graph Neural Networks (GNNs) is fundamentally different from training on i.i.d. data: sampling a subgraph alters the topology and introduces boundary effects, leading prior work to develop structure-aware samplers…

Machine Learning · Computer Science 2026-05-22 Clement Wang , Antoine Vialle , Robin Vaysse , Thomas Bonald

Understanding the dynamics of optimization in deep learning is increasingly important as models scale. While stochastic gradient descent (SGD) and its variants reliably find solutions that generalize well, the mechanisms driving this…

Machine Learning · Computer Science 2026-04-07 Wei-Kai Chang , Rajiv Khanna
‹ Prev 1 3 4 5 6 7 10 Next ›