English
Related papers

Related papers: Critical Bach Size Minimizes Stochastic First-Orde…

200 papers

Stochastic Computing (SC) is a computing paradigm that allows for the low-cost and low-power computation of various arithmetic operations using stochastic bit streams and digital logic. In contrast to conventional representation schemes…

Emerging Technologies · Computer Science 2021-03-18 Corey Lammie , Jason K. Eshraghian , Wei D. Lu , Mostafa Rahimi Azghadi

Scheduling the batch size to increase is an effective strategy to control gradient noise when training deep neural networks. Current approaches implement scheduling heuristics that neglect structure within the optimization procedure,…

Machine Learning · Computer Science 2022-05-18 Calum Robert MacLellan , Feng Dong

We propose a new per-layer adaptive step-size procedure for stochastic first-order optimization methods for minimizing empirical loss functions in deep learning, eliminating the need for the user to tune the learning rate (LR). The proposed…

Machine Learning · Computer Science 2023-07-07 Achraf Bahamou , Donald Goldfarb

Adam is a popular and widely used adaptive gradient method in deep learning, which has also received tremendous focus in theoretical research. However, most existing theoretical work primarily analyzes its full-batch version, which differs…

Machine Learning · Computer Science 2025-10-14 Xuan Tang , Han Zhang , Yuan Cao , Difan Zou

In this work, we perform a wide variety of experiments with different deep learning architectures on datasets of limited size. According to our study, we show that model complexity is a critical factor when only a few samples per class are…

Machine Learning · Computer Science 2020-10-27 L. Brigato , L. Iocchi

Stochastic optimization lies at the core of most statistical learning models. The recent great development of stochastic algorithmic tools focused significantly onto proximal gradient iterations, in order to find an efficient approach for…

Machine Learning · Computer Science 2020-03-31 Andrei Patrascu , Ciprian Paduraru , Paul Irofti

The choice of batch-size in a stochastic optimization algorithm plays a substantial role for both optimization and generalization. Increasing the batch-size used typically improves optimization but degrades generalization. To address the…

Machine Learning · Computer Science 2020-03-03 Yeming Wen , Kevin Luk , Maxime Gazeau , Guodong Zhang , Harris Chan , Jimmy Ba

Training large-scale models under given resources requires careful design of parallelism strategies. In particular, the efficiency notion of critical batch size (CBS), concerning the compromise between time and compute, marks the threshold…

Machine Learning · Computer Science 2025-04-22 Hanlin Zhang , Depen Morwani , Nikhil Vyas , Jingfeng Wu , Difan Zou , Udaya Ghai , Dean Foster , Sham Kakade

Learning representation from relative similarity comparisons, often called ordinal embedding, gains rising attention in recent years. Most of the existing methods are based on semi-definite programming (\textit{SDP}), which is generally…

Machine Learning · Computer Science 2019-12-03 Ke Ma , Jinshan Zeng , Qianqian Xu , Xiaochun Cao , Wei Liu , Yuan Yao

The concept of Critical Batch Size, as pioneered by OpenAI, has long served as a foundational principle for large-scale pre-training. However, with the paradigm shift towards the Warmup-Stable-Decay (WSD) learning rate scheduler, we observe…

Artificial Intelligence · Computer Science 2026-01-12 Yunhua Zhou , Junhao Huang , Shuhao Xing , Yechen Zhang , Runyu Peng , Qiping Guo , Xipeng Qiu

In modern decentralized applications, ensuring communication efficiency and privacy for the users are the key challenges. In order to train machine-learning models, the algorithm has to communicate to the data center and sample data for its…

Optimization and Control · Mathematics 2024-04-04 Hoang Huy Nguyen , Yan Li , Tuo Zhao

We investigate the dynamical and convergent properties of stochastic gradient descent (SGD) applied to Deep Neural Networks (DNNs). Characterizing the relation between learning rate, batch size and the properties of the final minima, such…

Machine Learning · Computer Science 2018-09-14 Stanisław Jastrzębski , Zachary Kenton , Devansh Arpit , Nicolas Ballas , Asja Fischer , Yoshua Bengio , Amos Storkey

Recently, Stochastic Gradient Descent (SGD) and its variants have become the dominant methods in the large-scale optimization of machine learning (ML) problems. A variety of strategies have been proposed for tuning the step sizes, ranging…

Machine Learning · Computer Science 2022-08-02 Xiaoyu Li

We consider stochastic approximation with block-coordinate stepsizes and propose adaptive stepsize rules that aim to minimize the expected distance from the next iterate to an (unknown) target point. These stepsize rules employ online…

Optimization and Control · Mathematics 2025-12-09 Tao Jiang , Lin Xiao

Adam is known to perform significantly better than Stochastic Gradient Descent (SGD) in language models, a phenomenon for which a number of explanations have been proposed. In this work, we revisit this "optimizer gap" through a series of…

Machine Learning · Computer Science 2025-06-17 Teodora Srećković , Jonas Geiping , Antonio Orvieto

In this paper, we study a class of stochastic and finite-sum convex optimization problems with deterministic constraints. Existing methods typically aim to find an $\epsilon$-$expectedly\ feasible\ stochastic\ optimal$ solution, in which…

Optimization and Control · Mathematics 2025-06-26 Zhaosong Lu , Yifeng Xiao

Recently, Arjevani et al. [1] established a lower bound of iteration complexity for the first-order optimization under an $L$-smooth condition and a bounded noise variance assumption. However, a thorough review of existing literature on…

Machine Learning · Computer Science 2023-10-30 Bohan Wang , Jingwen Fu , Huishuai Zhang , Nanning Zheng , Wei Chen

We study stochastic optimization of nonconvex loss functions, which are typical objectives for training neural networks. We propose stochastic approximation algorithms which optimize a series of regularized, nonlinearized losses on large…

Machine Learning · Computer Science 2019-03-12 Weiran Wang , Nathan Srebro

The problem of learning threshold functions is a fundamental one in machine learning. Classical learning theory implies sample complexity of $O(\xi^{-1} \log(1/\beta))$ (for generalization error $\xi$ with confidence $1-\beta$). The private…

Machine Learning · Computer Science 2022-11-14 Edith Cohen , Xin Lyu , Jelani Nelson , Tamás Sarlós , Uri Stemmer

This paper presents a methodology for selecting the mini-batch size that minimizes Stochastic Gradient Descent (SGD) learning time for single and multiple learner problems. By decoupling algorithmic analysis issues from hardware and…

Machine Learning · Computer Science 2019-11-18 Michael P. Perrone , Haidar Khan , Changhoan Kim , Anastasios Kyrillidis , Jerry Quinn , Valentina Salapura