中文
相关论文

相关论文: Towards Theoretical Understanding of Large Batch T…

200 篇论文

The stochastic gradient descent (SGD) method and its variants are algorithms of choice for many Deep Learning tasks. These methods operate in a small-batch regime wherein a fraction of the training data, say $32$-$512$ data points, is…

Stochastic gradient descent~(SGD) and its variants have been the dominating optimization methods in machine learning. Compared to SGD with small-batch training, SGD with large-batch training can better utilize the computational power of…

机器学习 · 统计学 2024-04-16 Shen-Yi Zhao , Chang-Wei Shi , Yin-Peng Xie , Wu-Jun Li

We study the statistical properties of the dynamic trajectory of stochastic gradient descent (SGD). We approximate the mini-batch SGD and the momentum SGD as stochastic differential equations (SDEs). We exploit the continuous formulation of…

机器学习 · 计算机科学 2021-12-03 Xiaowu Dai , Yuhua Zhu

We study the Stochastic Gradient Descent (SGD) method in nonconvex optimization problems from the point of view of approximating diffusion processes. We prove rigorously that the diffusion process can approximate the SGD algorithm weakly…

机器学习 · 统计学 2018-03-06 Wenqing Hu , Chris Junchi Li , Lei Li , Jian-Guo Liu

Stochastic gradient descent (SGD) with mini-batching is a standard tool in large-scale optimization, yet its theoretical properties under heavy-tailed gradient noise remain largely unexplored. In this paper we study SGD with increasing…

概率论 · 数学 2026-05-11 Bartosz Glowacki , Rafal Kulik , Philippe Soulier

The performance of mini-batch stochastic gradient descent (SGD) strongly depends on setting the batch size and learning rate to minimize the empirical loss in training the deep neural network. In this paper, we present theoretical analyses…

机器学习 · 计算机科学 2025-02-17 Hikaru Umeda , Hideaki Iiduka

Mini-batch stochastic gradient descent (SGD) is state of the art in large scale distributed training. The scheme can reach a linear speedup with respect to the number of workers, but this is rarely seen in practice as the scheme often…

最优化与控制 · 数学 2019-05-06 Sebastian U. Stich

Previous works on stochastic gradient descent (SGD) often focus on its success. In this work, we construct worst-case optimization problems illustrating that, when not in the regimes that the previous works often assume, SGD can exhibit…

机器学习 · 计算机科学 2023-05-30 Liu Ziyin , Botao Li , James B. Simon , Masahito Ueda

In several experimental reports on nonconvex optimization problems in machine learning, stochastic gradient descent (SGD) was observed to prefer minimizers with flat basins in comparison to more deterministic methods, yet there is very…

最优化与控制 · 数学 2018-05-08 Vivak Patel

Mini-batch stochastic gradient methods (SGD) are state of the art for distributed training of deep neural networks. Drastic increases in the mini-batch sizes have lead to key efficiency and scalability gains in recent years. However,…

机器学习 · 计算机科学 2020-02-18 Tao Lin , Sebastian U. Stich , Kumar Kshitij Patel , Martin Jaggi

Stochastic gradient descent (SGD) is widely believed to perform implicit regularization when used to train deep neural networks, but the precise manner in which this occurs has thus far been elusive. We prove that SGD minimizes an average…

机器学习 · 计算机科学 2018-01-17 Pratik Chaudhari , Stefano Soatto

Mini-batch stochastic gradient descent (SGD) and variants thereof approximate the objective function's gradient with a small number of training examples, aka the batch size. Small batch sizes require little computation for each model update…

机器学习 · 计算机科学 2023-09-28 Scott Sievert , Shrey Shah

We study to what extent may stochastic gradient descent (SGD) be understood as a "conventional" learning rule that achieves generalization performance by obtaining a good fit to training data. We consider the fundamental stochastic convex…

机器学习 · 计算机科学 2023-01-13 Tomer Koren , Roi Livni , Yishay Mansour , Uri Sherman

Stochastic gradient descent (SGD), which dates back to the 1950s, is one of the most popular and effective approaches for performing stochastic optimization. Research on SGD resurged recently in machine learning for optimizing convex loss…

机器学习 · 计算机科学 2019-12-24 Jie Chen , Ronny Luss

When training neural networks, it has been widely observed that a large step size is essential in stochastic gradient descent (SGD) for obtaining superior models. However, the effect of large step sizes on the success of SGD is not well…

机器学习 · 计算机科学 2023-02-17 Amirkeivan Mohtashami , Martin Jaggi , Sebastian Stich

We show that stochastic gradient descent (SGD) escapes from sharp minima exponentially fast even before SGD reaches stationary distribution. SGD has been a de-facto standard training algorithm for various machine learning tasks. However,…

机器学习 · 计算机科学 2022-03-22 Hikaru Ibayashi , Masaaki Imaizumi

In this work, we investigate the dynamics of stochastic gradient descent (SGD) when training a single-neuron autoencoder with linear or ReLU activation on orthogonal data. We show that for this non-convex problem, randomly initialized SGD…

机器学习 · 统计学 2023-08-08 Nikhil Ghosh , Spencer Frei , Wooseok Ha , Bin Yu

For infinitesimal learning rates, stochastic gradient descent (SGD) follows the path of gradient flow on the full batch loss function. However moderately large learning rates can achieve higher test accuracies, and this generalization…

机器学习 · 计算机科学 2021-01-29 Samuel L. Smith , Benoit Dherin , David G. T. Barrett , Soham De

Stochastic gradient descent (SGD) is an estimation tool for large data employed in machine learning and statistics. Due to the Markovian nature of the SGD process, inference is a challenging problem. An underlying asymptotic normality of…

统计计算 · 统计学 2025-03-27 Rahul Singh , Abhinek Shukla , Dootika Vats

Machine learning, especially deep neural networks, has been rapidly developed in fields including computer vision, speech recognition and reinforcement learning. Although Mini-batch SGD is one of the most popular stochastic optimization…

机器学习 · 计算机科学 2019-03-12 Xinyu Peng , Li Li , Fei-Yue Wang
‹ 上一页 1 2 3 10 下一页 ›