中文
相关论文

相关论文: The Impact of the Mini-batch Size on the Variance …

200 篇论文

In the vanishing learning rate regime, stochastic gradient descent (SGD) is now relatively well understood. In this work, we propose to study the basic properties of SGD and its variants in the non-vanishing learning rate regime. The focus…

机器学习 · 统计学 2021-06-14 Kangqiao Liu , Liu Ziyin , Masahito Ueda

Although stochastic gradient descent (SGD) is a driving force behind the recent success of deep learning, our understanding of its dynamics in a high-dimensional parameter space is limited. In recent years, some researchers have used the…

机器学习 · 计算机科学 2018-11-29 Cheolhyoung Lee , Kyunghyun Cho , Wanmo Kang

Stochastic gradient descent (SGD) is an estimation tool for large data employed in machine learning and statistics. Due to the Markovian nature of the SGD process, inference is a challenging problem. An underlying asymptotic normality of…

统计计算 · 统计学 2025-03-27 Rahul Singh , Abhinek Shukla , Dootika Vats

We study how the batch size affects the total gradient variance in differentially private stochastic gradient descent (DP-SGD), seeking a theoretical explanation for the usefulness of large batch sizes. As DP-SGD is the basis of modern DP…

机器学习 · 统计学 2024-09-20 Ossi Räisä , Joonas Jälkö , Antti Honkela

This paper theoretically reanalyzes the convergence of the mini-batch stochastic gradient descent (SGD) for a structured minimization problem involving a finite-sum function with its gradient being stochastically approximated, and an…

最优化与控制 · 数学 2026-04-07 Runze Li , Jintao Xu , Wenxun Xing

Stochastic gradient descent~(SGD) and its variants have been the dominating optimization methods in machine learning. Compared to SGD with small-batch training, SGD with large-batch training can better utilize the computational power of…

机器学习 · 统计学 2024-04-16 Shen-Yi Zhao , Chang-Wei Shi , Yin-Peng Xie , Wu-Jun Li

When training neural networks, it has been widely observed that a large step size is essential in stochastic gradient descent (SGD) for obtaining superior models. However, the effect of large step sizes on the success of SGD is not well…

机器学习 · 计算机科学 2023-02-17 Amirkeivan Mohtashami , Martin Jaggi , Sebastian Stich

Stochastic gradient descent (SGD) with mini-batching is a standard tool in large-scale optimization, yet its theoretical properties under heavy-tailed gradient noise remain largely unexplored. In this paper we study SGD with increasing…

概率论 · 数学 2026-05-11 Bartosz Glowacki , Rafal Kulik , Philippe Soulier

We study the power of learning via mini-batch stochastic gradient descent (SGD) on the population loss, and batch Gradient Descent (GD) on the empirical loss, of a differentiable model or neural network, and ask what learning problems can…

机器学习 · 计算机科学 2022-02-08 Emmanuel Abbe , Pritish Kamath , Eran Malach , Colin Sandon , Nathan Srebro

We propose mS2GD: a method incorporating a mini-batching scheme for improving the theoretical complexity and practical performance of semi-stochastic gradient descent (S2GD). We consider the problem of minimizing a strongly convex function…

机器学习 · 计算机科学 2016-04-20 Jakub Konečný , Jie Liu , Peter Richtárik , Martin Takáč

Stochastic gradient descent (SGD) is almost ubiquitously used for training non-convex optimization tasks. Recently, a hypothesis proposed by Keskar et al. [2017] that large batch methods tend to converge to sharp minimizers has received…

机器学习 · 统计学 2018-12-04 Xiaowu Dai , Yuhua Zhu

Theoretically understanding stochastic gradient descent (SGD) in overparameterized models has led to the development of several optimization algorithms that are widely used in practice today. Recent work by~\citet{zou2021benign} provides…

机器学习 · 计算机科学 2025-06-19 Alexandru Meterez , Depen Morwani , Costin-Andrei Oncescu , Jingfeng Wu , Cengiz Pehlevan , Sham Kakade

This paper presents a methodology for selecting the mini-batch size that minimizes Stochastic Gradient Descent (SGD) learning time for single and multiple learner problems. By decoupling algorithmic analysis issues from hardware and…

Stochastic gradient descent (SGD) provides a simple and efficient way to solve a broad range of machine learning problems. Here, we focus on distribution regression (DR), involving two stages of sampling: Firstly, we regress from…

机器学习 · 统计学 2021-03-08 Nicole Mücke

Stochastic gradient descent (SGD) is one of the most popular algorithms in modern machine learning. The noise encountered in these applications is different from that in many theoretical analyses of stochastic gradient algorithms. In this…

机器学习 · 统计学 2021-09-16 Stephan Wojtowytsch

Mini-batch stochastic gradient descent (SGD) is state of the art in large scale distributed training. The scheme can reach a linear speedup with respect to the number of workers, but this is rarely seen in practice as the scheme often…

最优化与控制 · 数学 2019-05-06 Sebastian U. Stich

Stochastic gradient descent (SGD) is a popular algorithm for optimization problems arising in high-dimensional inference tasks. Here one produces an estimator of an unknown parameter from independent samples of data by iteratively…

机器学习 · 统计学 2023-06-23 Gerard Ben Arous , Reza Gheissari , Aukosh Jagannath

Stochastic gradient descent (SGD) type optimization schemes are fundamental ingredients in a large number of machine learning based algorithms. In particular, SGD type optimization schemes are frequently employed in applications involving…

数值分析 · 数学 2020-07-22 Aritz Bercher , Lukas Gonon , Arnulf Jentzen , Diyora Salimova

Stochastic gradient descent (SGD) is often applied to train Deep Neural Networks (DNNs), and research efforts have been devoted to investigate the convergent dynamics of SGD and minima found by SGD. The influencing factors identified in the…

机器学习 · 计算机科学 2020-09-25 Victor Luo , Yazhen Wang

We propose a new stochastic optimization framework for empirical risk minimization problems such as those that arise in machine learning. The traditional approaches, such as (mini-batch) stochastic gradient descent (SGD), utilize an…

机器学习 · 统计学 2020-02-04 Kenji Kawaguchi , Haihao Lu