English
Related papers

Related papers: Heavy-Tail Phenomenon in Decentralized SGD

200 papers

Recent research shows that modern deep learning models achieve high predictive accuracy partly by memorizing individual training samples. Such memorization raises serious privacy concerns, motivating the widespread adoption of…

Machine Learning · Computer Science 2026-02-05 Jiaming Zhang , Huanyi Xie , Meng Ding , Shaopeng Fu , Jinyan Liu , Di Wang

This paper proposes a communication strategy for decentralized learning on wireless systems. Our discussion is based on the decentralized parallel stochastic gradient descent (D-PSGD), which is one of the state-of-the-art algorithms for…

Networking and Internet Architecture · Computer Science 2020-02-26 Koya Sato , Yasuyuki Satoh , Daisuke Sugimura

We consider the problem of high-dimensional heavy-tailed statistical estimation in the streaming setting, which is much harder than the traditional batch setting due to memory constraints. We cast this problem as stochastic convex…

Machine Learning · Statistics 2024-10-29 Aniket Das , Dheeraj Nagaraj , Soumyabrata Pal , Arun Suggala , Prateek Varshney

We study a distributed machine learning problem carried out by an edge server and multiple agents in a wireless network. The objective is to minimize a global function that is a sum of the agents' local loss functions. And the optimization…

Information Theory · Computer Science 2021-12-03 Howard H. Yang , Zihan Chen , Tony Q. S. Quek , H. Vincent Poor

Long-tailed learning has attracted much attention recently, with the goal of improving generalisation for tail classes. Most existing works use supervised learning without considering the prevailing noise in the training dataset. To move…

Machine Learning · Computer Science 2021-08-27 Tong Wei , Jiang-Xin Shi , Wei-Wei Tu , Yu-Feng Li

In this paper, we consider the problem of linear regression with heavy-tailed distributions. Different from previous studies that use the squared loss to measure the performance, we choose the absolute loss, which is capable of estimating…

Machine Learning · Computer Science 2018-10-26 Lijun Zhang , Zhi-Hua Zhou

Distributed stochastic gradient descent (SGD) algorithms are widely deployed in training large-scale deep learning models, while the communication overhead among workers becomes the new system bottleneck. Recently proposed gradient…

Machine Learning · Computer Science 2019-11-21 Shaohuai Shi , Xiaowen Chu , Ka Chun Cheung , Simon See

Intervals between discrete events representing human activities, as well as other types of events, often obey heavy-tailed distributions, and their impacts on collective dynamics on networks such as contagion processes have been intensively…

Physics and Society · Physics 2020-11-24 Elohim Fonseca dos Reis , Aming Li , Naoki Masuda

We provide a detailed study on the implicit bias of gradient descent when optimizing loss functions with strictly monotone tails, such as the logistic loss, over separable datasets. We look at two basic questions: (a) what are the…

As one of the most fundamental problems in machine learning, statistics and differential privacy, Differentially Private Stochastic Convex Optimization (DP-SCO) has been extensively studied in recent years. However, most of the previous…

Machine Learning · Computer Science 2021-08-10 Lijie Hu , Shuo Ni , Hanshen Xiao , Di Wang

We consider a first order stochastic optimization framework where, at each iteration, $K$ independent identically distributed (i.i.d.) data point samples are drawn, based on which stochastic gradients can be queried. We allow gradient noise…

Optimization and Control · Mathematics 2026-05-11 Manojlo Vukovic , Dusan Jakovetic

We propose a novel analysis of the Decentralized Stochastic Gradient Descent (DSGD) algorithm with constant step size, interpreting the iterates of the algorithm as a Markov chain. We show that DSGD converges to a stationary distribution,…

Machine Learning · Computer Science 2026-01-13 Lucas Versini , Paul Mangold , Aymeric Dieuleveut

There is an increasing realization that algorithmic inductive biases are central in preventing overfitting; empirically, we often see a benign overfitting phenomenon in overparameterized settings for natural learning algorithms, such as…

Machine Learning · Computer Science 2021-10-14 Difan Zou , Jingfeng Wu , Vladimir Braverman , Quanquan Gu , Sham M. Kakade

Skew-elliptical distributions constitute a large class of multivariate distributions that account for both skewness and a variety of tail properties. This class has simpler representations in terms of densities rather than cumulative…

Probability · Mathematics 2019-01-21 Harry Joe , Haijun Li

A growing lesson from neural network optimization is that optimizer design should respect how the model is parametrized. Scale-invariant methods become important because their normalized layerwise updates can not only support hyperparameter…

Optimization and Control · Mathematics 2026-05-19 Jiayu Zhang , Tianyi Lin

Stochastic gradient descent (SGD) is a widely adopted iterative method for optimizing differentiable objective functions. In this paper, we propose and discuss a novel approach to scale up SGD in applications involving non-convex functions…

Machine Learning · Statistics 2022-10-07 Saad Mohamad , Hamad Alamri , Abdelhamid Bouchachia

Gradient clipping is a commonly used technique to stabilize the training process of neural networks. A growing body of studies has shown that gradient clipping is a promising technique for dealing with the heavy-tailed behavior that emerged…

Machine Learning · Computer Science 2023-07-26 Shaojie Li , Yong Liu

Gaussian noise injections (GNIs) are a family of simple and widely-used regularisation methods for training neural networks, where one injects additive or multiplicative Gaussian noise to the network activations at every iteration of the…

Machine Learning · Statistics 2021-06-14 Alexander Camuto , Xiaoyu Wang , Lingjiong Zhu , Chris Holmes , Mert Gürbüzbalaban , Umut Şimşekli

We study scalable alternatives to robust gradient descent (RGD) techniques that can be used when the losses and/or gradients can be heavy-tailed, though this will be unknown to the learner. The core technique is simple: instead of trying to…

Machine Learning · Statistics 2020-12-15 Matthew J. Holland

Deep linear networks (DLNs) are used as an analytically tractable model of the training dynamics of deep neural networks. While gradient descent in DLNs is known to exhibit saddle-to-saddle dynamics, the impact of stochastic gradient…

Machine Learning · Computer Science 2026-04-09 Guillaume Corlouer , Avi Semler , Alexander Strang , Alexander Gietelink Oldenziel
‹ Prev 1 4 5 6 7 8 10 Next ›