English
Related papers

Related papers: Why are Adaptive Methods Good for Attention Models…

200 papers

We propose a federated version of adaptive gradient methods, particularly AdaGrad and Adam, within the framework of over-the-air model training. This approach capitalizes on the inherent superposition property of wireless channels,…

Machine Learning · Computer Science 2024-03-12 Chenhao Wang , Zihan Chen , Nikolaos Pappas , Howard H. Yang , Tony Q. S. Quek , H. Vincent Poor

Motivated by extreme multi-label classification applications, we consider training deep learning models over sparse data in multi-GPU servers. The variance in the number of non-zero features across training batches and the intrinsic GPU…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-15 Yujing Ma , Florin Rusu , Kesheng Wu , Alexander Sim

We study high-probability convergence guarantees of learning on streaming data in the presence of heavy-tailed noise. In the proposed scenario, the model is updated in an online fashion, as new information is observed, without storing any…

Machine Learning · Computer Science 2024-05-02 Aleksandar Armacki , Pranay Sharma , Gauri Joshi , Dragana Bajovic , Dusan Jakovetic , Soummya Kar

Non-convex optimization problems are ubiquitous in machine learning, especially in Deep Learning. While such complex problems can often be successfully optimized in practice by using stochastic gradient descent (SGD), theoretical analysis…

Machine Learning · Computer Science 2022-02-21 Harsh Vardhan , Sebastian U. Stich

Deep neural networks are usually trained with stochastic gradient descent (SGD), which minimizes objective function using very rough approximations of gradient, only averaging to the real gradient. Standard approaches like momentum or ADAM…

Machine Learning · Computer Science 2023-03-14 Jarek Duda

Due to the massive size of the neural network models and training datasets used in machine learning today, it is imperative to distribute stochastic gradient descent (SGD) by splitting up tasks such as gradient evaluation across multiple…

Machine Learning · Computer Science 2020-03-13 Xiaoxi Zhang , Jianyu Wang , Gauri Joshi , Carlee Joe-Wong

We propose an algorithm for the adaptation of the learning rate for stochastic gradient descent (SGD) that avoids the need for validation set use. The idea for the adaptiveness comes from the technique of extrapolation: to get an estimate…

Machine Learning · Statistics 2020-08-28 Antti Koskela , Antti Honkela

Per-example gradient clipping is a key algorithmic step that enables practical differential private (DP) training for deep learning models. The choice of clipping threshold R, however, is vital for achieving high accuracy under DP. We…

Machine Learning · Computer Science 2023-10-05 Zhiqi Bu , Yu-Xiang Wang , Sheng Zha , George Karypis

Heavy-tailed stochastic gradient noise, commonly observed in transformer models, can destabilize the optimization process. Recent works mainly focus on developing and understanding approaches to address heavy-tailed noise in the centralized…

Machine Learning · Computer Science 2026-02-23 Junfei Sun , Dixi Yao , Xuchen Gong , Tahseen Rabbani , Manzil Zaheer , Tian Li

Deep neural networks (DNN) are typically optimized using stochastic gradient descent (SGD). However, the estimation of the gradient using stochastic samples tends to be noisy and unreliable, resulting in large gradient variance and bad…

Machine Learning · Computer Science 2021-05-18 Xingyi Yang

The injection of heavy-tailed noise into the iterates of stochastic gradient descent (SGD) has garnered growing interest in recent years due to its theoretical and empirical benefits for optimization and generalization. However, its…

Machine Learning · Statistics 2025-05-13 Umut Şimşekli , Mert Gürbüzbalaban , Sinan Yıldırım , Lingjiong Zhu

Distributed methods are essential for handling machine learning pipelines comprising large-scale models and datasets. However, their benefits often come at the cost of increased communication overhead between the central server and agents,…

Machine Learning · Computer Science 2025-03-03 Enea Monzio Compagnoni , Rustem Islamov , Frank Norbert Proske , Aurelien Lucchi

We study Stochastic Gradient Descent with AdaGrad stepsizes: a popular adaptive (self-tuning) method for first-order stochastic optimization. Despite being well studied, existing analyses of this method suffer from various shortcomings:…

Machine Learning · Computer Science 2023-06-13 Amit Attia , Tomer Koren

Convolutional neural networks (CNNs) are trained using stochastic gradient descent (SGD)-based optimizers. Recently, the adaptive moment estimation (Adam) optimizer has become very popular due to its adaptive momentum, which tackles the…

Machine Learning · Computer Science 2023-09-12 S. K. Roy , M. E. Paoletti , J. M. Haut , S. R. Dubey , P. Kar , A. Plaza , B. B. Chaudhuri

We study scalable alternatives to robust gradient descent (RGD) techniques that can be used when the losses and/or gradients can be heavy-tailed, though this will be unknown to the learner. The core technique is simple: instead of trying to…

Machine Learning · Statistics 2020-12-15 Matthew J. Holland

Stochastic gradient descent (SGD) is a ubiquitous algorithm for a variety of machine learning problems. Researchers and industry have developed several techniques to optimize SGD's runtime performance, including asynchronous execution and…

Machine Learning · Computer Science 2015-10-06 Christopher De Sa , Ce Zhang , Kunle Olukotun , Christopher Ré

Understanding the generalization properties of optimization algorithms under heavy-tailed noise has gained growing attention. However, the existing theoretical results mainly focus on stochastic gradient descent (SGD) and the analysis of…

Previous works on stochastic gradient descent (SGD) often focus on its success. In this work, we construct worst-case optimization problems illustrating that, when not in the regimes that the previous works often assume, SGD can exhibit…

Machine Learning · Computer Science 2023-05-30 Liu Ziyin , Botao Li , James B. Simon , Masahito Ueda

Gradient descent algorithm is the most utilized method when optimizing machine learning issues. However, there exists many local minimums and saddle points in the loss function, especially for high dimensional non-convex optimization…

Machine Learning · Computer Science 2021-07-19 Zhicheng Cai

We consider a standard distributed optimization problem in which networked nodes collaboratively minimize the sum of their locally known convex costs. For this setting, we address for the first time the fundamental problem of design and…

Optimization and Control · Mathematics 2025-06-02 Manojlo Vukovic , Dusan Jakovetic , Dragana Bajovic , Soummya Kar