English
Related papers

Related papers: Stability and Generalization for Decentralized Mar…

200 papers

Deep Markov models (DMM) are generative models that are scalable and expressive generalization of Markov models for representation, learning, and inference problems. However, the fundamental stochastic stability guarantees of such models…

Machine Learning · Computer Science 2021-11-09 Ján Drgoňa , Sayak Mukherjee , Jiaxin Zhang , Frank Liu , Mahantesh Halappanavar

Stochastic Gradient Descent (SGD) has become popular for solving large scale supervised machine learning optimization problems such as SVM, due to their strong theoretical guarantees. While the closely related Dual Coordinate Ascent (DCA)…

Machine Learning · Statistics 2015-03-20 Shai Shalev-Shwartz , Tong Zhang

While stochastic gradient descent (SGD) and variants have been surprisingly successful for training deep nets, several aspects of the optimization dynamics and generalization are still not well understood. In this paper, we present new…

Machine Learning · Computer Science 2019-07-26 Xinyan Li , Qilong Gu , Yingxue Zhou , Tiancong Chen , Arindam Banerjee

The increasing scale of data propels the popularity of leveraging parallelism to speed up the optimization. Minibatch stochastic gradient descent (minibatch SGD) and local SGD are two popular methods for parallel optimization. The existing…

Machine Learning · Computer Science 2025-10-14 Yunwen Lei , Tao Sun , Mingrui Liu

In this paper, we investigate the impact of stochasticity and large stepsizes on the implicit regularisation of gradient descent (GD) and stochastic gradient descent (SGD) over diagonal linear networks. We prove the convergence of GD and…

Machine Learning · Computer Science 2023-10-26 Mathieu Even , Scott Pesme , Suriya Gunasekar , Nicolas Flammarion

This paper introduces a decentralized state-dependent Markov chain synthesis (DSMC) algorithm for finite-state Markov chains. We present a state-dependent consensus protocol that achieves exponential convergence under mild technical…

Optimization and Control · Mathematics 2024-04-29 Samet Uzun , Nazim Kemal Ure , Behcet Acikmese

Distributed machine learning has been widely studied in the literature to scale up machine learning model training in the presence of an ever-increasing amount of data. We study distributed machine learning from another perspective, where…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-16 Yaochen Hu , Di Niu , Jianming Yang , Shengping Zhou

Variance reduction (VR) methods employ stochastic gradients with decreasing variance, and they have been widely applied to solve large-scale optimization problems in machine learning because of their efficiency. Existing theoretical studies…

Machine Learning · Computer Science 2026-05-28 Yunwen Lei , Zimeng Wang , Xiaoming Yuan

Local SGD is a promising approach to overcome the communication overhead in distributed learning by reducing the synchronization frequency among worker nodes. Despite the recent theoretical advances of local SGD in empirical risk…

Machine Learning · Computer Science 2021-03-01 Yuyang Deng , Mehrdad Mahdavi

In this work, we focus on the communication aspect of decentralized learning, which involves multiple agents training a shared machine learning model using decentralized stochastic gradient descent (D-SGD) over distributed data. In…

Networking and Internet Architecture · Computer Science 2023-07-10 Zheng Chen , Martin Dahl , Erik G. Larsson

In this paper, we consider a general stochastic optimization problem which is often at the core of supervised learning, such as deep learning and linear classification. We consider a standard stochastic gradient descent (SGD) method with a…

Machine Learning · Statistics 2018-12-27 Lam M. Nguyen , Nam H. Nguyen , Dzung T. Phan , Jayant R. Kalagnanam , Katya Scheinberg

In this paper, we focus on the decentralized stochastic subgradient-based methods in minimizing nonsmooth nonconvex functions without Clarke regularity, especially in the decentralized training of nonsmooth neural networks. We propose a…

Optimization and Control · Mathematics 2026-01-07 Siyuan Zhang , Nachuan Xiao , Xin Liu

We analyze in a closed form the learning dynamics of stochastic gradient descent (SGD) for a single-layer neural network classifying a high-dimensional Gaussian mixture where each cluster is assigned one of two labels. This problem provides…

Machine Learning · Computer Science 2022-03-28 Francesca Mignacco , Florent Krzakala , Pierfrancesco Urbani , Lenka Zdeborová

We consider decentralized machine learning over a network where the training data is distributed across $n$ agents, each of which can compute stochastic model updates on their local data. The agent's common goal is to find a model that…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-09 Anastasia Koloskova , Tao Lin , Sebastian U. Stich

The success of minimax learning problems of generative adversarial networks (GANs) has been observed to depend on the minimax optimization algorithm used for their training. This dependence is commonly attributed to the convergence speed…

Machine Learning · Computer Science 2020-10-26 Farzan Farnia , Asuman Ozdaglar

We propose a novel distributed inference algorithm for continuous graphical models, by extending Stein variational gradient descent (SVGD) to leverage the Markov dependency structure of the distribution of interest. Our approach combines…

Machine Learning · Statistics 2018-06-11 Dilin Wang , Zhe Zeng , Qiang Liu

The stochastic gradient descent (SGD) algorithm is the algorithm we use to train neural networks. However, it remains poorly understood how the SGD navigates the highly nonlinear and degenerate loss landscape of a neural network. In this…

Machine Learning · Computer Science 2025-06-13 Liu Ziyin , Hongchao Li , Masahito Ueda

Uniform stability is a notion of algorithmic stability that bounds the worst case change in the model output by the algorithm when a single data point in the dataset is replaced. An influential work of Hardt et al. (2016) provides strong…

Machine Learning · Computer Science 2020-06-15 Raef Bassily , Vitaly Feldman , Cristóbal Guzmán , Kunal Talwar

The classical statistical learning theory implies that fitting too many parameters leads to overfitting and poor performance. That modern deep neural networks generalize well despite a large number of parameters contradicts this finding and…

Machine Learning · Statistics 2022-10-18 Masaaki Imaizumi , Johannes Schmidt-Hieber

Recent works have shown that high probability metrics with stochastic gradient descent (SGD) exhibit informativeness and in some cases advantage over the commonly adopted mean-square error-based ones. In this work we provide a formal…

Machine Learning · Computer Science 2022-11-03 Dragana Bajovic , Dusan Jakovetic , Soummya Kar