English
Related papers

Related papers: DONE: Distributed Approximate Newton-type Method f…

200 papers

We study distributed algorithms for expected loss minimization where the datasets are large and have to be stored on different machines. Often we deal with minimizing the average of a set of convex functions where each function is the…

Machine Learning · Computer Science 2019-07-24 Samira Sheikhi

Federated learning aims to jointly learn statistical models over massively distributed remote devices. In this work, we propose FedDANE, an optimization method that we adapt from DANE, a method for classical distributed optimization, to…

Machine Learning · Computer Science 2020-01-08 Tian Li , Anit Kumar Sahu , Manzil Zaheer , Maziar Sanjabi , Ameet Talwalkar , Virginia Smith

The DANE algorithm is an approximate Newton method popularly used for communication-efficient distributed machine learning. Reasons for the interest in DANE include scalability and versatility. Convergence of DANE, however, can be tricky;…

Machine Learning · Statistics 2019-08-07 Xiao-Tong Yuan , Ping Li

Federated learning is a distributed optimization paradigm that allows training machine learning models across decentralized devices while keeping the data localized. The standard method, FedAvg, suffers from client drift which can hamper…

Machine Learning · Computer Science 2024-04-15 Xiaowen Jiang , Anton Rodomanov , Sebastian U. Stich

In developing efficient optimization algorithms, it is crucial to account for communication constraints -- a significant challenge in modern Federated Learning. The best-known communication complexity among non-accelerated algorithms is…

Machine Learning · Computer Science 2024-11-05 Xiaowen Jiang , Anton Rodomanov , Sebastian U. Stich

We present a novel Newton-type method for distributed optimization, which is particularly well suited for stochastic optimization and learning problems. For quadratic objectives, the method enjoys a linear rate of convergence which provably…

Machine Learning · Computer Science 2014-05-15 Ohad Shamir , Nathan Srebro , Tong Zhang

There is a growing interest in the distributed optimization framework that goes under the name of Federated Learning (FL). In particular, much attention is being turned to FL scenarios where the network is strongly heterogeneous in terms of…

Machine Learning · Computer Science 2022-09-14 Nicolò Dal Fabbro , Subhrakanti Dey , Michele Rossi , Luca Schenato

Efficient collaboration between collaborative machine learning and wireless communication technology, forming a Federated Edge Learning (FEEL), has spawned a series of next-generation intelligent applications. However, due to the openness…

Machine Learning · Computer Science 2021-11-05 Yi Liu , Yuanshao Zhu , James J. Q. Yu

We consider minimization of a sum of convex objective functions where the components of the objective are available at different nodes of a network and nodes are allowed to only communicate with their neighbors. The use of distributed…

Optimization and Control · Mathematics 2014-12-12 Aryan Mokhtari , Qing Ling , Alejandro Ribeiro

Newton's method leverages curvature information to boost performance, and thus outperforms first-order methods for distributed learning problems. However, Newton's method is not practical in large-scale and heterogeneous learning…

Machine Learning · Computer Science 2024-12-18 Shuzhen Chen , Yuan Yuan , Youming Tao , Tianzhu Wang , Zhipeng Cai , Dongxiao Yu

In this paper, we present two new communication-efficient methods for distributed minimization of an average of functions. The first algorithm is an inexact variant of the DANE algorithm that allows any local algorithm to return an…

Optimization and Control · Mathematics 2016-08-25 Sashank J. Reddi , Jakub Konečný , Peter Richtárik , Barnabás Póczós , Alex Smola

Federated learning is a powerful distributed learning scheme that allows numerous edge devices to collaboratively train a model without sharing their data. However, training is resource-intensive for edge devices, and limited network…

Machine Learning · Computer Science 2024-10-25 Hui-Po Wang , Sebastian U. Stich , Yang He , Mario Fritz

Deep learning involves a difficult non-convex optimization problem with a large number of weights between any two adjacent layers of a deep structure. To handle large data sets or complicated networks, distributed training is needed, but…

Distributed Mean Estimation (DME) is a central building block in federated learning, where clients send local gradients to a parameter server for averaging and updating the model. Due to communication constraints, clients often use lossy…

Machine Learning · Computer Science 2022-06-16 Shay Vargaftik , Ran Ben Basat , Amit Portnoy , Gal Mendelson , Yaniv Ben-Itzhak , Michael Mitzenmacher

Large-scale machine learning models are often trained by parallel stochastic gradient descent algorithms. However, the communication cost of gradient aggregation and model synchronization between the master and worker nodes becomes the…

Machine Learning · Computer Science 2020-07-03 Xiaorui Liu , Yao Li , Jiliang Tang , Ming Yan

We consider distributed convex optimization problems originated from sample average approximation of stochastic optimization, or empirical risk minimization in machine learning. We assume that each machine in the distributed computing…

Optimization and Control · Mathematics 2015-01-05 Yuchen Zhang , Lin Xiao

We propose a distributed, cubic-regularized Newton method for large-scale convex optimization over networks. The proposed method requires only local computations and communications and is suitable for federated learning applications over…

Optimization and Control · Mathematics 2020-07-08 César A. Uribe , Ali Jadbabaie

Federated Learning (FL) has evolved as a promising technique to handle distributed machine learning across edge devices. A single neural network (NN) that optimises a global objective is generally learned in most work in FL, which could be…

Information Theory · Computer Science 2022-03-10 Sawan Singh Mahara , Shruti M. , B. N. Bharath , Akash Murthy

Federated learning (FL) is a promising technology that enables edge devices/clients to collaboratively and iteratively train a machine learning model under the coordination of a central server. The most common approach to FL is first-order…

Machine Learning · Computer Science 2025-01-22 Shayan Mohajer Hamidi , Linfeng Ye

In this paper, we consider distributed algorithms for solving the empirical risk minimization problem under the master/worker communication model. We develop a distributed asynchronous quasi-Newton algorithm that can achieve superlinear…

Optimization and Control · Mathematics 2019-06-11 Saeed Soori , Konstantin Mischenko , Aryan Mokhtari , Maryam Mehri Dehnavi , Mert Gurbuzbalaban
‹ Prev 1 2 3 10 Next ›