English
Related papers

Related papers: Federated Optimization:Distributed Optimization Be…

200 papers

In the distributed optimization problem for a multi-agent system, each agent knows a local function and must find a minimizer of the sum of all agents' local functions by performing a combination of local gradient evaluations and…

Optimization and Control · Mathematics 2022-06-16 Bryan Van Scoy , Laurent Lessard

Federated learning enables resource-constrained edge compute devices, such as mobile phones and IoT devices, to learn a shared model for prediction, while keeping the training data local. This decentralized approach to train models provides…

Machine Learning · Computer Science 2022-07-22 Yue Zhao , Meng Li , Liangzhen Lai , Naveen Suda , Damon Civin , Vikas Chandra

Federated Learning (FL) is a collaborative machine learning framework that allows multiple users to train models utilizing their local data in a distributed manner. However, considerable statistical heterogeneity in local data across…

Machine Learning · Computer Science 2024-09-10 Qi Le , Enmao Diao , Xinran Wang , Vahid Tarokh , Jie Ding , Ali Anwar

Federated learning is a distributed form of machine learning where both the training data and model training are decentralized. In this paper, we use federated learning in a commercial, global-scale setting to train, evaluate and deploy a…

Machine Learning · Computer Science 2018-12-10 Timothy Yang , Galen Andrew , Hubert Eichner , Haicheng Sun , Wei Li , Nicholas Kong , Daniel Ramage , Françoise Beaufays

This paper introduces a systematic methodological framework to design and analyze distributed algorithms for optimization and games over networks. Starting from a centralized method, we identify an aggregation function involving all the…

Optimization and Control · Mathematics 2025-05-26 Guido Carnevale , Nicola Mimmo , Giuseppe Notarstefano

The widespread adoption of smartphones and smart wearable devices has led to the widespread use of Centralized Federated Learning (CFL) for training powerful machine learning models while preserving data privacy. However, CFL faces…

Machine Learning · Computer Science 2025-03-18 Chengyan Jiang , Jiamin Fan , Talal Halabi , Israat Haque

Federated learning (FL) is a recently proposed distributed machine learning paradigm dealing with distributed and private data sets. Based on the data partition pattern, FL is often categorized into horizontal, vertical, and hybrid…

Machine Learning · Computer Science 2021-02-19 Xinwei Zhang , Wotao Yin , Mingyi Hong , Tianyi Chen

Recently, a considerable amount of works have been made to tackle the communication burden in federated learning (FL) (e.g., model quantization, data sparsification, and model compression). However, the existing methods, that boost the…

Information Theory · Computer Science 2022-06-15 Xuan-Tung Nguyen , Minh-Duong Nguyen , Quoc-Viet Pham , Vinh-Quang Do , Won-Joo Hwang

In this paper we consider a novel partitioned framework for distributed optimization in peer-to-peer networks. In several important applications the agents of a network have to solve an optimization problem with two key features: (i) the…

Systems and Control · Computer Science 2018-05-23 Ivano Notarnicola , Ruggero Carli , Giuseppe Notarstefano

Nowadays, devices are equipped with advanced sensors with higher processing/computing capabilities. Further, widespread Internet availability enables communication among sensing devices. As a result, vast amounts of data are generated on…

Machine Learning · Computer Science 2020-02-26 Ahmed Imteaj , Urmish Thakker , Shiqiang Wang , Jian Li , M. Hadi Amini

In decentralized optimization, nodes cooperate to minimize an overall objective function that is the sum (or average) of per-node private objective functions. Algorithms interleave local computations with communication among all or a subset…

Optimization and Control · Mathematics 2018-01-16 Angelia Nedić , Alex Olshevsky , Michael G. Rabbat

With the development of federated learning (FL), mobile devices (MDs) are able to train their local models with private data and sends them to a central server for aggregation, thereby preventing sensitive raw data leakage. In this paper,…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-15 Shunfeng Chu , Jun Li , Jianxin Wang , Zhe Wang , Ming Ding , Yijin Zang , Yuwen Qian , Wen Chen

There are situations where data relevant to a machine learning problem are distributed among multiple locations that cannot share the data due to regulatory, competitiveness, or privacy reasons. For example, data present in users'…

Machine Learning · Computer Science 2020-08-27 Dimitris Stripelis , Jose Luis Ambite

Federated learning is a distributed machine learning approach to privacy preservation and two major technical challenges prevent a wider application of federated learning. One is that federated learning raises high demands on communication,…

Machine Learning · Computer Science 2020-03-06 Hangyu Zhu , Yaochu Jin

Federated learning encapsulates distributed learning strategies that are managed by a central unit. Since it relies on using a selected number of agents at each iteration, and since each agent, in turn, taps into its local data, it is only…

Machine Learning · Computer Science 2020-12-15 Elsa Rizk , Stefan Vlaski , Ali H. Sayed

The explosive growth of smart devices (e.g., mobile phones, vehicles, drones) with sensing, communication, and computation capabilities gives rise to an unprecedented amount of data. The generated massive data together with the rapid…

Networking and Internet Architecture · Computer Science 2023-10-10 Yong Zhou , Yuanming Shi , Haibo Zhou , Jingjing Wang , Liqun Fu , Yang Yang

Most algorithms for solving optimization problems or finding saddle points of convex-concave functions are fixed-point algorithms. In this work we consider the generic problem of finding a fixed point of an average of operators, or an…

Machine Learning · Computer Science 2020-06-17 Grigory Malinovsky , Dmitry Kovalev , Elnur Gasanov , Laurent Condat , Peter Richtárik

Federated Learning is an emerging distributed collaborative learning paradigm used by many of applications nowadays. The effectiveness of federated learning relies on clients' collective efforts and their willingness to contribute local…

Computer Science and Game Theory · Computer Science 2022-05-24 Shuyu Kong , You Li , Hai Zhou

Federated learning opens a number of research opportunities due to its high communication efficiency in distributed training problems within a star network. In this paper, we focus on improving the communication efficiency for fully…

Machine Learning · Computer Science 2019-12-11 Songtao Lu , Yawen Zhang , Yunlong Wang , Christina Mack

A major challenge in machine learning is resilience to out-of-distribution data, that is data that exists outside of the distribution of a model's training data. Training is often performed using limited, carefully curated datasets and so…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Christopher J. Holder , Majid Khonji , Jorge Dias , Muhammad Shafique