中文
相关论文

相关论文: EDEN: Communication-Efficient and Robust Distribut…

200 篇论文

Distributed learning algorithms aim to leverage distributed and diverse data stored at users' devices to learn a global phenomena by performing training amongst participating devices and periodically aggregating their local models'…

机器学习 · 计算机科学 2021-02-04 Naram Mhaisen , Alaa Awad , Amr Mohamed , Aiman Erbad , Mohsen Guizani

In recent years, distributed optimization is proven to be an effective approach to accelerate training of large scale machine learning models such as deep neural networks. With the increasing computation power of GPUs, the bottleneck of…

机器学习 · 计算机科学 2021-09-14 Xiangyi Chen , Xiaoyun Li , Ping Li

Federated learning (FL) enables devices in mobile edge computing (MEC) to collaboratively train a shared model without uploading the local data. Gradient compression may be applied to FL to alleviate the communication overheads but current…

机器学习 · 计算机科学 2023-11-01 Peichun Li , Xumin Huang , Miao Pan , Rong Yu

Federated learning (FL) enables edge-devices to collaboratively learn a model without disclosing their private data to a central aggregating server. Most existing FL algorithms require models of identical architecture to be deployed across…

机器学习 · 计算机科学 2022-04-28 Yae Jee Cho , Andre Manoel , Gauri Joshi , Robert Sim , Dimitrios Dimitriadis

Distributed methods are essential for handling machine learning pipelines comprising large-scale models and datasets. However, their benefits often come at the cost of increased communication overhead between the central server and agents,…

机器学习 · 计算机科学 2025-03-03 Enea Monzio Compagnoni , Rustem Islamov , Frank Norbert Proske , Aurelien Lucchi

In federated learning, communication cost is often a critical bottleneck to scale up distributed optimization algorithms to collaboratively learn a model from millions of devices with potentially unreliable or limited communication and…

机器学习 · 计算机科学 2020-11-24 Farzin Haddadpour , Mohammad Mahdi Kamani , Aryan Mokhtari , Mehrdad Mahdavi

Statistical and systematic challenges in collaboratively training machine learning models across distributed networks of mobile devices have been the bottlenecks in the real-world application of federated learning. In this work, we show…

机器学习 · 计算机科学 2019-12-17 Fei Chen , Mi Luo , Zhenhua Dong , Zhenguo Li , Xiuqiang He

Federated Learning (FL) is a promising distributed method for edge-level machine learning, particularly for privacysensitive applications such as those in military and medical domains, where client data cannot be shared or transferred to a…

机器学习 · 计算机科学 2024-06-27 Lucas Grativol Ribeiro , Mathieu Leonardon , Guillaume Muller , Virginie Fresse , Matthieu Arzel

The Expectation Maximization (EM) algorithm is the default algorithm for inference in latent variable models. As in any other field of machine learning, applications of latent variable models to very large datasets make the use of advanced…

最优化与控制 · 数学 2021-11-11 Aymeric Dieuleveut , Gersende Fort , Eric Moulines , Geneviève Robin

In large-scale distributed environments, avoiding concurrent access to the same resource by multiple processes becomes a core challenge, commonly termed distributed mutual exclusion (DME). Token-based mechanisms have long been recognized as…

分布式、并行与集群计算 · 计算机科学 2025-02-10 Elahe Tohidi , Seyed Sattar Lotfi Fatemi

To process and transfer large amounts of data in emerging wireless services, it has become increasingly appealing to exploit distributed data communication and learning. Specifically, edge learning (EL) enables local model training on…

信息论 · 计算机科学 2023-03-22 Wei Xu , Zhaohui Yang , Derrick Wing Kwan Ng , Marco Levorato , Yonina C. Eldar , M'erouane Debbah

Federated learning, where algorithms are trained across multiple decentralized devices without sharing local data, is increasingly popular in distributed machine learning practice. Typically, a graph structure $G$ exists behind local…

机器学习 · 统计学 2022-09-20 Huiyuan Wang , Xuyang Zhao , Wei Lin

Edge signal processing facilitates distributed learning and inference in the client-server model proposed in federated learning. In traditional machine learning, clients (IoT devices) that acquire raw signal samples can aid a data center…

信号处理 · 电气工程与系统科学 2024-10-03 Vijay Anavangot

In federated learning (FL) systems, e.g., wireless networks, the communication cost between the clients and the central server can often be a bottleneck. To reduce the communication cost, the paradigm of communication compression has become…

机器学习 · 统计学 2022-11-28 Xiaoyun Li , Ping Li

Federated Learning is a machine learning setting where the goal is to train a high-quality centralized model while training data remains distributed over a large number of clients each with unreliable and relatively slow network…

The deployment of federated learning in a wireless network, called federated edge learning (FEEL), exploits low-latency access to distributed mobile data to efficiently train an AI model while preserving data privacy. In this work, we study…

信息论 · 计算机科学 2021-03-11 Zhenyi Lin , Xiaoyang Li , Vincent K. N. Lau , Yi Gong , Kaibin Huang

Federated learning is a privacy-preserving approach to train a global model at a central server by collaborating with wireless devices, each with its own local training data set. In this paper, we present a compressive sensing approach for…

信号处理 · 电气工程与系统科学 2020-08-06 Yo-Seb Jeon , Mohammad Mohammadi Amiri , Jun Li , H. Vincent Poor

Training at the edge utilizes continuously evolving data generated at different locations. Privacy concerns prohibit the co-location of this spatially as well as temporally distributed data, deeming it crucial to design training algorithms…

机器学习 · 计算机科学 2023-03-28 Sakshi Choudhary , Sai Aparna Aketi , Gobinda Saha , Kaushik Roy

Federated Learning (FL) has evolved as a promising technique to handle distributed machine learning across edge devices. A single neural network (NN) that optimises a global objective is generally learned in most work in FL, which could be…

信息论 · 计算机科学 2022-03-10 Sawan Singh Mahara , Shruti M. , B. N. Bharath , Akash Murthy

Federated learning~(FL) has recently attracted increasing attention from academia and industry, with the ultimate goal of achieving collaborative training under privacy and communication constraints. Existing iterative model averaging based…

机器学习 · 计算机科学 2022-07-21 Yuanhao Xiong , Ruochen Wang , Minhao Cheng , Felix Yu , Cho-Jui Hsieh