English
Related papers

Related papers: Distributed Machine Learning through Heterogeneous…

200 papers

We propose a new data-centric synchronization framework for carrying out of machine learning (ML) tasks in a distributed environment. Our framework exploits the iterative nature of ML algorithms and relaxes the application agnostic bulk…

Databases · Computer Science 2015-08-06 Naman Goel , Divyakant Agrawal , Sanjay Chawla , Ahmed Elmagarmid

Data generated at the network edge can be processed locally by leveraging the paradigm of edge computing (EC). Aided by EC, decentralized federated learning (DFL), which overcomes the single-point-of-failure problem in the parameter server…

Networking and Internet Architecture · Computer Science 2022-12-06 Yunming Liao , Yang Xu , Hongli Xu , Lun Wang , Chen Qian

In the era of deep learning (DL), convolutional neural networks (CNNs), and large language models (LLMs), machine learning (ML) models are becoming increasingly complex, demanding significant computational resources for both inference and…

Machine Learning · Computer Science 2024-05-27 Madison Threadgill , Andreas Gerstlauer

Edge computing enables smart IoT-based systems via concurrent and continuous execution of latency-sensitive machine learning (ML) applications. These edge-based machine learning systems are often battery-powered (i.e., energy-limited). They…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-22 Ali Mokhtari , Md Abir Hossen , Pooyan Jamshidi , Mohsen Amini Salehi

Mobile edge learning is an emerging technique that enables distributed edge devices to collaborate in training shared machine learning models by exploiting their local data samples and communication and computation resources. To deal with…

Signal Processing · Electrical Eng. & Systems 2020-01-31 Xiaoran Cai , Xiaopeng Mo , Junyang Chen , Jie Xu

As Machine Learning (ML) applications increase in data size and model complexity, practitioners turn to distributed clusters to satisfy the increased computational and memory demands. Unfortunately, effective use of clusters for ML requires…

Machine Learning · Computer Science 2014-10-31 Wei Dai , Abhimanu Kumar , Jinliang Wei , Qirong Ho , Garth Gibson , Eric P. Xing

Future machine learning (ML) powered applications, such as autonomous driving and augmented reality, involve training and inference tasks with timeliness requirements and are communication and computation intensive, which demands for the…

Networking and Internet Architecture · Computer Science 2020-09-24 Yuxuan Sun , Wenqi Shi , Xiufeng Huang , Sheng Zhou , Zhisheng Niu

Distributed machine learning (ML) at network edge is a promising paradigm that can preserve both network bandwidth and privacy of data providers. However, heterogeneous and limited computation and communication resources on edge servers (or…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-24 Qing Han , Shusen Yang , Xuebin Ren , Cong Zhao , Jingqi Zhang , Xinyu Yang

A fundamental challenge to providing edge-AI services is the need for a machine learning (ML) model that achieves personalization (i.e., to individual clients) and generalization (i.e., to unseen data) properties concurrently. Existing…

Machine Learning · Computer Science 2023-02-14 Dong-Jun Han , Do-Yeon Kim , Minseok Choi , Christopher G. Brinton , Jaekyun Moon

With the proliferation of edge devices, there is a significant increase in attack surface on these devices. The decentralized deployment of threat intelligence on edge devices, coupled with adaptive machine learning techniques such as the…

Cryptography and Security · Computer Science 2024-10-10 Syed Mhamudul Hasan , Alaa M. Alotaibi , Sajedul Talukder , Abdur R. Shahid

Resource-constrained IoT devices, such as sensors and actuators, have become ubiquitous in recent years. This has led to the generation of large quantities of data in real-time, which is an appealing target for AI systems. However,…

Machine Learning · Computer Science 2021-10-07 M. G. Sarwar Murshed , Christopher Murphy , Daqing Hou , Nazar Khan , Ganesh Ananthanarayanan , Faraz Hussain

Distributed machine learning has been widely studied in the literature to scale up machine learning model training in the presence of an ever-increasing amount of data. We study distributed machine learning from another perspective, where…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-16 Yaochen Hu , Di Niu , Jianming Yang , Shengping Zhou

The widespread adoption of machine learning on edge devices, such as mobile phones, laptops, IoT devices, etc., has enabled real-time AI applications in resource-constrained environments. Existing solutions for managing computational…

Software Engineering · Computer Science 2025-02-11 Akhila Matathammal , Kriti Gupta , Larissa Lavanya , Ananya Vishal Halgatti , Priyanshi Gupta , Karthik Vaidhyanathan

Fueled by the availability of more data and computing power, recent breakthroughs in cloud-based machine learning (ML) have transformed every aspect of our lives from face recognition and medical diagnosis to natural language processing.…

Information Theory · Computer Science 2019-09-13 Jihong Park , Sumudu Samarakoon , Mehdi Bennis , Mérouane Debbah

Owing to the large volume of sensed data from the enormous number of IoT devices in operation today, centralized machine learning algorithms operating on such data incur an unbearable training time, and thus cannot satisfy the requirements…

Signal Processing · Electrical Eng. & Systems 2020-07-21 Shashank Jere , Qiang Fan , Bodong Shang , Lianjun Li , Lingjia Liu

The demand for artificial intelligence has grown significantly over the last decade and this growth has been fueled by advances in machine learning techniques and the ability to leverage hardware acceleration. However, in order to increase…

Machine Learning · Computer Science 2022-11-28 Joost Verbraeken , Matthijs Wolting , Jonathan Katzy , Jeroen Kloppenburg , Tim Verbelen , Jan S. Rellermeyer

Split Learning (SL) is a promising collaborative machine learning approach, enabling resource-constrained devices to train models without sharing raw data, while reducing computational load and preserving privacy simultaneously. However,…

Machine Learning · Computer Science 2024-11-22 Yunrui Sun , Gang Hu , Yinglei Teng , Dunbo Cai

In this chapter, we will mainly focus on collaborative training across wireless devices. Training a ML model is equivalent to solving an optimization problem, and many distributed optimization algorithms have been developed over the last…

Machine Learning · Computer Science 2021-12-13 Emre Ozfatura , Deniz Gunduz , H. Vincent Poor

Federated edge learning (FEEL) has drawn much attention as a privacy-preserving distributed learning framework for mobile edge networks. In this work, we investigate a novel semi-decentralized FEEL (SD-FEEL) architecture where multiple edge…

Networking and Internet Architecture · Computer Science 2021-12-10 Yuchang Sun , Jiawei Shao , Yuyi Mao , Jun Zhang

Federated learning (FL) is a machine learning paradigm where a shared central model is learned across distributed edge devices while the training data remains on these devices. Federated Averaging (FedAvg) is the leading optimization method…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-22 Yujing Chen , Yue Ning , Martin Slawski , Huzefa Rangwala