English
Related papers

Related papers: SplitEasy: A Practical Approach for Training ML mo…

200 papers

Data collected by IoT devices are often private and have a large diversity across users. Therefore, learning requires pre-training a model with available representative data samples, deploying the pre-trained model on IoT devices, and…

Machine Learning · Computer Science 2022-06-28 Zhongnan Qu , Zimu Zhou , Yongxin Tong , Lothar Thiele

Federated learning (FL) provides a distributed learning framework for multiple participants to collaborate learning without sharing raw data. In many practical FL scenarios, participants have heterogeneous resources due to disparities in…

Machine Learning · Computer Science 2022-03-21 Junyuan Hong , Haotao Wang , Zhangyang Wang , Jiayu Zhou

Currently the only techniques for sharing governance of a deep learning model are homomorphic encryption and secure multiparty computation. Unfortunately, neither of these techniques is applicable to the training of large neural networks…

Machine Learning · Computer Science 2018-12-17 Miljan Martic , Jan Leike , Andrew Trask , Matteo Hessel , Shane Legg , Pushmeet Kohli

New intelligence applications are driving increasing interest in deploying deep neural networks (DNN) in a distributed way. To set up distributed deep learning involves alterations of a great number of the parameter configurations of…

Machine Learning · Computer Science 2022-11-24 Xiaoyan Liu , Zhiwei Xu , Yana Qin , Jie Tian

The traditional cloud-centric approach for Deep Learning (DL) requires training data to be collected and processed at a central server which is often challenging in privacy-sensitive domains like healthcare. Towards this, a new learning…

Cryptography and Security · Computer Science 2021-11-08 Andreas Grafberger , Mohak Chadha , Anshul Jindal , Jianfeng Gu , Michael Gerndt

With the increasing data volume, there is a trend of using large-scale pre-trained models to store the knowledge into an enormous number of model parameters. The training of these models is composed of lots of dense algebras, requiring a…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-11 Xiaonan Nie , Xupeng Miao , Zilong Wang , Zichao Yang , Jilong Xue , Lingxiao Ma , Gang Cao , Bin Cui

The scientific computation of large deformations in elastic-plastic solids is crucial in various manufacturing applications. Traditional numerical methods exhibit several inherent limitations, prompting Deep Learning (DL) as a promising…

Artificial Intelligence · Computer Science 2026-01-16 Jianheng Tang , Shilong Tao , Zhe Feng , Haonan Sun , Menglu Wang , Zhanxing Zhu , Yunhuai Liu

With the prevalence of Large Learning Models (LLM), Split Federated Learning (SFL), which divides a learning model into server-side and client-side models, has emerged as an appealing technology to deal with the heavy computational burden…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-03 Yipeng Liang , Qimei Chen , Guangxu Zhu , Muhammad Kaleem Awan , Hao Jiang

Federated learning (FL) and split learning (SL) are two popular distributed machine learning approaches. Both follow a model-to-data scenario; clients train and test machine learning models without sharing raw data. SL provides better model…

Machine Learning · Computer Science 2022-02-18 Chandra Thapa , M. A. P. Chamikara , Seyit Camtepe , Lichao Sun

The increasing complexity of deep neural networks poses significant barriers to democratizing them to resource-limited edge devices. To address this challenge, split federated learning (SFL) has emerged as a promising solution by of…

Machine Learning · Computer Science 2025-06-05 Zheng Lin , Guanqiao Qu , Wei Wei , Xianhao Chen , Kin K. Leung

Federated learning (FL) and split learning (SL) are state-of-the-art distributed machine learning techniques to enable machine learning training without accessing raw data on clients or end devices. However, their \emph{comparative training…

Machine Learning · Computer Science 2021-03-05 Yansong Gao , Minki Kim , Chandra Thapa , Sharif Abuadbba , Zhi Zhang , Seyit A. Camtepe , Hyoungshick Kim , Surya Nepal

Deep learning (DL) models of code have recently reported great progress for vulnerability detection. In some cases, DL-based models have outperformed static analysis tools. Although many great models have been proposed, we do not yet have a…

Software Engineering · Computer Science 2023-02-14 Benjamin Steenhoek , Md Mahbubur Rahman , Richard Jiles , Wei Le

As a popular distributed learning paradigm, federated learning (FL) over mobile devices fosters numerous applications, while their practical deployment is hindered by participating devices' computing and communication heterogeneity. Some…

Machine Learning · Computer Science 2025-03-03 Huai-an Su , Jiaxiang Geng , Liang Li , Xiaoqi Qin , Yanzhao Hou , Hao Wang , Xin Fu , Miao Pan

Large Artificial Intelligence Models (LAMs) powered by massive datasets, extensive parameter scales, and extensive computational resources, leading to significant transformations across various industries. Yet, their practical deployment on…

Machine Learning · Computer Science 2026-04-22 Xianke Qiang , Hongda Liu , Xinran Zhang , Zheng Chang , Ying-Chang Liang

On-device machine learning (ML) promises to improve the privacy, responsiveness, and proliferation of new, intelligent user experiences by moving ML computation onto everyday personal devices. However, today's large ML models must be…

Human-Computer Interaction · Computer Science 2024-04-05 Fred Hohman , Mary Beth Kery , Donghao Ren , Dominik Moritz

Deep learning models are being deployed in many mobile intelligent applications. End-side services, such as intelligent personal assistants, autonomous cars, and smart home services often employ either simple local models on the mobile or…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-06 Amir Erfan Eshratifar , Mohammad Saeed Abrishami , Massoud Pedram

In this letter, we consider the concept of Mobile Crowd-Machine Learning (MCML) for a federated learning model. The MCML enables mobile devices in a mobile network to collaboratively train neural network models required by a server while…

Networking and Internet Architecture · Computer Science 2018-12-11 Tran The Anh , Nguyen Cong Luong , Dusit Niyato , Dong In Kim , Li-Chun Wang

The predominant paradigm for using machine learning models on a device is to train a model in the cloud and perform inference using the trained model on the device. However, with increasing number of smart devices and improved hardware,…

Machine Learning · Computer Science 2020-07-27 Sauptik Dhar , Junyao Guo , Jiayi Liu , Samarth Tripathi , Unmesh Kurup , Mohak Shah

The increased use of deep learning (DL) in academia, government and industry has, in turn, led to the popularity of on-premise and cloud-hosted deep learning platforms, whose goals are to enable organizations utilize expensive resources…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-25 Vaibhav Saxena , K. R. Jayaram , Saurav Basu , Yogish Sabharwal , Ashish Verma

The increased availability of data and computing resources has enabled researchers to successfully adopt machine learning (ML) techniques and make significant contributions in several engineering areas. ML and in particular deep learning…

Machine Learning · Computer Science 2025-02-10 Nunzio A. Letizia