English
Related papers

Related papers: Workflow Optimization for Parallel Split Learning

200 papers

Large language models (LLMs) have been a disruptive innovation in recent years, and they play a crucial role in our daily lives due to their ability to understand and generate human-like text. Their capabilities include natural language…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-17 Akrit Mudvari , Yuang Jiang , Leandros Tassiulas

Federated learning (FL) is an emerging distributed machine learning method that empowers in-situ model training on decentralized edge devices. However, multiple simultaneous training activities could overload resource-constrained devices.…

Machine Learning · Computer Science 2022-07-12 Weiming Zhuang , Yonggang Wen , Shuai Zhang

We consider a basic problem of preemptive scheduling of $n$ non-simultaneously released jobs on a group of $m$ unrelated parallel machines so as to minimize maximum job completion time, the makespan. In the scheduling literature, the…

Data Structures and Algorithms · Computer Science 2022-05-06 Nodari Vakhania

The scalability of large language models (LLMs) in handling high-complexity models and large-scale datasets has led to tremendous successes in pivotal domains. While there is an urgent need to acquire more training data for LLMs, a…

Machine Learning · Computer Science 2024-07-02 Zheng Lin , Xuanjie Hu , Yuxin Zhang , Zhe Chen , Zihan Fang , Xianhao Chen , Ang Li , Praneeth Vepakomma , Yue Gao

Hierarchical Rate Splitting (HRS) schemes proposed in recent years have shown to provide significant improvements in exploiting spatial diversity in wireless networks and provide high throughput for all users while minimising interference…

In distributed training, deep neural networks (DNNs) are launched over multiple workers concurrently and aggregate their local updates on each step in bulk-synchronous parallel (BSP) training. However, BSP does not linearly scale-out due to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-30 Sahil Tyagi , Martin Swany

Recently, the increasing deployment of LEO satellite systems has enabled various space analytics (e.g., crop and climate monitoring), which heavily relies on the advancements in deep learning (DL). However, the intermittent connectivity…

Machine Learning · Computer Science 2025-01-03 Zheng Lin , Yuxin Zhang , Zhe Chen , Zihan Fang , Cong Wu , Xianhao Chen , Yue Gao , Jun Luo

Fine-tuning pre-trained large language models (LLMs) in a distributed manner poses significant challenges on resource-constrained edge networks. To address this challenge, we propose SflLLM, a novel framework that integrates split federated…

Machine Learning · Computer Science 2025-07-03 Kai Zhao , Zhaohui Yang , Ye Hu , Mingzhe Chen , Chen Zhu , Zhaoyang Zhang

Many of the machine learning (ML) tasks are focused on centralized learning (CL), which requires the transmission of local datasets from the clients to a parameter server (PS) leading to a huge communication overhead. Federated learning…

Machine Learning · Computer Science 2021-02-17 Ahmet M. Elbir , Sinem Coleri , Kumar Vijay Mishra

Federated Learning (FL) is a method of training machine learning models on private data distributed over a large number of possibly heterogeneous clients such as mobile phones and IoT devices. In this work, we propose a new federated…

Machine Learning · Computer Science 2021-12-15 Enmao Diao , Jie Ding , Vahid Tarokh

Privacy-preserving machine learning has become a key conundrum for multi-party artificial intelligence. Federated learning (FL) and Split Learning (SL) are two frameworks that enable collaborative learning while keeping the data private (on…

Machine Learning · Computer Science 2022-12-15 Frédéric Berdoz , Abhishek Singh , Martin Jaggi , Ramesh Raskar

Federated learning (FL) enables edge devices to collaboratively train a machine learning model without sharing their raw data. Due to its privacy-protecting benefits, FL has been deployed in many real-world applications. However, deploying…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-16 Zhidong Gao , Zhenxiao Zhang , Yu Zhang , Tongnian Wang , Yanmin Gong , Yuanxiong Guo

The Jobs shop Scheduling Problem (JSP) is a canonical combinatorial optimization problem that is routinely solved for a variety of industrial purposes. It models the optimal scheduling of multiple sequences of tasks, each under a fixed…

Machine Learning · Computer Science 2021-10-14 James Kotary , Ferdinando Fioretto , Pascal Van Hentenryck

Split Learning (SL) is a new collaborative learning technique that allows participants, e.g. a client and a server, to train machine learning models without the client sharing raw data. In this setting, the client initially applies its part…

Cryptography and Security · Computer Science 2023-01-24 Tanveer Khan , Khoa Nguyen , Antonis Michalas

In this work, we introduce SplitNN-driven Vertical Partitioning, a configuration of a distributed deep learning method called SplitNN to facilitate learning from vertically distributed features. SplitNN does not share raw data or model…

Machine Learning · Computer Science 2020-08-11 Iker Ceballos , Vivek Sharma , Eduardo Mugica , Abhishek Singh , Alberto Roman , Praneeth Vepakomma , Ramesh Raskar

Privacy-Preserving machine learning (PPML) can help us train and deploy models that utilize private information. In particular, on-device machine learning allows us to avoid sharing raw data with a third-party server during inference.…

Machine Learning · Computer Science 2024-01-23 Xinchi Qiu , Ilias Leontiadis , Luca Melis , Alex Sablayrolles , Pierre Stock

Deep learning is a popular machine learning technique and has been applied to many real-world problems. However, training a deep neural network is very time-consuming, especially on big data. It has become difficult for a single machine to…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-04 Xing Zhao , Aijun An , Junfeng Liu , Bao Xin Chen

Split learning is a promising privacy-preserving distributed learning scheme that has low computation requirement at the edge device but has the disadvantage of high communication overhead between edge device and server. To reduce the…

Machine Learning · Computer Science 2022-03-10 Xing Chen , Jingtao Li , Chaitali Chakrabarti

There are situations where data relevant to machine learning problems are distributed across multiple locations that cannot share the data due to regulatory, competitiveness, or privacy reasons. Machine learning approaches that require data…

Machine Learning · Computer Science 2022-06-28 Dimitris Stripelis , Jose Luis Ambite

Modern computing workloads are often composed of parallelizable jobs. A parallelizable job can be completed more quickly when run on additional servers. However, each job can only use a limited number of servers, known as its…

Performance · Computer Science 2025-12-30 Benjamin Berg , Benjamin Moseley , Weina Wang , Mor Harchol-Balter