English
Related papers

Related papers: Accelerating Geo-distributed Machine Learning with…

200 papers

Distributed computing systems often consist of hundreds of nodes, executing tasks with different resource requirements. Efficient resource provisioning and task scheduling in such systems are non-trivial and require close monitoring and…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-10 Paul J. Pritz , Daniel Perez , Kin K. Leung

Federated learning has emerged in the last decade as a distributed optimization paradigm due to the rapidly increasing number of portable devices able to support the heavy computational needs related to the training of machine learning…

Machine Learning · Computer Science 2024-10-10 Emanuel Buttaci , Giuseppe Carlo Calafiore

In the mobile-edge-cloud continuum, a plethora of heterogeneous data sources and computation-capable nodes are available. Such nodes can cooperate to perform a distributed learning task, aided by a learning controller (often located at the…

Networking and Internet Architecture · Computer Science 2022-11-15 Francesco Malandrino , Carla Fabiana Chiasserini , Giuseppe Di Giacomo

Effective internet traffic prediction in smaller ISP networks is challenged by limited data availability. This paper explores this issue using transfer learning and data augmentation techniques with two LSTM-based models, LSTMSeq2Seq and…

Machine Learning · Computer Science 2025-09-22 Sajal Saha , Anwar Haque , Greg Sidebottom

Graph Neural Networks (GNNs) have become popular across a diverse set of tasks in exploring structural relationships between entities. However, due to the highly connected structure of the datasets, distributed training of GNNs on…

Machine Learning · Computer Science 2025-09-08 Arefin Niam , Tevfik Kosar , M S Q Zulkar Nine

Input distribution shift presents a significant problem in many real-world systems. Here we present Xenovert, an adaptive algorithm that can dynamically adapt to changes in input distribution. It is a perfect binary tree that adaptively…

Machine Learning · Computer Science 2024-04-09 Tham Yik Foong , Heng Zhang , Mao Po Yuan , Danilo Vasconcellos Vargas

As human-robot collaboration increases in the workforce, it becomes essential for human-robot teams to coordinate efficiently and intuitively. Traditional approaches for human-robot scheduling either utilize exact methods that are…

Artificial Intelligence · Computer Science 2023-02-01 Batuhan Altundas , Zheyuan Wang , Joshua Bishop , Matthew Gombolay

As modern DNN models grow ever larger, collective communications between the accelerators (allreduce, etc.) emerge as a significant performance bottleneck. Designing efficient communication schedules is challenging, given today's…

Networking and Internet Architecture · Computer Science 2025-09-22 Liangyu Zhao , Saeed Maleki , Yuanhong Wang , Zezhou Wang , Ziyue Yang , Hossein Pourreza , Arvind Krishnamurthy

Adaptive networks consist of a collection of nodes with adaptation and learning abilities. The nodes interact with each other on a local level and diffuse information across the network to solve estimation and inference tasks in a…

Information Theory · Computer Science 2015-06-05 Sheng-Yuan Tu , Ali H. Sayed

Accurate traffic prediction is essential for optimizing transportation systems, enhancing resource allocation, and improving overall urban administration. Spatio-temporal graph neural networks (GNNs) have achieved state-of-the-art…

Machine Learning · Computer Science 2026-05-12 Qianru Zhang , Xinyi Gao , Alexander Zhou , Reynold Cheng , Siu-Ming Yiu , Hongzhi Yin

This paper presents a decentralized algorithm for non-convex optimization over tree-structured networks. We assume that each node of this network can solve small-scale optimization problems and communicate approximate value functions with…

Optimization and Control · Mathematics 2020-11-02 Yuning Jiang , Dimitris Kouzoupis , Haoyu Yin , Moritz Diehl , Boris Houska

In decentralized machine learning, workers compute model updates on their local data. Because the workers only communicate with few neighbors without central coordination, these updates propagate progressively over the network. This…

Machine Learning · Computer Science 2022-02-01 Thijs Vogels , Lie He , Anastasia Koloskova , Tao Lin , Sai Praneeth Karimireddy , Sebastian U. Stich , Martin Jaggi

In this empirical paper, we investigate how learning agents can be arranged in more efficient communication topologies for improved learning. This is an important problem because a common technique to improve speed and robustness of…

Machine Learning · Computer Science 2019-03-05 Dhaval Adjodah , Dan Calacci , Abhimanyu Dubey , Peter Krafft , Esteban Moro , Alex `Sandy' Pentland

Spatial-temporal network traffic forecasting is a challenging task due to the complex spatial relationships and dynamic temporal patterns present in each node. Traditional regression methods are not directly applicable to such graph data.…

Information Retrieval · Computer Science 2026-05-12 Jinming Xing , Guoheng Sun , Hui Sun , Linchao Pan , Shakir Mahmood , Xuanhao Luo , Muhammad Shahzad

Network topology optimization (NTO) via busbar splitting can mitigate transmission grid congestion and reduce redispatch costs. However, solving this mixed-integer nonlinear problem for large-scale systems in near-real-time is currently…

Artificial Intelligence · Computer Science 2026-03-16 Ali Rajaei , Peter Palensky , Jochen L. Cremer

To achieve global coverage and ubiquitous connectivity, the non-terrestrial network (NTN) has been regarded as a key enabler in the sixth generation (6G) network, which includes uncrewed aerial vehicles (UAVs), high-altitude platforms…

Systems and Control · Electrical Eng. & Systems 2026-01-23 Jikang Deng , Hui Zhou , Mohamed-Slim Alouini

Large-scale commercial platforms usually involve numerous business domains for diverse business strategies and expect their recommendation systems to provide click-through rate (CTR) predictions for multiple domains simultaneously. Existing…

Information Retrieval · Computer Science 2022-11-23 Jinyun Li , Huiwen Zheng , Yuanlin Liu , Minfang Lu , Lixia Wu , Haoyuan Hu

Modern machine learning frameworks can train neural networks using multiple nodes in parallel, each computing parameter updates with stochastic gradient descent (SGD) and sharing them asynchronously through a central parameter server. Due…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-02 Zhuojin Li , Wumo Yan , Marco Paolieri , Leana Golubchik

The traditional approach to distributed machine learning is to adapt learning algorithms to the network, e.g., reducing updates to curb overhead. Networks based on intelligent edge, instead, make it possible to follow the opposite approach,…

Networking and Internet Architecture · Computer Science 2022-07-07 Francesco Malandrino , Carla Fabiana Chiasserini , Nuria Molner , Antonio De La Oliva

We consider the problem of decentralized deep learning where multiple agents collaborate to learn from a distributed dataset. While there exist several decentralized deep learning approaches, the majority consider a central parameter-server…

Machine Learning · Computer Science 2020-12-01 Aditya Balu , Zhanhong Jiang , Sin Yong Tan , Chinmay Hedge , Young M Lee , Soumik Sarkar