English
Related papers

Related papers: Load Balancing for AI Training Workloads

200 papers

Ad-load balancing is a critical challenge in online advertising systems, particularly in the context of social media platforms, where the goal is to maximize user engagement and revenue while maintaining a satisfactory user experience. This…

Information Retrieval · Computer Science 2023-12-20 Hitesh Sagtani , Madan Jhawar , Rishabh Mehrotra , Olivier Jeunen

Distributed systems store data objects redundantly to balance the data access load over multiple nodes. Load balancing performance depends mainly on 1) the level of storage redundancy and 2) the assignment of data objects to storage nodes.…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-19 Mehmet Aktas , Emina Soljanin

Event processing is the cornerstone of the dynamic and responsive Internet of Things (IoT). Recent approaches in this area are based on representational state transfer (REST) principles, which allow event processing tasks to be placed at…

Machine Learning · Computer Science 2021-12-08 A. Mazayev , F. Al-Tam , N. Correia

To circumvent persistent connectivity to the cloud infrastructure, the current emphasis on computing at network edge devices in the multi-robot domain is a promising enabler for delay-sensitive jobs, yet its adoption is rife with…

Robotics · Computer Science 2023-11-20 Nazish Tahir , Ramviyas Parasuraman

The centralized architecture in software-defined network (SDN) provides a global view of the underlying network, paving the way for enormous research in the area of SDN traffic engineering (SDN TE). This research focuses on the load…

Networking and Internet Architecture · Computer Science 2018-12-07 Sminesh C. N. , Grace Mary Kanaga E. , Ranjitha K

In the Industrial Internet of Things (IIoT), the frequent transmission of large amounts of data over wireless networks should meet the stringent timeliness requirements. Particularly, the freshness of packet status updates has a significant…

Systems and Control · Electrical Eng. & Systems 2025-10-21 Yuang Chen , Fengqian Guo , Chang Wu , Shuyi Liu , Hancheng Lu , Chang Wen Chen

Emerging artificial intelligence (AI) and machine learning (ML) workloads present new challenges of managing the collective communication used in distributed training across hundreds or even thousands of GPUs. This paper presents STrack, a…

Networking and Internet Architecture · Computer Science 2024-07-25 Yanfang Le , Rong Pan , Peter Newman , Jeremias Blendin , Abdul Kabbani , Vipin Jain , Raghava Sivaramu , Francis Matus

The innovative services empowered by the Internet of Things (IoT) require a seamless and reliable wireless infrastructure that enables communications within heterogeneous and dynamic low-power and lossy networks (LLNs). The Routing Protocol…

Networking and Internet Architecture · Computer Science 2021-05-21 Hossam Farag , Cedomir Stefanovic

In the load balancing problem, each node in a network is assigned a load, and the goal is to equally distribute the loads among the nodes, by preforming local load exchanges. While load balancing was extensively studied in static networks,…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-28 Seth Gilbert , Uri Meir , Ami Paz , Gregory Schwartzman

The development of large-scale foundation models, particularly Large Language Models (LLMs), is constrained by significant computational and memory bottlenecks. These challenges elevate throughput optimization from a mere engineering task…

Machine Learning · Computer Science 2026-03-31 Mayank Jha

Very High Throughput satellites typically provide multibeam coverage, however, a common problem is that there can be a mismatch between the capacity of each beam and the traffic demand: some beams may fall short, while others exceed the…

Dynamic dispatching is one of the core problems for operation optimization in traditional industries such as mining, as it is about how to smartly allocate the right resources to the right place at the right time. Conventionally, the…

Machine Learning · Computer Science 2020-08-26 Chi Zhang , Philip Odonkor , Shuai Zheng , Hamed Khorasgani , Susumu Serita , Chetan Gupta

Demand for AI accelerators is rapidly increasing rack power density, with projections approaching 1MW per deployment by 2027. This poses a major challenge for datacenter power delivery designers. As power densities increase, a datacenter…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-18 Grant Wilkins , Fiodar Kazhamiaka , Alok Gautam Kumbhare , Chaojie Zhang , Ricardo Bianchini

Load balancing in open radio access networks (O-RAN) is critical for ensuring efficient resource utilization, and the user's experience by evenly distributing network traffic load. Current research mainly focuses on designing load-balancing…

Systems and Control · Electrical Eng. & Systems 2025-04-08 Mengbang Zou , Yun Tang , Weisi Guo

The IEEE 802.11 backoff algorithm is very important for controlling system throughput over contentionbased wireless networks. For this reason, there are many studies on wireless network performance focus on developing backoff algorithms.…

Networking and Internet Architecture · Computer Science 2016-01-05 Hatm Alkadeki , Xingang Wang , Michael Odetayo

We introduce a new class of balanced allocation processes which are primarily characterized by ``filling'' underloaded bins. A prototypical example is the Packing process: At each round we only take one bin sample, if the load is below the…

Discrete Mathematics · Computer Science 2026-02-19 Dimitrios Los , Thomas Sauerwald , John Sylvester

A long-standing goal in AI is to develop agents capable of solving diverse tasks across a range of environments, including those never seen during training. Two dominant paradigms address this challenge: (i) reinforcement learning (RL),…

Machine Learning · Computer Science 2025-10-30 Vlad Sobal , Wancong Zhang , Kyunghyun Cho , Randall Balestriero , Tim G. J. Rudner , Yann LeCun

Cloud computing infrastructures increasingly rely on geographically distributed data centers to meet the growing demand for low latency, high availability, and cost-efficient service delivery. In this context, load balancing plays a…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-12 Saeid Aghasoleymani Najafabadi , Elaheh Nabavi Nia

Mobile robotic manipulation--the ability of robots to navigate spaces and interact with objects--is a core capability of physical AI. Foundation models have led to breakthroughs in their performance, but at a significant computational cost.…

In large-scale AI training, Sparse Mixture-of-Experts (s-MoE) layers enable scaling by activating only a small subset of experts per token. An operational challenge in this design is load balancing: routing tokens to minimize the number of…

Optimization and Control · Mathematics 2026-04-28 X. Y. Han , Yuan Zhong