English
Related papers

Related papers: Tackling the Data-Parallel Load Balancing Bottlene…

200 papers

Transformer models have emerged as the leading approach for achieving state-of-the-art performance across various application domains, serving as the foundation for advanced large-scale deep learning (DL) models. However, efficiently…

Machine Learning · Computer Science 2024-09-06 Yujie Wang , Youhe Jiang , Xupeng Miao , Fangcheng Fu , Shenhan Zhu , Xiaonan Nie , Yaofeng Tu , Bin Cui

A common problem in science networks and private wide area networks (WANs) is that of achieving predictable data transfers of multiple concurrent flows by maintaining specific pacing rates for each. We address this problem by developing a…

Networking and Internet Architecture · Computer Science 2020-02-25 Taran Lynn , Dipak Ghosal , Nathan Hanford

Many of the current bio-inspired delivery networks set their focus on search, e.g., by using artificial ants. If the network size and, therefore, the search space gets too large, the users experience high delays until the requested content…

Multimedia · Computer Science 2011-11-02 Anita Sobe , Wilfried Elmenreich , Laszlo Böszörmenyi

Serving systems for Large Language Models (LLMs) are often optimized to improve quality of service (QoS) and throughput. However, due to the lack of open-source LLM serving workloads, these systems are frequently evaluated under unrealistic…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-27 Yuxin Wang , Yuhan Chen , Zeyu Li , Xueze Kang , Yuchu Fang , Yeju Zhou , Yang Zheng , Zhenheng Tang , Xin He , Rui Guo , Xin Wang , Qiang Wang , Amelie Chi Zhou , Xiaowen Chu

With the increasing popularity of Cloud computing and Mobile computing, individuals, enterprises and research centers have started outsourcing their IT and computational needs to on-demand cloud services. Recently geographical load…

Networking and Internet Architecture · Computer Science 2012-04-12 Muhammad Abdullah Adnan , Ryo Sugihara , Rajesh Gupta

Parsing is essential for a wide range of use cases, such as stream processing, bulk loading, and in-situ querying of raw data. Yet, the compute-intense step often constitutes a major bottleneck in the data ingestion pipeline, since parsing…

Databases · Computer Science 2020-04-16 Elias Stehle , Hans-Arno Jacobsen

Applications with low data reuse and frequent irregular memory accesses, such as graph or sparse linear algebra workloads, fail to scale well due to memory bottlenecks and poor core utilization. While prior work with prefetching,…

Hardware Architecture · Computer Science 2023-05-05 Marcelo Orenes-Vera , Esin Tureci , David Wentzlaff , Margaret Martonosi

As compute power increases with time, more involved and larger simulations become possible. However, it gets increasingly difficult to efficiently use the provided computational resources. Especially in particle-based simulations with a…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-05 Sebastian Eibl , Ulrich Rüde

A load balancer (LB) is a vital network function for cloud services to balance the load amongst resources. Stateful software LBs that run on commodity servers provides flexibility, cost-efficiency, and packet consistency. However current…

Networking and Internet Architecture · Computer Science 2019-08-07 Shouqian Shi , Chen Qian , Ye Yu , Xin Li , Ying Zhang , Xiaozhou Li

Parallel iterative applications often suffer from load imbalance, one of the most critical performance degradation factors. Hence, load balancing techniques are used to distribute the workload evenly to maximize performance. A key challenge…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-06 Anthony Boulmier , Nabil Abdennadher , Bastien Chopard

The centralized architecture in software-defined network (SDN) provides a global view of the underlying network, paving the way for enormous research in the area of SDN traffic engineering (SDN TE). This research focuses on the load…

Networking and Internet Architecture · Computer Science 2018-12-07 Sminesh C. N. , Grace Mary Kanaga E. , Ranjitha K

Most load balancing techniques implemented in current data centers tend to rely on a mapping from packets to server IP addresses through a hash value calculated from the flow five-tuple. The hash calculation allows extremely fast packet…

Networking and Internet Architecture · Computer Science 2017-07-11 Qingkai Liang , Sem Borst

Load balance is important for MapReduce to reduce job duration, increase parallel efficiency, etc. Previous work focuses on coarse-grained scheduling. This study concerns fine-grained scheduling on MapReduce operations. Each operation…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-04-15 Liya Fan , Bo Gao , Xi Sun , Fa Zhang , Zhiyong Liu

In this paper, we introduce DLB, a Deep Learning based load Balancing mechanism, to effectively address the data skew problem. The key idea of DLB is to replace hash functions in the load balancing mechanisms with deep learning models,…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-14 Xiaoke Zhu , Qi Zhang , Taining Cheng , Ling Liu , Wei Zhou , and Jing He

Deep reinforcement learning (RL) has made groundbreaking advancements in robotics, data center management and other applications. Unfortunately, system-level bottlenecks in RL workloads are poorly understood; we observe fundamental…

Machine Learning · Computer Science 2021-03-05 James Gleeson , Srivatsan Krishnan , Moshe Gabel , Vijay Janapa Reddi , Eyal de Lara , Gennady Pekhimenko

Modern LLM serving systems confront inefficient GPU utilization due to the fundamental mismatch between compute-intensive prefill and memory-bound decode phases. While current practices attempt to address this by organizing these phases…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-29 Zejia Lin , Hongxin Xu , Guanyi Chen , Zhiguang Chen , Yutong Lu , Xianwei Zhang

Opportunistic computation offloading is an effective method to improve the computation performance of mobile-edge computing (MEC) networks under dynamic edge environment. In this paper, we consider a multi-user MEC network with time-varying…

Networking and Internet Architecture · Computer Science 2021-07-08 Suzhi Bi , Liang Huang , Hui Wang , Ying-Jun Angela Zhang

LLMs often achieve similar average benchmark accuracies while exhibiting complementary strengths on different subsets of queries, suggesting that a router with query-specific model selection can outperform any single model. While existing…

Computation and Language · Computer Science 2026-04-02 Tanay Varshney , Annie Surla , Michelle Xu , Gomathy Venkata Krishnan , Maximilian Jeblick , David Austin , Neal Vaidya , Davide Onofrio

The rapid proliferation of Large Language Models (LLMs) has led to a fragmented and inefficient ecosystem, a state of ``model lock-in'' where seamlessly integrating novel models remains a significant bottleneck. Current routing frameworks…

Machine Learning · Computer Science 2026-01-13 Cheng Yan , Wuyang Zhang , Zhiyuan Ning , Fan Xu , Ziyang Tao , Lu Zhang , Bing Yin , Yanyong Zhang

In feed-forward time-sensitive networks with Deficit Round-Robin (DRR), worst-case delay bounds were obtained by combining Total Flow Analysis (TFA) with the strict service curve characterization of DRR by Tabatabaee et al. The latter is…

Networking and Internet Architecture · Computer Science 2023-07-24 Seyed Mohammadhossein Tabatabaee , Anne Bouillard , Jean-Yves Le Boudec
‹ Prev 1 3 4 5 6 7 10 Next ›