English
Related papers

Related papers: Size-aware Sharding For Improving Tail Latencies i…

200 papers

Layout-Aware Data Scheduler (LADS) data transfer tool, identifies and addresses the issues that lead to congestion on the path of an end-to-end data transfer in the terabit network environments. It exploits the underlying storage layout at…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-04-05 Preethika Kasu , Taeuk Kim , Youngjae Kim , Jung-Ho Um , Kyongseok Park , Scott Atchley

Modern latency-critical online services often rely on composing results from a large number of server components. Hence the tail latency (e.g. the 99th percentile of response time), rather than the average, of these components determines…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-11-11 Rui Han , Junwei Wang , Siguang Huang , Chenrong Shao , Shulin Zhan , Jianfeng Zhan , Jose Luis Vazquez-Poletti

Sharding is a promising technique for addressing the scalability issues of blockchain, and this technique is especially important for IoT, edge, or mobile computing. It divides the $n$ participating nodes into $s$ disjoint groups called…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-20 Ramesh Adhikari , Costas Busch , Miroslav Popovic

Common implementations of core memory allocation components, like the Linux buddy system, handle concurrent allocation/release requests by synchronizing threads via spin-locks. This approach is clearly not prone to scale with large thread…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-22 Romolo Marotta , Mauro Ianni , Alessandro Pellegrini , Andrea Scarselli , Francesco Quaglia

Modern key-value stores, object stores, Internet proxy caches, as well as Content Delivery Networks (CDN) often manage objects of diverse sizes, e.g., blobs, video files of different lengths, images with varying resolution, and small…

Operating Systems · Computer Science 2021-05-25 Gil Einziger , Ohad Eytan , Roy Friedman , Benjamin Manes

Scalable web search systems typically employ multi-stage retrieval architectures, where an initial stage generates a set of candidate documents that are then pruned and re-ranked. Since subsequent stages typically exploit a multitude of…

Information Retrieval · Computer Science 2017-12-12 Joel Mackenzie , J. Shane Culpepper , Roi Blanco , Matt Crane , Charles L. A. Clarke , Jimmy Lin

Memristive in-memory sorting has been proposed recently to improve hardware sorting efficiency. Using iterative in-memory min computations, data movements between memory and external processing units can be eliminated for improved latency…

Hardware Architecture · Computer Science 2022-02-22 Lianfeng Yu , Zhaokun Jing , Yuchao Yang , Yaoyu Tao

Existing blockchain systems scale poorly because of their distributed consensus protocols. Current attempts at improving blockchain scalability are limited to cryptocurrency. Scaling blockchain systems under general workloads (i.e.,…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-03-13 Hung Dang , Tien Tuan Anh Dinh , Dumitrel Loghin , Ee-Chien Chang , Qian Lin , Beng Chin Ooi

The memory capacity in edge devices is often limited due to constraints on cost, size, and power. Consequently, memory competition leads to inevitable page swapping in memory-constrained mixed-criticality edge devices, causing slow storage…

Operating Systems · Computer Science 2025-11-26 Meng-Chia Lee , Wen Sheng Lim , Yuan-Hao Chang , Tei-Wei Kuo

Sharding is proposed to enhance blockchain scalability. However, a size-security dilemma where every shard must be large enough to ensure its security constrains the efficacy of individual shards and the degree of sharding itself. Most…

Cryptography and Security · Computer Science 2025-03-26 Jianting Zhang , Zhongtang Luo , Raghavendra Ramesh , Aniket Kate

Self-attention is an essential component of large language models (LLM) but a significant source of inference latency for long sequences. In multi-tenant LLM serving scenarios, the compute and memory operation cost of self-attention can be…

Machine Learning · Computer Science 2024-08-02 Lu Ye , Ze Tao , Yong Huang , Yang Li

In the realm of edge computing, the increasing demand for high Quality of Service (QoS), particularly in dynamic multimedia streaming applications (e.g., Augmented Reality/Virtual Reality and online gaming), has prompted the need for…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-29 Cheng Zhang , Yinuo Deng , Hailiang Zhao , Tianlv Chen , Shuiguang Deng

This paper focuses on data structures for multi-core reachability, which is a key component in model checking algorithms and other verification methods. A cornerstone of an efficient solution is the storage of visited states. In related…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-05-06 Alfons Laarman , Jaco van de Pol , Michael Weber

Metadata hotspots remain one of the key obstacles to scalable Input/Output (I/O) in both High-Performance Computing (HPC) and cloud-scale storage environments. Situations such as job start-ups, checkpoint storms, or heavily skewed namespace…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-25 Sangam Ghimire , Nigam Niraula , Nirjal Bhurtel , Paribartan Timalsina , Bishal Neupane , James Bhattarai , Sudan Jha

Leveraging long contexts is crucial for advanced AI systems, but attention computation poses a scalability challenge. While scaled dot-product attention (SDPA) exhibits token sparsity, i.e. only a few pivotal tokens significantly contribute…

Machine Learning · Computer Science 2025-06-05 Aditya Desai , Shuo Yang , Alejandro Cuadron , Matei Zaharia , Joseph E. Gonzalez , Ion Stoica

Inference serving is of great importance in deploying machine learning models in real-world applications, ensuring efficient processing and quick responses to inference requests. However, managing resources in these systems poses…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-23 Kamran Razavi , Mehran Salmani , Max Mühlhäuser , Boris Koldehofe , Lin Wang

Microservice-based applications are characterized by stochastic latencies arising from long-tail execution patterns and heterogeneous resource constraints across computational nodes. To address this challenge, we first formulate the problem…

Software Engineering · Computer Science 2026-03-25 Huixiang Zhang , Mahzabeen Emu

Sharding has emerged as a critical solution to address the scalability challenges faced by blockchain networks, enabling them to achieve higher transaction throughput, reduced latency, and optimized resource usage. This paper investigates…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-25 Ziwei Wang , Cong Wu , Paolo Tasca

To usher in the next round of client AI innovation, there is an urgent need to enable efficient, lossless inference of high-accuracy large language models (LLMs) and vision language models (VLMs), jointly referred to as xLMs, on client…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-30 Aditya Ukarande , Deep Shekhar , Marc Blackstein , Ram Rangan

Node and link churn in multi-party, cross-region clusters over wide-area networks (WANs) often disrupts distributed training. However, checkpoint-based recovery and cloud-centric autoscaling react slowly and assume centralized control,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-16 Wenjiao Feng , Rongxing Xiao , Zonghang Li , Hongfang Yu , Gang Sun , Long Luo , Mohsen Guizani , Qirong Ho , Steve Liu