English
Related papers

Related papers: SPLIT: SymPathy for Large jobs Improves Tail laten…

200 papers

We investigate the tail asymptotics of the response time distribution for the cancel-on-start (c.o.s.) and cancel-on-completion (c.o.c.) variants of redundancy-$d$ scheduling and the fork-join model with heavy-tailed job sizes. We present…

Probability · Mathematics 2021-05-31 Youri Raaijmakers , Sem Borst , Onno Boxma

We consider a computation offloading system where jobs are processed sequentially at a local server followed by a higher-capacity cloud server. The system offers two service modes, differing in how the processing is split between the…

Systems and Control · Electrical Eng. & Systems 2025-12-17 Darin Jeff , Eytan Modiano

Efficient data access in High-Performance Computing (HPC) systems is essential to the performance of intensive computing tasks. Traditional optimizations of the I/O stack aim to improve peak performance but are often workload specific and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-21 Thomas Collignon , Kouds Halitim , Raphaël Bleuse , Sophie Cerf , Bogdan Robu , Éric Rutten , Lionel Seinturier , Alexandre van Kempen

We say that a random variable is $light$-$tailed$ if moments of order $2+\epsilon$ are finite for some $\epsilon>0$; otherwise, we say that it is $heavy$-$tailed$. We study queueing networks that operate under the Max-Weight scheduling…

Systems and Control · Electrical Eng. & Systems 2023-02-28 Arsalan Sharifnassab , John N. Tsitsiklis

We consider the single server queue with service in random order. For a large class of heavy-tailed service time distributions, we determine the asymptotic behavior of the waiting time distribution. For the special case of Poisson arrivals…

Probability · Mathematics 2017-11-29 Onno Boxma , Sergey Foss , Jean-Marc Lasgouttes , Rudesindo Núñez Queija

Can the popular shortest remaining processing time (SRPT) algorithm achieve a constant competitive ratio on multiple servers when server speeds are adjustable (speed scaling) with respect to the flow time plus energy consumption metric?…

Performance · Computer Science 2020-05-06 Rahul Vaze , Jayakrishnan Nair

In cloud computing systems, assigning a task to multiple servers and waiting for the earliest copy to finish is an effective method to combat the variability in response time of individual servers, and reduce latency. But adding redundancy…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-04-13 Gauri Joshi , Emina Soljanin , Gregory Wornell

We investigate the application of the Adaptive Multilevel Splitting algorithm for the estimation of tail probabilities of solutions of Stochastic Differential Equations evaluated at a given time, and of associated temporal averages. We…

Probability · Mathematics 2019-03-27 Charles-Edouard Bréhier , Tony Lelièvre

State-machine replication, a fundamental approach to fault tolerance, requires replicas to execute commands deterministically, which usually results in sequential execution of commands. Sequential execution limits performance and underuses…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-04-29 Parisa Jalili Marandi , Fernando Pedone

Serving systems for Large Language Models (LLMs) improve throughput by processing several requests concurrently. However, multiplexing hardware resources between concurrent requests involves non-trivial scheduling decisions. Practical…

Machine Learning · Computer Science 2025-01-29 Ferdi Kossmann , Bruce Fontaine , Daya Khudia , Michael Cafarella , Samuel Madden

Real-world visual data often exhibits a long-tailed distribution, where some ''head'' classes have a large number of samples, yet only a few samples are available for ''tail'' classes. Such imbalanced distribution causes a great challenge…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 Junjie Zhang , Lingqiao Liu , Peng Wang , Chunhua Shen

We consider maximizing the long-term average reward in a single server queue, where the reward obtained for a job is a non-increasing function of its sojourn time. The motivation behind this work comes from multiple applications, including…

Performance · Computer Science 2022-11-02 Sushmitha Shree S , Avijit Mandal , Avhishek Chatterjee , Krishna Jagannathan

We examine a distributional fixed-point equation related to a multi-type branching process that is key in the cluster sizes analysis of multivariate heavy-tailed Hawkes processes. Specifically, we explore the tail behavior of its solution…

Probability · Mathematics 2025-04-07 Jose Blanchet , Roger J. A. Laeven , Xingyu Wang , Bert Zwart

We develop accurate approximations of the delay distribution of the MArP/G/1 queue that cap- ture the exact tail behavior and provide bounded relative errors. Motivated by statistical analysis, we consider the service times as a mixture of…

Probability · Mathematics 2014-05-21 Eleni Vatamidou , Ivo J. B. F. Adan , Maria Vlasiou , Bert Zwart

Self-improvement methods enable large language models (LLMs) to generate solutions themselves and iteratively train on filtered, high-quality rationales. This process proves effective and reduces the reliance on human supervision in LLMs'…

Computation and Language · Computer Science 2025-02-24 Yiwen Ding , Zhiheng Xi , Wei He , Zhuoyuan Li , Yitao Zhai , Xiaowei Shi , Xunliang Cai , Tao Gui , Qi Zhang , Xuanjing Huang

Today's search engines process billions of online user queries a day over huge collections of data. In order to scale, they distribute query processing among many nodes, where each node holds and searches over a subset of the index called…

Information Retrieval · Computer Science 2017-07-25 Naama Kraus , David Carmel , Idit Keidar

Modern datacenter applications are prone to high tail latencies since their requests typically follow highly-dispersive distributions. Delivering fast interrupts is essential to reducing tail latency. Prior work has proposed both OS- and…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-14 Lisa , Li , Nikita Lazarev , David Koufaty , Yijun Yin , Andy Anderson , Zhiru Zhang , Edward Suh , Kostis Kaffes , Christina Delimitrou

Large language model (LLM) serving is becoming an increasingly critical workload for cloud providers. Existing LLM serving systems focus on interactive requests, such as chatbots and coding assistants, with tight latency SLO requirements.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-26 Archit Patke , Dhemath Reddy , Saurabh Jha , Haoran Qiu , Christian Pinto , Chandra Narayanaswami , Zbigniew Kalbarczyk , Ravishankar Iyer

We study the problem of scheduling jobs on fault-prone machines communicating via a shared channel, also known as multiple-access channel. We have $n$ arbitrary length jobs to be scheduled on $m$ identical machines, $f$ of which are prone…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-26 Marek Klonowski , Dariusz R. Kowalski , Jarosław Mirek , Prudence W. H. Wong

We address the problem of giving robust performance bounds based on the study of the asymptotic behavior of the insensitive load balancing schemes when the number of servers and the load scales jointly. These schemes have the desirable…

Performance · Computer Science 2016-05-11 Matthieu Jonckheere , Balakrishna Prabhu