English
Related papers

Related papers: HTBQueue: A Hierarchical Token Bucket Implementati…

200 papers

The cost of simulator evaluations is a key practical bottleneck for Simulation Based Inference (SBI). In hierarchical settings with shared global parameters and exchangeable site-level parameters and observations, this structure can be…

Machine Learning · Computer Science 2026-04-23 Giovanni Charles , Cosmo Santoni , Seth Flaxman , Elizaveta Semenova

Stream processing is usually done either on a tuple-by-tuple basis or in micro-batches. There are many applications where tuples over a predefined duration/window must be processed within certain deadlines. Processing such queries using…

Databases · Computer Science 2024-09-23 Saranya Chandrasekaran , S. Sudarshan

Production vLLM fleets typically provision each instance for the worst-case context length, leading to substantial KV-cache over-allocation and under-utilized concurrency. In practice, 80-95% of requests are short, yet are served under…

Computation and Language · Computer Science 2026-04-10 Xunzhuo Liu , Bowei He , Xue Liu , Andy Luo , Haichen Zhang , Huamin Chen

Today's cloud networks are shared among many tenants. Bandwidth guarantees and work conservation are two key properties to ensure predictable performance for tenant applications and high network utilization for providers. Despite…

Networking and Internet Architecture · Computer Science 2018-01-09 Zhuotao Liu , Kai Chen , Haitao Wu , Shuihai Hu , Yih-Chun Hu , Yi Wang , Gong Zhang

The interconnection network is a key element in High-Performance Computing (HPC) and Datacenter (DC) systems whose performance depends on several design parameters, such as the topology, the switch architecture, and the routing algorithm.…

Networking and Internet Architecture · Computer Science 2025-02-04 Jose Rocher-Gonzalez , Jesus Escudero-Sahuquillo , Pedro J. Garcia , Francisco J. Quiles , Gaspar Mora

The field of parallel network simulation frameworks is evolving at a great pace. That is also because of the growth of Intelligent Transportation Systems (ITS) and the necessity for cost-effective large-scale trials. In this contribution,…

Networking and Internet Architecture · Computer Science 2022-09-05 Ioannis Mavromatis , Andrea Tassi , Robert J. Piechocki , Andrew Nix

Disaggregated inference has become an essential framework that separates the prefill (P) and decode (D) stages in large language model inference to improve throughput. However, the KV cache transfer faces significant delays between prefill…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-08 Weiqing Li , Guochao Jiang , Xiangyong Ding , Zhangcheng Tao , Chuzhan Hao , Chenfeng Xu , Yuewei Zhang , Hao Wang

The evolution of 5G and Beyond networks has enabled new applications with stringent end-to-end latency requirements, but providing reliable low-latency service with high throughput over public wireless networks is still a significant…

Networking and Internet Architecture · Computer Science 2022-10-19 Andrea Bedin , Federico Chiariotti , Stepan Kucera , Andrea Zanella

The great efficiency achieved by the BitTorrent protocol for the distribution of large amounts of data inspired its adoption to provide multimedia content on-demand delivery over the Internet. As it is not designed for this purpose, some…

Networking and Internet Architecture · Computer Science 2015-12-14 Ananda Gorck Streit , Carlo Kleber da Silva Rodrigues

Using tiny, equal-sized tasks (Homogeneous microTasking, HomT) has long been regarded an effective way of load balancing in parallel computing systems. When combined with nodes pulling in work upon becoming idle, HomT has the desirable…

Performance · Computer Science 2018-10-03 Yuquan Shan , George Kesidis , Bhuvan Urgaonkar , Jorg Schad , Jalal Khamse-Ashari , Ioannis Lambadaris

Quantum computing holds the promise of solving problems intractable for classical computers, but practical large-scale quantum computation requires error correction to protect against errors. Fault-tolerant quantum computing (FTQC) enables…

Quantum Physics · Physics 2025-09-04 Meng Wang , Chenxu Liu , Sean Garner , Samuel Stein , Yufei Ding , Prashant J. Nair , Ang Li

This paper envisions a quantum database (Qute) that treats quantum computation as a first-class execution option. Unlike prior simulation-based methods that either run quantum algorithms on classical machines or adapt existing databases for…

Databases · Computer Science 2026-02-17 Muzhi Chen , Xuanhe Zhou , Wei Zhou , Bangrui Xu , Surui Tang , Guoliang Li , Bingsheng He , Yeye He , Yitong Song , Fan Wu

A well-known technique for enhancing the performance and stability of content distribution is the use of multiple dissemination flows. Multipath TCP (MPTCP), the most popular multiflow protocol on the Internet, allows receivers to exploit…

Networking and Internet Architecture · Computer Science 2017-07-07 Yannis Thomas , George Xylomenos , Christos Tsilopoulos , George C. Polyzos

Distributed data processing systems have advanced through models that expose more and more opportunities for concurrency within a computation. The scheduling of these increasingly sophisticated models has become the bottleneck for improved…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-13 Andrea Lattuada , Frank McSherry

We present a distributed algorithm for joint power control, routing and scheduling in multihop wireless networks. The algorithm also provides for Quality of Service (QoS) guarantees, namely, end-to-end mean delay guarantees and hard…

Networking and Internet Architecture · Computer Science 2016-12-28 Ashok Krishnan K. S. , Vinod Sharma

In grid networks, distributed resources are interconnected by wide area network to support compute and data-intensive applications, which require reliable and efficient transfer of gigabits (even terabits) of data. Different from…

Networking and Internet Architecture · Computer Science 2016-08-16 Bin Bin Chen , Pascale Primet

Modern Large Language Model serving system batches multiple requests to achieve high throughput, while batching attention operations is challenging, rendering memory bandwidth a critical bottleneck. The community relies on high-end GPUs…

Hardware Architecture · Computer Science 2025-05-15 Minsu Kim , Seongmin Hong , RyeoWook Ko , Soongyu Choi , Hunjong Lee , Junsoo Kim , Joo-Young Kim , Jongse Park

Intermittent demand forecasting poses unique challenges due to sparse observations, cold-start items, and obsolescence. Classical models such as Croston, SBA, and the Teunter--Syntetos--Babai (TSB) method provide simple heuristics but lack…

Machine Learning · Statistics 2026-04-02 Zong-Han Bai , Po-Yen Chu

Distinct HEP workflows have distinct I/O needs; while ROOT I/O excels at serializing complex C++ objects common to reconstruction, analysis workflows typically have simpler objects and can sustain higher event rates. To meet these…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-26 Brian Bockelman , Zhe Zhang , Oksana Shadura

In the last few years, the Message Queueing Telemetry Transport (MQTT) publish/subscribe protocol emerged as the de facto standard communication protocol for IoT, M2M and wireless sensor networks applications. Such popularity is mainly due…

Networking and Internet Architecture · Computer Science 2018-10-02 Riccardo Giambona , Alessandro E. C. Redondi , Matteo Cesana