English
Related papers

Related papers: Achieving High Throughput and Elasticity in a Larg…

200 papers

Despite existing work in machine learning inference serving, ease-of-use and cost efficiency remain challenges at large scales. Developers must manually search through thousands of model-variants -- versions of already-trained models that…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-07 Francisco Romero , Qian Li , Neeraja J. Yadwadkar , Christos Kozyrakis

Event-based vision sensors produce asynchronous event streams with high temporal resolution based on changes in the visual scene. The properties of these sensors allow for accurate and fast calculation of optical flow as events are…

Hardware Architecture · Computer Science 2024-03-14 Daniel C. Stumpp , Himanshu Akolkar , Alan D. George , Ryad B. Benosman

Large deep learning models have demonstrated strong ability to solve many tasks across a wide range of applications. Those large models typically require training and inference to be distributed. Tensor parallelism is a common technique…

Advances in networks, accelerators, and cloud services encourage programmers to reconsider where to compute -- such as when fast networks make it cost-effective to compute on remote accelerators despite added latency. Workflow and…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-31 J. Gregory Pauloski , Valerie Hayot-Sasson , Logan Ward , Nathaniel Hudson , Charlie Sabino , Matt Baughman , Kyle Chard , Ian Foster

Recent large language models (LLMs) are rapidly extending their context windows, yet inference throughput lags due to increasing GPU memory and bandwidth demands. This is because the key-value (KV) cache, an intermediate structure storing…

Most cloud services and distributed applications rely on hashing algorithms that allow dynamic scaling of a robust and efficient hash table. Examples include AWS, Google Cloud and BitTorrent. Consistent and rendezvous hashing are algorithms…

Data Structures and Algorithms · Computer Science 2022-05-17 Mike Heddes , Igor Nunes , Tony Givargis , Alexandru Nicolau , Alex Veidenbaum

Flow Matching models achieve state-of-the-art image generation quality but incur substantial inference cost due to iterative denoising through large Transformer networks. We observe that different layer groups within a Transformer exhibit…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Guandong Li

Multi-variant execution (MVX) systems amplify the effectiveness of software diversity techniques. The key idea is to run multiple diversified program variants in lockstep while providing them with the same input and monitoring their…

Cryptography and Security · Computer Science 2020-11-05 Alexios Voulimeneas , Dokyung Song , Per Larsen , Michael Franz , Stijn Volckaert

With a goal of supporting the timely and cost-effective analysis of Terabyte datasets on commodity components, we present and evaluate StoreTorrent, a simple distributed filesystem with integrated fault tolerance for efficient handling of…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-01-22 Federico D. Sacerdoti

Building and deploying software on high-end computing systems is a challenging task. High performance applications have to reliably run across multiple platforms and environments, and make use of site-specific resources while resolving…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-04-12 Lucas Benedicic , Felipe A. Cruz , Alberto Madonna , Kean Mariotti

With advancements in multicore embedded systems, leakage power, exponentially tied to chip temperature, has surpassed dynamic power consumption. Energy-aware solutions use dynamic voltage and frequency scaling (DVFS) to mitigate overheating…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-13 Mohammad Pivezhandi , Abusayeed Saifullah , Ali Jannesari

Integer sorts in OLAP engines often run on columns whose cardinality $K$ is much smaller than the array length $N$. After a group-by stage the intermediate key column has $K$ bounded by the number of distinct group keys, and even a…

Data Structures and Algorithms · Computer Science 2026-05-26 Vasiliy S. Shlyk

Current graph systems can easily process billions of data, however when increased to exceed hundred billions, the performance decreases dramatically, time series data always be very huge, consequently computation on time series graphs still…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-25 Derong Tang

Authenticated data storage on an untrusted platform is an important computing paradigm for cloud applications ranging from big-data outsourcing, to cryptocurrency and certificate transparency log. These modern applications increasingly…

Cryptography and Security · Computer Science 2019-11-11 Yuzhe Tang , Ju Chen , Kai Li , Jianliang Xu , Qi Zhang

We present~\emph{KV-Tandem}, a modular architecture for building LSM-based storage engines on top of simple, non-ordered persistent key-value stores (KVSs). KV-Tandem enables advanced functionalities such as range queries and snapshot…

The computational and memory demands of large language models for generative inference present significant challenges for practical deployment. One promising solution targeting offline inference is offloading-based batched inference, which…

Hardware Architecture · Computer Science 2026-02-09 Hongsun Jang , Jaeyong Song , Changmin Shin , Si Ung Noh , Jaewon Jung , Jisung Park , Jinho Lee

Cloud applications often insert a caching lay\-er in front of a database in order to reduce I/O latency and improve throughput. One complication occurs when a client fetches some data from one cache node, then migrates to another (e.g., due…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-20 Haoran Zhang , Zihao Zhang , Shuai Mu , Sebastian Angel , Vincent Liu

Neuromorphic event cameras possess superior temporal resolution, power efficiency, and dynamic range compared to traditional cameras. However, their asynchronous and sparse data format poses a significant challenge for conventional deep…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Wei Fang , Priyadarshini Panda

Modern distributed systems demand low-latency, fault-tolerant event processing that exceeds traditional messaging architecture limits. While frameworks including Apache Kafka, RabbitMQ, Apache Pulsar, NATS JetStream, and serverless event…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-24 Jahidul Arafat , Fariha Tasmin , Sanjaya Poudel

Large Reasoning Models (LRMs) are becoming integral to many AI inference systems, enhancing their capabilities with advanced reasoning. However, deploying these models in production environments presents a significant QoS challenge: the…

Machine Learning · Computer Science 2026-05-15 Kaiwen Chen , Xin Tan , Minchen Yu , Jingzong Li , Hong Xu