English
Related papers

Related papers: Taiji: A DPU Memory Elasticity Solution for In-pro…

200 papers

There is a growing need for low latency for many devices and users. The traditional cloud computing paradigm can not meet this requirement, legitimizing the need for a new paradigm. Edge computing proposes to move computing capacities to…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-12 Samuel Rac , Mats Brorsson

Memory latency, bandwidth, capacity, and energy increasingly limit performance. In this paper, we reconsider proposed system architectures that consist of huge (many-terabyte to petabyte scale) memories shared among large numbers of CPUs.…

Hardware Architecture · Computer Science 2025-09-24 Samuel Dayo , Shuhan Liu , Peijing Li , Philip Levis , Subhasish Mitra , Thierry Tambe , David Tennenhouse , H. -S. Philip Wong

The ongoing shift of cloud services from monolithic designs to microservices creates high demand for efficient and high performance datacenter networking stacks, optimized for fine-grained workloads. Commodity networking systems based on…

Hardware Architecture · Computer Science 2021-06-04 Nikita Lazarev , Shaojie Xiang , Neil Adit , Zhiru Zhang , Christina Delimitrou

Distributed Stream Processing (DSP) engines analyze continuous data via queries expressed as a graph of operators. Auto-scalers adjust the number of parallel instances of these operators to support a target rate. Current auto-scalers couple…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-27 Donatien Schmitz , Guillaume Rosinosky , Etienne Rivière

As artificial intelligence (AI) and machine learning (ML) technologies disrupt a wide range of industries, cloud datacenters face ever-increasing demand in inference workloads. However, conventional CPU-based servers cannot handle excessive…

Hardware Architecture · Computer Science 2022-06-08 Jung-Hoon Kim , Sungyeob Yoo , Seungjae Moon , Joo-Young Kim

Cloud applications are increasingly relying on hundreds of loosely-coupled microservices to complete user requests that meet an applications end-to-end QoS requirements. Communication time between services accounts for a large fraction of…

Hardware Architecture · Computer Science 2020-09-14 Nikita Lazarev , Neil Adit , Shaojie Xiang , Zhiru Zhang , Christina Delimitrou

For distributed applications to take full advantage of cloud computing systems, we need middleware systems that allow developers to build elasticity management components right into the applications. This paper describes the design and…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-10 K. R. Jayaram

Elasticity is highly desirable for stream processing systems to guarantee low latency against workload dynamics, such as surges in data arrival rate and fluctuations in data distribution. Existing systems achieve elasticity following a…

Databases · Computer Science 2017-11-06 Li Wang , Tom Z. J. Fu , Richard T. B. Ma , Marianne Winslett , Zhenjie Zhang

A heterogeneous memory has a single address space with fast access to some addresses (a fast tier of DRAM) and slow access to other addresses (a capacity tier of CXL-attached memory or NVM). A tiered memory system aims to maximize the…

Emerging Technologies · Computer Science 2025-10-28 Rohan Kadekodi , Haoran Peng , Gilbert Bernstein , Michael D. Ernst , Baris Kasikci

Cloud resource management is often modeled by two-dimensional bin packing with a set of items that correspond to tasks having fixed CPU and memory requirements. However, applications running in clouds are much more flexible: modern…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-01 Bartłomiej Przybylski , Paweł Żuk , Krzysztof Rzadca

The escalating adoption of diffusion models for applications such as image generation demands efficient parallel inference techniques to manage their substantial computational cost. However, existing diffusion parallelism inference schemes…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-16 Han Liang , Jiahui Zhou , Zicheng Zhou , Xiaoxi Zhang , Xu Chen

The significant resource demands in LLM serving prompts production clusters to fully utilize heterogeneous hardware by partitioning LLM models across a mix of high-end and low-end GPUs. However, existing parallelization approaches often…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-11 Zizhao Mo , Jianxiong Liao , Huanle Xu , Zhi Zhou , Chengzhong Xu

Edge computing can be defined as an emerging technology that uses cloud computing to leverage edge data centers to process, store, and analyze data close to the source. Traditional cloud computing architectures are not designed for…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-26 Vivek Basavegowda Ramu

The continued growth of the computational capability of throughput processors has made throughput processors the platform of choice for a wide variety of high performance computing applications. Graphics Processing Units (GPUs) are a prime…

Hardware Architecture · Computer Science 2018-05-01 Rachata Ausavarungnirun

As SRAM-based caches are hitting a scaling wall, manufacturers are integrating DRAM-based caches into system designs to continue increasing cache sizes. While DRAM caches can improve the performance of memory systems, existing DRAM cache…

Elasticity plays an important role in modern cloud computing systems. Elastic computing allows virtual machines (i.e., computing nodes) to be preempted when high-priority jobs arise, and also allows new virtual machines to participate in…

Information Theory · Computer Science 2024-03-04 Wenbo Huang , Xudong You , Kai Wan , Robert Caiming Qiu , Mingyue Ji

Understanding the performance of data-parallel workloads when resource-constrained has significant practical importance but unfortunately has received only limited attention. This paper identifies, quantifies and demonstrates memory…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-15 Calin Iorgulescu , Florin Dinu , Aunn Raza , Wajih Ul Hassan , Willy Zwaenepoel

IoT applications increasingly rely on on-device AI accelerators to ensure high performance, especially in low-connectivity and safety-critical scenarios. However, the limited on-chip memory of these accelerators forces inference runtimes to…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-13 Nathan Ng , Walid A. Hanafy , Prashanthi Kadambi , Balachandra Sunil , Ayush Gupta , David Irwin , Yogesh Simmhan , Prashant Shenoy

We present a framework for performance optimization in serverless edge-cloud platforms using dynamic task placement. We focus on applications for smart edge devices, for example, smart cameras or speakers, that need to perform processing…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-21 Anirban Das , Shigeru Imai , Mike P. Wittie , Stacy Patterson

Cloud elasticity - the ability to use as much resources as needed at any given time - and low cost - a user pays only for the resources it consumes - represent solid incentives for many organizations to migrate some of their computational…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-07-15 Ashkan Paya , Dan C. Marinescu