English
Related papers

Related papers: Elasticizing Linux via Joint Disaggregation of Mem…

200 papers

Scientific computing in the exascale era demands increased computational power to solve complex problems across various domains. With the rise of heterogeneous computing architectures the need for vendor-agnostic, performance portability…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-05 Johansell Villalobos , Josef Ruzicka , Silvio Rizzi

Poor time predictability of multicore processors has been a long-standing challenge in the real-time systems community. In this paper, we make a case that a fundamental problem that prevents efficient and predictable real-time computing on…

Hardware Architecture · Computer Science 2018-04-20 Farzad Farshchi , Prathap Kumar Valsan , Renato Mancuso , Heechul Yun

Scientists increasingly rely on Python tools to perform scalable distributed memory array operations using rich, NumPy-like expressions. However, many of these tools rely on dynamic schedulers optimized for abstract task graphs, which often…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-14 Melih Elibol , Vinamra Benara , Samyu Yagati , Lianmin Zheng , Alvin Cheung , Michael I. Jordan , Ion Stoica

Network programmability is an area of research both defined by its potential and its current limitations. While programmable hardware enables customization of device operation, tailoring processing to finely tuned objectives, limited…

Networking and Internet Architecture · Computer Science 2021-03-29 Marcelo Abranches , Karl Olson , Eric Keller

Elasticity is a form of self-adaptivity in cloud-based software systems that is typically restricted to the infrastructure layer and realized through auto-scaling. However, both reactive and proactive forms of infrastructure auto-scaling…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-16 Mohan Baruwal Chhetri , Abdur Rahim Mohammad Forkan , Anton V. Uzunov , Surya Nepal

We study how to support elasticity, i.e., the ability to dynamically adjust the parallelism (number of GPUs), for deep neural network (DNN) training. Elasticity can benefit multi-tenant GPU cluster management in many ways, e.g., achieving…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-03 Yidi Wu , Kaihao Ma , Xiao Yan , Zhi Liu , Zhenkun Cai , Yuzhen Huang , James Cheng , Han Yuan , Fan Yu

With rapid improvements in NVM storage devices, the performance bottleneck is gradually shifting to the network, thus giving rise to the notion of "data movement wall". To reduce the amount of data movement over the network, researchers…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-27 Kornilios Kourtis , Animesh Trivedi , Nikolas Ioannou

Elasticity plays an important role in modern cloud computing systems. Elastic computing allows virtual machines (i.e., computing nodes) to be preempted when high-priority jobs arise, and also allows new virtual machines to participate in…

Information Theory · Computer Science 2024-03-04 Wenbo Huang , Xudong You , Kai Wan , Robert Caiming Qiu , Mingyue Ji

Optimizing communication performance is imperative for large-scale computing because communication overheads limit the strong scalability of parallel applications. Today's network cards contain rather powerful processors optimized for data…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-10-20 Torsten Hoefler , Salvatore Di Girolamo , Konstantin Taranov , Ryan E. Grant , Ron Brightwell

We present a single-node, multi-GPU programmable graph processing library that allows programmers to easily extend single-GPU graph algorithms to achieve scalable performance on large graphs with billions of edges. Directly using the…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-03-02 Yuechao Pan , Yangzihao Wang , Yuduo Wu , Carl Yang , John D. Owens

The need for computational resources grows as computational algorithms gain popularity in different sectors of the scientific community. This search has stimulated the development of several cloud platforms that abstract the complexity of…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-18 Henrique C. T. Santos , Luciano S. de Souza , Jonathan H. A. de Carvalho , Tiago A. E. Ferreira

The growth of cloud computing drives data centers toward higher density and efficiency. Data processing units (DPUs) enhance server network and storage performance but face challenges such as long hardware upgrade cycles and limited…

The web ecosystem is rapidly evolving with changing business and functional models. Cloud platforms are available in a SaaS, PaaS and IaaS model designed around commoditized Linux based servers. 10 billion users will be online and accessing…

Software Engineering · Computer Science 2018-09-24 Shaun C. D'Souza

RDMA is an exciting technology that enables a host to access the memory of a remote host without involving the remote CPU. Prior work shows how to use RDMA to improve the performance of distributed in-memory storage systems. However, RDMA…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-08 Stanko Novakovic , Yizhou Shan , Aasheesh Kolli , Michael Cui , Yiying Zhang , Haggai Eran , Liran Liss , Michael Wei , Dan Tsafrir , Marcos Aguilera

Serverless computing has attracted a broad range of applications due to its ease of use and resource elasticity. However, developing serverless applications often poses a dilemma -- relying on general-purpose serverless platforms can fall…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-17 Minchen Yu , Yinghao Ren , Jiamu Zhao , Jiaqi Li

The applications being developed within the U.S. Exascale Computing Project (ECP) to run on imminent Exascale computers will generate scientific results with unprecedented fidelity and record turn-around time. Many of these codes are based…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-04 Lipeng Wan , Axel Huebl , Junmin Gu , Franz Poeschel , Ana Gainaru , Ruonan Wang , Jieyang Chen , Xin Liang , Dmitry Ganyushin , Todd Munson , Ian Foster , Jean-Luc Vay , Norbert Podhorszki , Kesheng Wu , Scott Klasky

We revisit the problem of designing scalable protocols for private statistics and private federated learning when each device holds its private data. Locally differentially private algorithms require little trust but are (provably) limited…

Application compartmentalization and privilege separation are our primary weapons against ever-increasing security threats and privacy concerns on connected devices. Despite significant progress, it is still challenging to privilege…

Cryptography and Security · Computer Science 2023-06-27 Zahra Tarkhani , Anil Madhavapeddy

Process migration refers to the act of transferring a process in the middle of its execution from one machine to another in a network. In this paper, we proposed a process migration framework for Linux OS. It is a multilayer architecture to…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-01-15 Amirreza Zarrabi

Mixture-of-Experts (MoE) models promise efficient scaling of large language models (LLMs) by activating only a small subset of experts per token, but their parallelized inference pipelines make elastic serving challenging. Existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-06 Gursimran Singh , Timothy Yu , Haley Li , Cheng Chen , Hanieh Sadri , Qintao Zhang , Yu Zhang , Ying Xiong , Yong Zhang , Zhenan Fan