English
Related papers

Related papers: JArena: Partitioned Shared Memory for NUMA-awarene…

200 papers

Deep neural networks (DNNs) have revolutionized the field of artificial intelligence and have achieved unprecedented success in cognitive tasks such as image and speech recognition. Training of large DNNs, however, is computationally…

In this paper we present a novel strategy for accelerating green computing by utilizing and adopting the Hybrid Asymmetric Multicore Architectures (HAMA) model with Safe Parallelism. Most of the modern computing is serial and contributes to…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-20 Hope Mogale , Michael Esiefarienrhe , Naison Gasela , Lucia Letlonkane

With the increasing computational demands of deep neural network (DNN) inference on resource-constrained devices, DNN partitioning-based device-edge collaborative inference has emerged as a promising paradigm. However, the transmission of…

Machine Learning · Computer Science 2026-03-04 Mengru Wu , Jiawei Li , Jiaqi Wei , Bin Lyu , Kai-Kit Wong , Hyundong Shin

Memory disaggregation has emerged as an alternative to traditional server architecture in data centers. This paper introduces DRackSim, a simulation infrastructure to model rack-scale hardware disaggregated memory. DRackSim models multiple…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-24 Amit Puri , John Jose , Tamarapalli Venkatesh , Vijaykrishnan Narayanan

Triadic analysis encompasses a useful set of graph mining methods that are centered on the concept of a triad, which is a subgraph of three nodes. Such methods are often applied in the social sciences as well as many other diverse fields.…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-09-28 George Chin , Andres Marquez , Sutanay Choudhury , John Feo

Mixed-Criticality (MC) systems consolidate multiple functionalities with different criticalities onto a single hardware platform. Such systems improve the overall resource utilization while guaranteeing resources to critical tasks. In this…

Operating Systems · Computer Science 2020-03-13 Saravanan Ramanathan , Arvind Easwaran

The emergence of high-density byte-addressable non-volatile memory (NVM) is promising to accelerate data- and compute-intensive applications. Current NVM technologies have lower performance than DRAM and, thus, are often paired with DRAM in…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-17 Ivy Peng , Kai Wu , Jie Ren , Dong Li , Maya Gokhale

Large language models (LLMs) are widely used but expensive to run, especially as inference workloads grow. To lower costs, maximizing the request batch size by managing GPU memory efficiently is crucial. While PagedAttention has recently…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-25 Chen Zhang , Kuntai Du , Shu Liu , Woosuk Kwon , Xiangxi Mo , Yufeng Wang , Xiaoxuan Liu , Kaichao You , Zhuohan Li , Mingsheng Long , Jidong Zhai , Joseph Gonzalez , Ion Stoica

Heterogeneous MPSoCs comprise diverse processing units of varying compute capabilities. To date, the mapping strategies of neural networks (NNs) onto such systems are yet to exploit the full potential of processing parallelism, made…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-28 Halima Bouzidi , Mohanad Odema , Hamza Ouarnoughi , Smail Niar , Mohammad Abdullah Al Faruque

Grant-free transmission is considered as a promising technology to support sporadic data transmission in massive machine-type communications (mMTC). Due to the distributed manner, high collision probability is an inherent drawback of…

Information Theory · Computer Science 2018-07-24 Hui Jiang , Qimei Cui , Yu Gu , Xiaoqi Qin , Xuefei Zhang , Xiaofeng Tao

Hybrid memory systems, comprised of emerging non-volatile memory (NVM) and DRAM, have been proposed to address the growing memory demand of applications. Emerging NVM technologies, such as phase-change memories (PCM), memristor, and 3D…

Hardware Architecture · Computer Science 2024-03-19 Fei Wen , Mian Qin , Paul V. Gratz , A. L. Narasimha Reddy

Modern high-end machines feature multiple processor packages, each of which contains multiple independent cores and integrated memory controllers connected directly to dedicated physical RAM. These packages are connected via a shared bus,…

Programming Languages · Computer Science 2011-05-13 Sven Auhagen , Lars Bergstrom , Matthew Fluet , John Reppy

In cloud computing environments, multiple tenants are often co-located on the same multi-processor system. Thus, preventing information leakage between tenants is crucial. While the hypervisor enforces software isolation, shared hardware,…

Cryptography and Security · Computer Science 2016-06-29 Peter Pessl , Daniel Gruss , Clémentine Maurice , Michael Schwarz , Stefan Mangard

Disaggregated memory is an upcoming data center technology that will allow nodes (servers) to share data efficiently. Sharing data creates a debate on the level of cache coherence the system should provide. While current proposals aim to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-24 Jaewan Hong , Marcos K. Aguilera , Emmanuel Amaro , Vincent Liu , Aurojit Panda , Ion Stoica

Code-domain non-orthogonal multiple access (CD-NOMA) systems offer key benefits such as high spectral efficiency, low latency, high reliability, and massive connectivity. NOMA's ability to handle overloading allows multiple devices to share…

Signal Processing · Electrical Eng. & Systems 2024-10-23 Vinjamoori Vikas , Kuntal Deka , A. Rajesh

The autoregressive decoding in LLMs is the major inference bottleneck due to the memory-intensive operations and limited hardware bandwidth. 3D-stacked architecture is a promising solution with significantly improved memory bandwidth, which…

Hardware Architecture · Computer Science 2025-11-20 Siyuan He , Peiran Yan , Yandong He , Youwei Zhuo , Tianyu Jia

To index the increasing volume of data, modern data indexes are typically stored on SSDs and cached in DRAM. However, searching such an index has resulted in significant I/O traffic due to limited access locality and inefficient cache…

Hardware Architecture · Computer Science 2024-08-05 Yun-Chih Chen , Yuan-Hao Chang , Tei-Wei Kuo

This paper presents the foundational elements of a distributed memory method for mesh generation that is designed to leverage concurrency offered by large-scale computing. To achieve this goal, meshing functionality is separated from…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-22 Kevin Garner , Christos Tsolakis , Polykarpos Thomadakis , Nikos Chrisochoides

Modern Deep Neural Network (DNN) accelerators are equipped with increasingly larger on-chip buffers to provide more opportunities to alleviate the increasingly severe DRAM bandwidth pressure. However, most existing research on buffer…

Hardware Architecture · Computer Science 2025-01-23 Jingwei Cai , Xuan Wang , Mingyu Gao , Sen Peng , Zijian Zhu , Yuchen Wei , Zuotong Wu , Kaisheng Ma

Non-Volatile Memory (NVM) can deliver higher density and lower cost per bit when compared with DRAM. Its main drawback is that it is slower than DRAM. On the other hand, DRAM has scalability problems due to its cost and energy consumption.…

Performance · Computer Science 2024-12-18 Diego Moura , Vinicius Petrucci , Daniel Mosse