English
Related papers

Related papers: RDMAbox : Optimizing RDMA for Memory Intensive Wor…

200 papers

Remote Direct Memory Access (RDMA) is widely used in data center networks because of its high performance. However, due to the characteristics of RDMA's retransmission strategy and the traffic mode of AI training, current load balancing…

Networking and Internet Architecture · Computer Science 2024-07-16 Huimin Luo , Jiao Zhang , Mingxuan Yu , Yongchen Pan , Tian Pan , Tao Huang

RDMA has been widely adopted for high-speed datacenter networks. However, native RDMA merely supports one-to-one reliable connection, which mismatches various applications with group communication patterns (e.g., one-to-many). While there…

Networking and Internet Architecture · Computer Science 2023-08-01 Wenxue Li , Junyi Zhang , Gaoxiong Zeng , Yufei Liu , Zilong Wang , Chaoliang Zeng , Pengpeng Zhou , Qiaoling Wang , Kai Chen

This paper introduces a warehouse optimization procedure aimed at enhancing the efficiency of product storage and retrieval. By representing product locations and order flows within a time-evolving graph structure, we employ unsupervised…

Optimization and Control · Mathematics 2025-10-21 Magnus Bengtsson , Jens Wittsten , Jonas Waidringer

High-speed RDMA networks are getting rapidly adopted in the industry for their low latency and reduced CPU overheads. To verify that RDMA can be used in production, system administrators need to understand the set of application workloads…

Networking and Internet Architecture · Computer Science 2023-04-25 Xinhao Kong , Yibo Zhu , Huaping Zhou , Zhuo Jiang , Jianxi Ye , Chuanxiong Guo , Danyang Zhuo

Leadership supercomputers feature a diversity of storage, from node-local persistent memory and NVMe SSDs to network-interconnected flash memory and HDD. Memory mapping files on different tiers of storage provides a uniform interface in…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-18 Ivy B. Peng , Marty McFadden , Eric Green , Keita Iwabuchi , Kai Wu , Dong Li , Roger Pearce , Maya Gokhale

Since very few contributions to the development of an unified memory orchestration framework for efficient management of both host and remote idle memory have been made, we present Valet, an efficient approach to orchestration of host and…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-31 Juhyun Bae , Gong Su , Arun Iyengar , Yanzhao Wu , Ling Liu

Remote Direct Memory Access (RDMA) has been haunted by the need of pinning down memory regions. Pinning limits the memory utilization because it impedes on-demand paging and swapping. It also increases the initialization latency of large…

Networking and Internet Architecture · Computer Science 2023-10-18 Huijun Shen , Guo Chen , Bojie Li , Xingtong Lin , Xingyu Zhang , Xizheng Wang , Amit Geron , Shamir Rabinovitch , Haifeng Lin , Han Ruan , Lijun Li , Jingbin Zhou , Kun Tan

Today's data centers consist of thousands of network-connected hosts, each with CPUs and accelerators such as GPUs and FPGAs. These hosts also contain network interface cards (NICs), operating at speeds of 100Gb/s or higher, that are used…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-12 Guanwen Zhong , Aditya Kolekar , Burin Amornpaisannon , Inho Choi , Haris Javaid , Mario Baldi

To cope with the increasing demand of wireless communication services multi-carrier systems are being used. Radio resources are very limited and efficient usages of these resources are inevitable to get optimum performance of the system.…

Networking and Internet Architecture · Computer Science 2011-09-13 Sheikh Shanawaz Mostafa , Khondker Jahid Reza , Gazi Maniur Rashid , Muhammad Moinuddin , Md. Ziaul Amin , Abdullah Al Nahid

Iterative compilation is a widely adopted technique to optimize programs for different constraints such as performance, code size and power consumption in rapidly evolving hardware and software environments. However, in case of statically…

Programming Languages · Computer Science 2014-07-16 Lianjie Luo , Yang Chen , Chengyong Wu , Shun Long , Grigori Fursin

The computational and memory challenges of large language models (LLMs) have sparked several optimization approaches towards their efficient implementation. While prior LLM-targeted quantization, and prior works on sparse acceleration have…

Hardware Architecture · Computer Science 2025-03-18 Abhishek Moitra , Arkapravo Ghosh , Shrey Agarwal , Aporva Amarnath , Karthik Swaminathan , Priyadarshini Panda

The growing demand for low-latency computing in 6G is driving the use of UAV-based low-altitude mobile edge computing (MEC) systems. However, limited spectrum often leads to severe uplink interference among ground terminals (GTs). In this…

Networking and Internet Architecture · Computer Science 2025-07-18 Xudong Wang , Hongyang Du , Lei Feng , Kaibin Huang

Coordinating concurrent access to a shared resource using mutual exclusion is a fundamental problem in computation. In this paper, we present a novel approach to mutual exclusion designed specifically for distributed systems leveraging a…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-23 Jacob Nelson-Slivon , Lewis Tseng , Roberto Palmieri

Operating systems include many heuristic algorithms designed to improve overall storage performance and throughput. Because such heuristics cannot work well for all conditions and workloads, system designers resorted to exposing numerous…

Disaggregated memory systems achieve resource utilization efficiency and system scalability by distributing computation and memory resources into distinct pools of nodes. RDMA is an attractive solution to support high-throughput…

Databases · Computer Science 2025-02-14 Yi Liu , Minghao Xie , Shouqian Shi , Yuanchao Xu , Heiner Litz , Chen Qian

Remote direct memory access (RDMA) networks are being rapidly adopted into industry for their high speed, low latency, and reduced CPU overheads compared to traditional kernel-based TCP/IP networks. RDMA enables threads to access remote…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-30 Amanda Baran , Jacob Nelson-Slivon , Lewis Tseng , Roberto Palmieri

Data-intensive applications in data centers, especially machine learning (ML), have made the network a bottleneck, which in turn has motivated the development of more efficient network protocols and infrastructure. For instance, remote…

Hardware Architecture · Computer Science 2025-07-29 Maximilian Jakob Heer , Benjamin Ramhorst , Yu Zhu , Luhao Liu , Zhiyi Hu , Jonas Dann , Gustavo Alonso

Remote Direct Memory Access (RDMA) improves host networking performance by eliminating software and server CPU involvement. However, RDMA has a limited set of operations, is difficult to program, and often requires multiple round trips to…

Networking and Internet Architecture · Computer Science 2025-09-10 Md Ashfaqur Rahaman , Alireza Sanaee , Todd Thornley , Sebastiano Miano , Gianni Antichi , Brent E. Stephens , Ryan Stutsman

Energy consumption has become a first-class optimization goal in design and implementation of data-intensive computing systems. This is particularly true in the design of database management systems (DBMS), which was found to be the major…

Databases · Computer Science 2017-03-09 Peyman Behzadnia , Yi-Cheng Tu , Bo Zeng , Wei Yuan

RDMA is vital for efficient distributed training across datacenters, but millisecond-scale latencies complicate the design of its reliability layer. We show that depending on long-haul link characteristics, such as drop rate, distance and…