English
Related papers

Related papers: ReStore: In-Memory REplicated STORagE for Rapid Re…

200 papers

Rollback recovery strategies are well-known in concurrent and distributed systems. In this context, recovering from unexpected failures is even more relevant given the non-deterministic nature of execution, which means that it is…

Programming Languages · Computer Science 2024-01-08 Germán Vidal

One of the primary objectives of a distributed storage system is to reliably store large amounts of source data for long durations using a large number $N$ of unreliable storage nodes, each with $c$ bits of storage capacity. Storage nodes…

Information Theory · Computer Science 2021-01-14 Michael Luby , Thomas Richardson

Ensuring resilience in distributed systems has become an acute concern. In today's environment, it is crucial to develop light-weight mechanisms that recover a distributed system from faults quickly and with only a small impact on the…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-10 Antonis Psistakis , Burak Ocalan , Fabien Chaix , Ramnatthan Alagappan , Josep Torrellas

Distributed applications running on a large cluster environment, such as the cloud instances will have shorter execution time. However, the application might suffer from sudden termination due to unpredicted computing node failures, thus…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-30 Basma Abdel Azeem , Manal Helal

This paper investigates an edge computing system where requests are processed by a set of replicated edge servers. We investigate a class of applications where similar queries produce identical results. To reduce processing overhead on the…

Emerging Technologies · Computer Science 2024-05-29 Adrian-Cristian Nicolaescu , Spyridon Mastorakis , Md Washik Al Azad , David Griffin , Miguel Rio

Deduplication has been largely employed in distributed storage systems to improve space efficiency. Traditional deduplication research ignores the design specifications of shared-nothing distributed storage systems such as no central…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-22 Awais Khan , Chang-Gyu Lee , Prince Hamandawana , Sungyong Park , Youngjae Kim

Persistent Memory (PM) makes possible recoverable applications that can preserve application progress across system reboots and power failures. Actual recoverability requires careful ordering of cacheline flushes, currently done in two…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-02 Swapnil Haria , Mark D. Hill , Michael M. Swift

Upcoming HPC clusters will feature hybrid memories and storage devices per compute node. In this work, we propose to use the MPI one-sided communication model and MPI windows as unique interface for programming memory and storage. We…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-10 Sergio Rivas-Gomez , Roberto Gioiosa , Ivy Bo Peng , Gokcen Kestor , Sai Narasimhamurthy , Erwin Laure , Stefano Markidis

Distributed storage systems with replication are well known for storing large amount of data. A large number of replication is done in order to provide reliability. This makes the system expensive. Various methods have been proposed over…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-10-01 Mit Sheth , Krishna Gopal Benerjee , Manish K. Gupta

With the increasing number of compute components, failures in future exa-scale computer systems are expected to become more frequent. This motivates the study of novel resilience techniques. Here, we extend a recently proposed…

Mathematical Software · Computer Science 2018-04-18 Markus Huber , Ulrich Rüde , Barbara Wohlmuth

Fault tolerance for the upcoming exascale generation has long been an area of active research. One of the components of a fault tolerance strategy is checkpointing. Petascale-level checkpointing is demonstrated through a new mechanism for…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-09-27 Jiajun Cao , Kapil Arya , Rohan Garg , Shawn Matott , Dhabaleswar K. Panda , Hari Subramoni , Jérôme Vienne , Gene Cooperman

Data distribution across different facilities offers benefits such as enhanced resource utilization, increased resilience through replication, and improved performance by processing data near its source. However, managing such data is…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-02 Dante D. Sanchez-Gallegos , J. L. Gonzalez-Compean , Maxime Gonthier , Valerie Hayot-Sasson , J. Gregory Pauloski , Haochen Pan , Kyle Chard , Jesus Carretero , Ian Foster

Emerging Deep Learning (DL) applications introduce heavy I/O workloads on computer clusters. The inherent long lasting, repeated, and random file access pattern can easily saturate the metadata and data service and negatively impact other…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-01 Zhao Zhang , Lei Huang , Uri Manor , Linjing Fang , Gabriele Merlo , Craig Michoski , John Cazes , Niall Gaffney

In P2P systems, large volumes of data are declustered naturally across a large number of peers. But it is very difficult to control the initial data distribution because every user has the freedom to share any data with other users. The…

Networking and Internet Architecture · Computer Science 2010-09-24 S. Ayyasamy , S. N. Sivanandam

As LLMs and foundation models scale, checkpoint/restore has become a critical pattern for training and inference. With 3D parallelism (tensor, pipeline, data), checkpointing involves many processes, each managing numerous tensors of varying…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-01 Mikaila J. Gossman , Avinash Maurya , Bogdan Nicolae , Jon C. Calhoun

This paper investigates the use of redundancy and self repairing against node failures in distributed storage systems, using various strategies. In replication method, access to one replication node is sufficient to reconstruct a lost node,…

Information Theory · Computer Science 2011-10-03 Abbas Kiani , Soroush Akhlaghi

Quorum systems are useful tools for implementing consistent and available storage in the presence of failures. These systems usually comprise a static set of servers that provide a fault-tolerant read/write register accessed by a set of…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-07-20 Eduardo Alchieri , Alysson Bessani , Fabiola Greve , Joni Fraga

HyCoR is a fully-operational fault tolerance mechanism for multiprocessor workloads, based on container replication, using a hybrid of checkpointing and replay. HyCoR derives from two insights regarding replication mechanisms: 1)…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-26 Diyu Zhou , Yuval Tamir

In order to efficiently use the future generations of supercomputers, fault tolerance and power consumption are two of the prime challenges anticipated by the High Performance Computing (HPC) community. Checkpoint/Restart (CR) has been and…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-08-08 Faisal Shahzad , Jonas Thies , Moritz Kreutzer , Thomas Zeiser , Georg Hager , Gerhard Wellein

With the increasing complexity of computing systems, complete hardware reliability can no longer be guaranteed. We need, however, to ensure overall system reliability. One of the most important features of artificial neural networks is…

Neural and Evolutionary Computing · Computer Science 2015-10-07 Anton Kulakov , Mark Zwolinski , Jeff Reeve