English
Related papers

Related papers: Parallel Deferred Update Replication

200 papers

The aim of this paper is to present a first evaluation of the potential of an asynchronous distributed computation associated to the recently proposed approach, D-iteration: the D-iteration is a fluid diffusion based iterative method, which…

Numerical Analysis · Mathematics 2012-02-29 Dohy Hong

Read-Copy Update (RCU) is a scalable, high-performance Linux-kernel synchronization mechanism that runs low-overhead readers concurrently with updaters. Production-quality RCU implementations for multi-core systems are decidedly…

Logic in Computer Science · Computer Science 2018-11-27 Lihao Liang , Paul E. McKenney , Daniel Kroening , Tom Melham

In this paper we present two strategies to enable "parallelization across the method" for spectral deferred corrections (SDC). Using standard low-order time-stepping methods in an iterative fashion, SDC can be seen as preconditioned Picard…

Numerical Analysis · Mathematics 2017-03-24 Robert Speck

Deep reinforcement learning (DRL) algorithms and evolution strategies (ES) have been applied to various tasks, showing excellent performances. These have the opposite properties, with DRL having good sample efficiency and poor stability,…

Machine Learning · Computer Science 2021-04-06 Kyunghyun Lee , Byeong-Uk Lee , Ukcheol Shin , In So Kweon

While distributed training significantly speeds up the training process of the deep neural network (DNN), the utilization of the cluster is relatively low due to the time-consuming data synchronizing between workers. To alleviate this…

Machine Learning · Computer Science 2020-12-01 Yuhao Zhou , Qing Ye , Hailun Zhang , Jiancheng Lv

Communication scheduling has been shown to be effective in accelerating distributed training, which enables all-reduce communications to be overlapped with backpropagation computations. This has been commonly adopted in popular distributed…

Machine Learning · Computer Science 2023-06-16 Lin Zhang , Shaohuai Shi , Xiaowen Chu , Wei Wang , Bo Li , Chengjian Liu

This paper considers the scheduling of parallel real-time tasks with arbitrary-deadlines. Each job of a parallel task is described as a directed acyclic graph (DAG). In contrast to prior work in this area, where decomposition-based…

Operating Systems · Computer Science 2017-12-15 Niklas Ueter , Georg von der Brüggen , Jian-Jia Chen , Jing Li , Kunal Agrawal

Training large deep learning models requires parallelization techniques to scale. In existing methods such as Data Parallelism or ZeRO-DP, micro-batches of data are processed in parallel, which creates two drawbacks: the total memory…

Machine Learning · Computer Science 2024-03-15 Louis Fournier , Edouard Oyallon

Self-adjusting computation is an approach for automatically producing dynamic algorithms from static ones. The approach works by tracking control and data dependencies, and propagating changes through the dependencies when making an update.…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-17 Daniel Anderson , Guy E. Blelloch , Anubhav Baweja , Umut A. Acar

Conventional blockchains use consensus algorithms that totally order updates across all accounts, which is stronger than necessary to implement a replicated ledger. This makes updates slower and more expensive than necessary. More recent…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-29 Erick Lavoie

In this paper we present the new DUNE-ALUGrid module. This module contains a major overhaul of the sources from the ALUgrid library and the binding to the DUNE software framework. The main changes include user defined load balancing,…

Mathematical Software · Computer Science 2015-08-18 Martin Alkämper , Andreas Dedner , Robert Klöfkorn , Martin Nolte

This paper presents PIPQ, a strict and linearizable concurrent priority queue whose design differs from existing solutions in literature because it focuses on enabling parallelism of insert operations as opposed to accelerating delete-min…

Data Structures and Algorithms · Computer Science 2025-08-25 Olivia Grimes , Ahmed Hassan , Panagiota Fatourou , Roberto Palmieri

A dominant cost for query evaluation in modern massively distributed systems is the number of communication rounds. For this reason, there is a growing interest in single-round multiway join algorithms where data is first reshuffled over…

Databases · Computer Science 2015-01-06 Tom J. Ameloot , Gaetano Geck , Bas Ketsman , Frank Neven , Thomas Schwentick

Data is replicated and stored redundantly over multiple servers for availability in distributed databases. We focus on databases with frequent reads and writes, where both read and write latencies are important. This is in contrast to…

Networking and Internet Architecture · Computer Science 2022-02-01 Saraswathy Ramanathan , Gaurav Gautam , Vikram Srinivasan , Parimal Parag

In order to increase availability in a distributed system some or all of the data items are replicated and stored at separate sites. This is an issue of key concern especially since there is such a proliferation of wireless technologies and…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-06-11 Joel M. Crichlow , Stephen J. Hartley , Michael Hosein

One key requirement for storage clouds is to be able to retrieve data quickly. Recent system measurements have shown that the data retrieving delay in storage clouds is highly variable, which may result in a long latency tail. One crucial…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Yin Sun , Zizhan Zheng , C. Emre Koksal , Kyu-Han Kim , Ness B. Shroff

This paper offers a new hybrid probably approximately correct (PAC) reinforcement learning (RL) algorithm for Markov decision processes (MDPs) that intelligently maintains favorable features of its parents. The designed algorithm, referred…

Machine Learning · Computer Science 2021-01-29 Ashkan Zehfroosh , Herbert G. Tanner

Deep Neural Network (DNN) models are usually trained sequentially from one layer to another, which causes forward, backward and update locking's problems, leading to poor performance in terms of training time. The existing parallel…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-25 Samson B. Akintoye , Liangxiu Han , Huw Lloyd , Xin Zhang , Darren Dancey , Haoming Chen , Daoqiang Zhang

Parallel real-time embedded applications can be modelled as directed acyclic graphs (DAGs) whose nodes model subtasks and whose edges model precedence constraints among subtasks. Efficiently scheduling such parallel tasks can be challenging…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-24 Shardul Lendve , Konstantinos Bletsas , Pedro F. Souto

Data movement between the processor and the main memory is a first-order obstacle against improving performance and energy efficiency in modern systems. To address this obstacle, Processing-using-Memory (PuM) is a promising approach where…