English
Related papers

Related papers: Low latency via redundancy

200 papers

Service systems often face task-server assignment-constraints due to skill-based routing or geographical conditions. Redundancy scheduling responds to this limited flexibility by replicating tasks to specific servers in agreement with these…

Probability · Mathematics 2022-08-17 Ellen Cardinaels , Sem Borst , Johan S. H. van Leeuwaarden

In a cloud computing job with many parallel tasks, the tasks on the slowest machines (straggling tasks) become the bottleneck in the job completion. Computing frameworks such as MapReduce and Spark tackle this by replicating the straggling…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-14 Da Wang , Gauri Joshi , Gregory Wornell

Redundancy scheduling has emerged as a powerful strategy for improving response times in parallel-server systems. The key feature in redundancy scheduling is replication of a job upon arrival by dispatching replicas to different servers.…

Probability · Mathematics 2019-10-24 Youri Raaijmakers , Sem Borst , Onno Boxma

We study the expected completion time of some recently proposed algorithms for distributed computing which redundantly assign computing tasks to multiple machines in order to tolerate a certain number of machine failures. We analytically…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-10 Amir Behrouzi-Far , Emina Soljanin

Master-worker distributed computing systems use task replication in order to mitigate the effect of slow workers, known as stragglers. Tasks are grouped into batches and assigned to one or more workers for execution. We first consider the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-29 Amir Behrouzi-Far , Emina Soljanin

We design and analyze the performance of a redundancy management mechanism for Peer-to-Peer backup applications. Armed with the realization that a backup system has peculiar requirements -- namely, data is read over the network only during…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-01-20 Matteo Dell'Amico , Pietro Michiardi , Laszlo Toka , Pasquale Cataldi

In distributed computing systems with stragglers, various forms of redundancy can improve the average delay performance. We study the optimal replication of data in systems where the job execution time is a stochastically decreasing and…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-01 Amir Behrouzi-Far , Emina Soljanin

In cloud storage systems with a large number of servers, files are typically not stored in single servers. Instead, they are split, replicated (to ensure reliability in case of server malfunction) and stored in different servers. We analyze…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-09 Avishek Ghosh , Kannan Ramchandran

Data redundancy is ubiquitous in the inputs and intermediate results of Deep Neural Networks (DNN). It offers many significant opportunities for improving DNN performance and efficiency and has been explored in a large body of work. These…

Machine Learning · Computer Science 2022-08-30 Jou-An Chen , Wei Niu , Bin Ren , Yanzhi Wang , Xipeng Shen

Modern applications are highly sensitive to communication delays and throughput. This paper surveys major attempts on reducing latency and increasing the throughput. These methods are surveyed on different networks and surroundings such as…

Networking and Internet Architecture · Computer Science 2020-09-09 Amir Mirzaeinnia , Mehdi Mirzaeinia , Abdelmounaam Rezgui

Both capacity and latency are crucial performance metrics for the optimal operation of most networking services and applications, from online gaming to futuristic holographic-type communications. Networks worldwide have witnessed important…

Networking and Internet Architecture · Computer Science 2023-06-09 Gonzalo Martínez , José Alberto Hernández , Pedro Reviriego , Paul Reinheimer

This work presents an approach for robots to suitably carry out complex applications characterized by the presence of multiple additional constraints or subtasks (e.g. obstacle and self-collision avoidance) but subject to redundancy…

Robotics · Computer Science 2020-12-11 Lu Chen , Lipeng Chen , Xiangchi Chen , Yi Ren , Longfei Zhao , Yue Wang , Rong Xiong

With significant increases in mobile device traffic slated for the foreseeable future, numerous technologies must be embraced to satisfy such demand. Notably, one of the more intriguing approaches has been blending on-device caching and…

Networking and Internet Architecture · Computer Science 2016-05-16 Xueheng Hu , Aaron Striegel

Evolutionary computation algorithms are increasingly being used to solve optimization problems as they have many advantages over traditional optimization algorithms. In this paper we use evolutionary computation to study the trade-off…

Neural and Evolutionary Computing · Computer Science 2009-11-10 Matthew J. Berryman , Wei-Li Khoo , Hiep Nguyen , Erin O'Neill , Andrew Allison , Derek Abbott

In this paper, we consider how to provide fast estimates of flow-level tail latency performance for very large scale data center networks. Network tail latency is often a crucial metric for cloud application performance that can be affected…

Networking and Internet Architecture · Computer Science 2022-10-03 Kevin Zhao , Prateesh Goyal , Mohammad Alizadeh , Thomas E. Anderson

Datacenters are the cornerstone of the big data infrastructure supporting numerous online services. The demand for interactivity, which significantly impacts user experience and provider revenue, is translated into stringent timing…

Networking and Internet Architecture · Computer Science 2014-08-01 Shuhao Liu , Hong Xu , Zhiping Cai

Recent studies in different fields of science caused emergence of needs for high performance computing systems like Cloud. A critical issue in design and implementation of such systems is resource allocation which is directly affected by…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-05 Masoud Nosrati , Abdolah Chalechale , Ronak Karimi

The existence of considerable amount of redundancy in the Internet traffic at the packet level has stimulated the deployment of packet-level redundancy elimination techniques within the network by enabling network nodes to memorize data…

Networking and Internet Architecture · Computer Science 2014-11-25 Ahmad Beirami , Mohsen Sardari , Faramarz Fekri

The maximum possible throughput (or the rate of job completion) of a multi-server system is typically the sum of the service rates of individual servers. Recent work shows that launching multiple replicas of a job and canceling them as soon…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-29 Gauri Joshi , Dhruva Kaushal

Optimizing tail latency while efficiently managing computational resources is crucial for delivering high-performance, latency-sensitive services in edge computing. Emerging applications, such as augmented reality, require low-latency…

Machine Learning · Computer Science 2024-10-23 Jyoti Shokhanda , Utkarsh Pal , Aman Kumar , Soumi Chattopadhyay , Arani Bhattacharya