English
Related papers

Related papers: Online Scheduling of Spark Workloads with Mesos us…

200 papers

To solve the limitation of Hadoop on scalability, resource sharing, and application support, the open-source community proposes the next generation of Hadoop's compute platform called Yet Another Resource Negotiator (YARN) by separating…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-09-12 JIa-Chun Lin , Ming-Chang Lee

Algorithms for scheduling structured parallel computations have been widely studied in the literature. For some time now, Work Stealing is one of the most popular for scheduling such computations, and its performance has been studied in…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-26 Guilherme Rito , Hervé Paulino

Mobile edge computing seeks to provide resources to different delay-sensitive applications. This is a challenging problem as an edge cloud-service provider may not have sufficient resources to satisfy all resource requests. Furthermore,…

Networking and Internet Architecture · Computer Science 2020-01-03 Faheem Zafari , Kin K. Leung , Don Towsley , Prithwish Basu , Ananthram Swami , Jian Li

Efficient task scheduling in large-scale distributed systems presents significant challenges due to dynamic workloads, heterogeneous resources, and competing quality-of-service requirements. Traditional centralized approaches face…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-27 Daniel Benniah John

For popular websites most important concern is to handle incoming load dynamically among web servers, so that they can respond to their client without any wait or failure. Different websites use different strategies to distribute load among…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-03-08 Ms. Deepti Sharma , Ms. Archana B. Saxena

We present a new framework for designing nonpreemptive and job-size oblivious scheduling policies in the multiserver-job queueing model. The main requirement is to identify a static and balanced sub-partition of the server set and ensure…

Performance · Computer Science 2025-02-04 Jonatha Anselmi , Josu Doncel

This paper describes a new scheduling algorithm to distribute jobs in server farm systems. The proposed algorithm overcomes the starvation caused by SRPT (Shortest Remaining Processing Time). This algorithm is used in process scheduling in…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-09-06 Ehsan Saboori , Shahriar Mohammadi , Shafigh Parsazad

Information exchange is a crucial component of many real-world multi-agent systems. However, the communication between the agents involves two major challenges: the limited bandwidth, and the shared communication medium between the agents,…

Multiagent Systems · Computer Science 2021-02-18 Majid Raeis , S. Jamaloddin Golestani

Clustered federated Multitask learning is introduced as an efficient technique when data is unbalanced and distributed amongst clients in a non-independent and identically distributed manner. While a similarity metric can provide client…

Networking and Internet Architecture · Computer Science 2023-05-02 Abdullatif Albaseer , Mohamed Abdallah , Ala Al-Fuqaha , Abegaz Mohammed , Aiman Erbad , Octavia A. Dobre

We propose a Novel Fairness-Aware framework for Crowdsourcing Energy Services (FACES) to efficiently provision crowdsourced IoT energy services. Typically, efficient resource provisioning might incur an unfair resource sharing for some…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-12 Abdallah Lakhdari , Athman Bouguettaya

Multiuser resource allocation has recently been recognized as an effective methodology for enhancing the power and spectrum efficiency in OFDM (orthogonal frequency division multiplexing) systems. It is, however, not directly applicable to…

Numerical Analysis · Mathematics 2025-10-20 Ying Jun Zhang

Operating a distributed data stream processing workload efficiently at scale is hard. The operator of the workload must parallelize and lay out tasks of the workload with resources that match the requirement of target data rate. The…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-27 Manu Bansal , Eyal Cidon , Arjun Balasingam , Aditya Gudipati , Christos Kozyrakis , Sachin Katti

Integrating time-frequency resource conversion (TFRC), a new network resource allocation strategy, with call admission control can not only increase the cell capacity but also reduce network congestion effectively. However, the optimal…

Networking and Internet Architecture · Computer Science 2016-05-24 Hangguan Shan , Yani Zhang , Weihua Zhuang , Aiping Huang , Zhaoyang Zhang

We study a class of scheduling problems, where each job is divided into a batch of unit-size tasks and these tasks can be executed in parallel on multiple servers with New-Better-than-Used (NBU) service time distributions. While many delay…

Networking and Internet Architecture · Computer Science 2023-10-02 Yin Sun , C. Emre Koksal , Ness B. Shroff

In this paper we explore the performance limits of Apache Spark for machine learning applications. We begin by analyzing the characteristics of a state-of-the-art distributed machine learning algorithm implemented in Spark and compare it to…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-21 Celestine Dünner , Thomas Parnell , Kubilay Atasu , Manolis Sifalakis , Haralampos Pozidis

Ranking algorithms as an essential component of retrieval systems have been constantly improved in previous studies, especially regarding relevance-based utilities. In recent years, more and more research attempts have been proposed…

Information Retrieval · Computer Science 2024-05-29 Fumian Chen , Hui Fang

This paper considers the steady-state performance of load balancing algorithms in a many-server system with distributed queues. The system has $N$ servers, and each server maintains a local queue with buffer size $b-1,$ i.e. a server can…

Probability · Mathematics 2019-12-30 Xin Liu , Lei Ying

Datacenters are the main infrastructure on top of which cloud computing services are offered. Such infrastructure may be shared by a large number of tenants and applications generating a spectrum of datacenter traffic. Delay sensitive…

Networking and Internet Architecture · Computer Science 2017-07-21 Mohammad Noormohammadpour , Cauligi S. Raghavendra

This work is a continuation of efforts to define and understand competitive analysis of algorithms in a distributed shared memory setting, which is surprisingly different from the classical online setting. In fact, in a distributed shared…

Data Structures and Algorithms · Computer Science 2018-07-19 Joan Boyar , Faith Ellen , Kim S. Larsen

Polling systems with losses are useful mathematical objects that can model many practical systems like travelling salesman problem with recurrent requests. One of the less studied yet an important aspect in such systems is the disparity in…

Optimization and Control · Mathematics 2022-08-12 Vartika Singh , Veeraruna Kavitha