English
Related papers

Related papers: Scheduling Distributed Resources in Heterogeneous …

200 papers

Applications that fuse machine learning and simulation can benefit from the use of multiple computing resources, with, for example, simulation codes running on highly parallel supercomputers and AI training and inference tasks on…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-04 Logan Ward , J. Gregory Pauloski , Valerie Hayot-Sasson , Ryan Chard , Yadu Babuji , Ganesh Sivaraman , Sutanay Choudhury , Kyle Chard , Rajeev Thakur , Ian Foster

Spatial crowdsourcing (SC) engages large worker pools for location-based tasks, attracting growing research interest. However, prior SC task allocation approaches exhibit limitations in computational efficiency, balanced matching, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-20 Kun Li , Shengling Wang , Hongwei Shi , Xiuzhen Cheng , Minghui Xu

Understanding the performance of a pool of servers is crucial for proper dimensioning. One of the main challenges is to take into account the complex interactions between servers that are pooled to process jobs. In particular, a job can…

Networking and Internet Architecture · Computer Science 2019-10-03 Thomas Bonald , Céline Comte , Fabien Mathieu

In order to better accommodate the dramatically increasing demand for data caching and computing services, storage and computation capabilities should be endowed to some of the intermediate nodes within the network. In this paper, we design…

Networking and Internet Architecture · Computer Science 2017-06-30 Yuchen Zhou , F. Richard Yu , Jian Chen , Yonghong Kuo

Current-day data centers and high-volume cloud services employ a broad set of heterogeneous servers. In such settings, client requests typically arrive at multiple entry points, and dispatching them to servers is an urgent distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-27 Guy Goren , Shay Vargaftik , Yoram Moses

Service systems often face task-server assignment-constraints due to skill-based routing or geographical conditions. Redundancy scheduling responds to this limited flexibility by replicating tasks to specific servers in agreement with these…

Probability · Mathematics 2022-08-17 Ellen Cardinaels , Sem Borst , Johan S. H. van Leeuwaarden

This paper considers the scheduling of jobs on distributed, heterogeneous High Performance Computing (HPC) clusters. Market-based approaches are known to be efficient for allocating limited resources to those that are most prepared to pay.…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-02-01 Andrew Burkimsher , Leandro Soares Indrusiak

MapReduce has become a popular programming model for running data intensive applications on the cloud. Completion time goals or deadlines of MapReduce jobs set by users are becoming crucial in existing cloud-based data processing…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-08-10 B. Thirumala Rao , L. S. S. Reddy

Extreme dynamic heterogeneity in high performance computing systems and the convergence of traditional HPC with new simulation, analysis, and data science approaches impose increasingly more complex requirements on resource and job…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-09 Daniel J. Milroy , Claudia Misale , Stephen Herbein , Dong H. Ahn

We study a fundamental model of resource allocation in which a finite number of resources must be assigned in an online manner to a heterogeneous stream of customers. The customers arrive randomly over time according to known stochastic…

Optimization and Control · Mathematics 2018-05-16 Clifford Stein , Van-Anh Truong , Xinshang Wang

As machine learning has become more prevalent, researchers have begun to recognize the necessity of ensuring machine learning systems are fair. Recently, there has been an interest in defining a notion of fairness that mitigates…

Data Structures and Algorithms · Computer Science 2020-06-22 Sara Ahmadian , Alessandro Epasto , Marina Knittel , Ravi Kumar , Mohammad Mahdian , Benjamin Moseley , Philip Pham , Sergei Vassilvitskii , Yuyan Wang

We consider the problem of scheduling in multi-class, parallel-server queuing systems with uncertain rewards from job-server assignments. In this scenario, jobs incur holding costs while awaiting completion, and job-server assignments yield…

Machine Learning · Computer Science 2025-08-15 Jung-hun Kim , Milan Vojnovic

Today's cloud infrastructure landscape offers a broad range of services to build and operate software applications. The myriad of options, however, has also brought along a new layer of complexity. When it comes to procuring cloud computing…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-16 Maximilian Kiessler , Valentin Haag , Benedikt Pittl , Erich Schikuta

In recent years many important societal decisions are made by machine-learning algorithms, and many such important decisions have strict capacity limits, allowing resources to be allocated only to the highest utility individuals. For…

Computers and Society · Computer Science 2026-02-27 Eitan Bachmat , Inbal Livni Navon

In this work we are interested in the problem of scheduling and redistributing data on master-slave platforms. We consider the case were the workers possess initial loads, some of which having to be redistributed in order to balance their…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-08-16 Loris Marchal , Veronika Rehn , Yves Robert , Frédéric Vivien

We present a convex optimization framework for overcoming the limitations of Kubernetes Cluster Autoscaler by intelligently allocating diverse cloud resources while minimizing costs and fragmentation. Current Kubernetes scaling mechanisms…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-28 Shayan Boghani , Emin Kirimlioglu , Amrita Moturi , Hao-Ting Tso

This paper considers the setting where a cloud server services a static set or a dynamic sequence of tasks submitted by multiple clients. Every client wishes to assure honest execution of tasks by additionally employing a trusted third…

Computer Science and Game Theory · Computer Science 2021-03-12 Pinglan Liu , Xiaojuan Ma , Wensheng Zhang

In recent years with the advent of high bandwidth internet access availability, the cloud computing applications have boomed. With more and more applications being run over the cloud and an increase in the overall user base of the different…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-25 Sandeep Kumar Patel , Avtar Singh

Nowadays many companies have available large amounts of raw, unstructured data. Among Big Data enabling technologies, a central place is held by the MapReduce framework and, in particular, by its open source implementation, Apache Hadoop.…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-01-18 Eugenio Gianniti , Danilo Ardagna , Michele Ciavotta , Mauro Passacantando

O-RAN systems and their deployment in virtualized general-purpose computing platforms (O-Cloud) constitute a paradigm shift expected to bring unprecedented performance gains. However, these architectures raise new implementation challenges…

Networking and Internet Architecture · Computer Science 2024-02-20 Fatih Aslan , George Iosifidis , Jose A. Ayala-Romero , Andres Garcia-Saavedra , Xavier Costa-Perez