English
Related papers

Related papers: Utility maximizing load balancing policies

200 papers

This paper discusses the problem of maximizing the total data transmission utility of the computer network. The total utility is defined as the sum of the individual (corresponding to each node in the network) utilities that are concave…

Optimization and Control · Mathematics 2022-01-31 Dmitry Pasechnyuk

With the increasing popularity of Internet-based services and applications, power efficiency is becoming a major concern for data center operators, as high electricity consumption not only increases greenhouse gas emissions, but also…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-03-19 Dmytro Dyachuk , Michele Mazzucco

Flexible loads, i.e. the loads whose power trajectory is not bound to a specific one, constitute a sizable portion of current and future electric demand. This flexibility can be used to improve the performance of the grid, should the right…

Optimization and Control · Mathematics 2014-07-08 Mahdi Kefayati , Ross Baldick

We consider a system of $N$ parallel queues with identical exponential service rates and a single dispatcher where tasks arrive as a Poisson process. When a task arrives, the dispatcher always assigns it to an idle server, if there is any,…

Probability · Mathematics 2016-12-14 D. Mukherjee , S. C. Borst , J. S. H. van Leeuwaarden , P. A. Whiting

We consider two-stage tandem queueing systems with one dedicated server in each station and a flexible server that can serve both stations. We assume exponential service times, linear holding costs accrued by jobs present in the system, and…

Systems and Control · Computer Science 2019-04-12 Ioannis Papachristos , Dimitrios G. Pandelis

We consider a service system with an infinite number of exponential servers sharing a finite service capacity. The servers are ordered according to their speed, and arriving customers join the fastest idle server. A capacity allocation is…

Probability · Mathematics 2018-08-23 Refael Hassin , Liron Ravner

The model is a service system, consisting of several large server pools. A server processing speed and buffer size (which may be finite or infinite) depend on the pool. The input flow of customers is split equally among a fixed number of…

Probability · Mathematics 2016-08-05 Alexander Stolyar

In large-scale distributed systems, balancing the load in an efficient way is crucial in order to achieve low latency. Recently, some load balancing policies have been suggested which are able to achieve a bounded maximum queue length in…

Performance · Computer Science 2022-01-12 Tim Hellemans , Grzegorz Kielanski , Benny Van Houdt

We consider a simple computation offloading model where jobs can either be fully processed in the cloud or be partially processed at a local server before being sent to the cloud to complete processing. Our goal is to design a policy for…

Systems and Control · Electrical Eng. & Systems 2025-09-24 Darin Jeff , Eytan Modiano

In geographically-distributed systems, communication latencies are non-negligible. The perceived processing time of a request is thus composed of the time needed to route the request to the server and the true processing time. Once a…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-02-11 Piotr Skowron , Krzysztof Rzadca

Traditionally, research focusing on the design of routing and staffing policies for service systems has modeled servers as having fixed (possibly heterogeneous) service rates. However, service systems are generally staffed by people.…

Computer Science and Game Theory · Computer Science 2016-03-24 Ragavendran Gopalakrishnan , Sherwin Doroudi , Amy R. Ward , Adam Wierman

A fundamental challenge in large-scale cloud networks and data centers is to achieve highly efficient server utilization and limit energy consumption, while providing excellent user-perceived performance in the presence of uncertain and…

Probability · Mathematics 2017-06-23 Debankur Mukherjee , Souvik Dhara , Sem Borst , Johan S. H. van Leeuwaarden

Resource allocation for cloud services is a complex task due to the diversity of the services and the dynamic workloads. One way to address this is by overprovisioning which results in high cost due to the unutilized resources. A much more…

Data Structures and Algorithms · Computer Science 2015-03-10 Galia Shabtai , Danny Raz , Yuval Shavitt

The sum-utility maximization problem is known to be important in the energy systems literature. The conventional assumption to address this problem is that the utility is concave. But for some key applications, such an assumption is not…

Computer Science and Game Theory · Computer Science 2021-12-07 Chao Zhang , Samson Lasaulce , Li Wang , Lucas Saludjian , H. Vincent Poor

Randomized load balancing networks arise in a variety of applications, and allow for efficient sharing of resources, while being relatively easy to implement. We consider a network of parallel queues in which incoming jobs with independent…

Probability · Mathematics 2017-10-13 Reza Aghajani , Kavita Ramanan

A large-scale service system with multiple customer classes and multiple server pools is considered, with the mean service time depending both on the customer class and server pool. The allowed activities (routing choices) form a tree (in…

Probability · Mathematics 2014-03-28 Alexander Stolyar

We consider load balancing in service systems with affinity relations between jobs and servers. Specifically, an arriving job can be allocated to a fast, primary server from a particular selection associated with this job or to a secondary…

Probability · Mathematics 2018-12-31 Ellen Cardinaels , Sem C. Borst , Johan S. H. van Leeuwaarden

A classical sampling strategy for load balancing policies is power-of-two, where any server pair is sampled with equal probability. This does not cover practical settings with assignment constraints which force non-uniform sampling. While…

Probability · Mathematics 2022-07-18 Ellen Cardinaels , Sem Borst , Johan S. H. van Leeuwaarden

Cloud Computing is a new trend emerging in IT environment with huge requirements of infrastructure and resources. Load Balancing is an important aspect of cloud computing environment. Efficient load balancing scheme ensures efficient…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-03-28 Mayanka Katyal , Atul Mishra

The increasing reliance on renewable energy generation means that storage may well play a much greater role in the balancing of future electricity systems. We show how heterogeneous stores, differing in capacity and rate constraints, may be…

Optimization and Control · Mathematics 2021-06-14 Stan Zachary , Simon Tindemans , Michael Evans , James Cruise , David Angeli