English
Related papers

Related papers: Interference and Need Aware Workload Colocation in…

200 papers

Power consumption is a dominant and still growing cost factor in data centers. In time periods with low load, the energy consumption can be reduced by powering down unused servers. We resort to a model introduced by Lin, Wierman, Andrew and…

Data Structures and Algorithms · Computer Science 2021-08-02 Susanne Albers , Jens Quedenfeld

Load balancing arises as a fundamental problem, underlying the dimensioning and operation of many computing and communication systems, such as job routing in data center clusters, multipath communication, Big Data and queueing systems. In…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-12 Anam Tahir , Bastian Alt , Amr Rizk , Heinz Koeppl

Cloud-based serverless computing systems, either public or privately provisioned, aim to provide the illusion of infinite resources and abstract users from details of the allocation decisions. With the goal of providing a low cost and a…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-25 Chavit Denninnart

Recently, the capital expenditure of flash-based Solid State Driver (SSDs) keeps declining and the storage capacity of SSDs keeps increasing. As a result, all-flash storage systems have started to become more economically viable for large…

Performance · Computer Science 2019-07-10 Zhengyu Yang , Manu Awasthi , Mrinmoy Ghosh , Janki Bhimani , Ningfang Mi

In Cloud computing environment the resources are managed dynamically based on the need and demand for resources for a particular task. With a lot of challenges to be addressed our concern is Load balancing where load balancing is done for…

Networking and Internet Architecture · Computer Science 2020-10-02 Mohammad Riyaz Belgaum , Safeeullah Soomro , Zainab Alansari , Shahrulniza Musa , Muhammad Alam , Mazliham Mohd Su'ud

Small-scale clouds (SCs) often suffer from resource under-provisioning during peak demand, leading to inability to satisfy service level agreements (SLAs) and consequent loss of customers. One approach to address this problem is for a set…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-08-08 Sung-Han Lin , Ranjan Pal , Marco Paolieri , Leana Golubchik

We consider a large-scale service system where incoming tasks have to be instantaneously dispatched to one out of many parallel server pools. The user-perceived performance degrades with the number of concurrent tasks and the dispatcher…

As artificial intelligence (AI) and machine learning (ML) technologies disrupt a wide range of industries, cloud datacenters face ever-increasing demand in inference workloads. However, conventional CPU-based servers cannot handle excessive…

Hardware Architecture · Computer Science 2022-06-08 Jung-Hoon Kim , Sungyeob Yoo , Seungjae Moon , Joo-Young Kim

As machine learning techniques are applied to a widening range of applications, high throughput machine learning (ML) inference servers have become critical for online service applications. Such ML inference servers pose two challenges:…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-06 Seungbeom Choi , Sunho Lee , Yeonjae Kim , Jongse Park , Youngjin Kwon , Jaehyuk Huh

Load balancing plays a critical role in efficiently dispatching jobs in parallel-server systems such as cloud networks and data centers. A fundamental challenge in the design of load balancing algorithms is to achieve an optimal trade-off…

Performance · Computer Science 2020-12-16 Mark van der Boor , Sem Borst , Johan van Leeuwaarden

Mobile and IoT applications increasingly adopt deep learning inference to provide intelligence. Inference requests are typically sent to a cloud infrastructure over a wireless network that is highly variable, leading to the challenge of…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-24 Kamran Razavi , Saeid Ghafouri , Max Mühlhäuser , Pooyan Jamshidi , Lin Wang

Database platform-as-a-service (dbPaaS) is developing rapidly and a large number of databases have been migrated to run on the Clouds for the low cost and flexibility. Emerging Clouds rely on the tenants to provide the resource…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-30 Ningxin Zheng , Quan Chen , Yong Yang , Wei Zhang , Jin Li , Wenli Zheng , Minyi Guo

This paper addresses the challenges of rapid resource variation and highly uncertain task loads in cloud computing environments. It proposes an optimization method for elastic cloud resource scaling based on a multi-agent system. The method…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-02 Bruce Fang , Danyi Gao

I/O performance is crucial to efficiency in data-intensive scientific computing; but tuning large-scale storage systems is complex, costly, and notoriously manpower-intensive, making it inaccessible for most domain scientists. To address…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-27 Chris Egersdoerfer , Philip Carns , Shane Snyder , Robert Ross , Dong Dai

Large language models (LLMs) deployed on edge servers are increasingly used in latency-sensitive applications such as personalized assistants, recommendation, and content moderation. However, the non-stationary nature of user data…

Machine Learning · Computer Science 2025-10-07 Yufei Li , Yu Fu , Yue Dong , Cong Liu

Emerging reconfigurable datacenters allow to dynamically adjust the network topology in a demand-aware manner. These datacenters rely on optical switches which can be reconfigured to provide direct connectivity between racks, in the form of…

Networking and Internet Architecture · Computer Science 2025-03-19 Kathrin Hanauer , Monika Henzinger , Lara Ost , Stefan Schmid

Adopting serverless computing to edge networks benefits end-users from the pay-as-you-use billing model and flexible scaling of applications. This paradigm extends the boundaries of edge computing and remarkably improves the quality of…

Networking and Internet Architecture · Computer Science 2024-08-15 Peiyuan Guan , Chen Chen , Ziru Chen , Lin X. Cai , Xing Hao , Amir Taherkordi

The rapid expansion of data centers (DCs) has intensified energy and carbon footprint, incurring a massive environmental computing cost. While carbon-aware workload migration strategies have been examined, existing approaches often overlook…

Systems and Control · Electrical Eng. & Systems 2025-04-02 Yichao Zhang , Yubo Song , Subham Sahoo

The integration of AI-assisted coding tools within development environments drastically reduces development time, and allows developers to focus more on creative and critical aspects of software engineering through the use of Code Large…

Software Engineering · Computer Science 2025-03-26 Kishanthan Thangarajah , Arthur Leung , Boyuan Chen , Ahmed E. Hassan

Hierarchical edge-cloud computing-aided Internet of Things (IoT) networks offer low-latency and cost-efficient services to a growing number of data-intensive IoT devices. However, optimizing service placement, which involves determining the…