English
Related papers

Related papers: KEA: Tuning an Exabyte-Scale Data Infrastructure

200 papers

The energy footprint of global data movement has surpassed 100 terawatt hours, costing more than 20 billion US dollars to the world economy. Depending on the number of switches, routers, and hubs between the source and destination nodes,…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-04-12 Luigi Di Tacchio , Zulkar Nine , Tevfik Kosar , Fatih M. Bulut , Jinho Hwang

Nowadays, data-centers are largely under-utilized because resource allocation is based on reservation mechanisms which ignore actual resource utilization. Indeed, it is common to reserve resources for peak demand, which may occur only for a…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-03 Francesco Pace , Dimitrios Milios , Damiano Carra , Daniele Venzano , Pietro Michiardi

This work introduces EE-Tuning, a lightweight and economical solution to training/tuning early-exit large language models (LLMs). In contrast to the common approach of full-parameter pre-training, EE-Tuning augments any pre-trained (and…

Machine Learning · Computer Science 2024-02-02 Xuchen Pan , Yanxi Chen , Yaliang Li , Bolin Ding , Jingren Zhou

The rapid adoption of AI-driven automation in IoT environments, particularly in smart cities and industrial systems, necessitates a standardized approach to quantify AIs computational workload. Existing methodologies lack a consistent…

Performance · Computer Science 2025-03-20 Aasish Kumar Sharma , Michael Bidollahkhani , Julian Martin Kunkel

Software and hardware co-design and optimization of HPC systems has become intolerably complex, ad-hoc, time consuming and error prone due to enormous number of available design and optimization choices, complex interactions between all…

Software Engineering · Computer Science 2013-08-13 Grigori Fursin

An increasing amount of data is being injected into the network from IoT (Internet of Things) applications. Many of these applications, developed to improve society's quality of life, are latency-critical and inject large amounts of data…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-13 Patricia Arroba , Rajkumar Buyya , Román Cárdenas , José L. Risco-Martín , José M. Moya

Mobile networks are becoming energy hungry, and this trend is expected to continue due to a surge in communication and computation demand. Multi-access Edge Computing (MEC), will entail energy-consuming services and applications, with…

Networking and Internet Architecture · Computer Science 2022-09-29 Neda Shalavi , Giovanni Perin , Andrea Zanella , Michele Rossi

Non-Uniform Memory Access (NUMA) architecture imposes numerous performance challenges to today's cloud workloads. Due to the complexity and the massive scale of modern warehouse-scale computers (WSCs), a lot of efforts need to be done to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-05 Yueji Liu , Jun Jin , Wenhui Shu , Shiyong Li , Yongzhan He

Task scheduling is a well-studied problem in the context of optimizing the Quality of Service (QoS) of cloud computing environments. In order to sustain the rapid growth of computational demands, one of the most important QoS metrics for…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-24 Shreshth Tuli , Giuliano Casale , Nicholas R. Jennings

The adoption of probabilistic models for the best individuals found so far is a powerful approach for evolutionary computation. Increasingly more complex models have been used by estimation of distribution algorithms (EDAs), which often…

Neural and Evolutionary Computing · Computer Science 2007-10-16 Leonardo Emmendorfer , Aurora Pozo

Efficient resource allocation is a key challenge in modern cloud computing. Over-provisioning leads to unnecessary costs, while under-provisioning risks performance degradation and SLA violations. This work presents an artificial…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-08 Harshit Goyal

Large-scale computing systems are increasingly using accelerators such as GPUs to enable peta- and exa-scale levels of compute to meet the needs of Machine Learning (ML) and scientific computing applications. Given the widespread and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-20 Rutwik Jain , Brandon Tran , Keting Chen , Matthew D. Sinclair , Shivaram Venkataraman

Cascaded controller tuning is a multi-step iterative procedure that needs to be performed routinely upon maintenance and modification of mechanical systems. An automated data-driven method for cascaded controller tuning based on Bayesian…

Systems and Control · Electrical Eng. & Systems 2020-05-19 Mohammad Khosravi , Varsha Behrunani , Roy S. Smith , Alisa Rupenyan , John Lygeros

Dynamic nature of the cloud environment has made distributed resource management process a challenge for cloud service providers. The importance of maintaining the quality of service in accordance with customer expectations as well as the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-08 Sara Kardani-Moghaddam , Rajkumar Buyya , Kotagiri Ramamohanarao

The computation demand for machine learning (ML) has grown rapidly recently, which comes with a number of costs. Estimating the energy cost helps measure its environmental impact and finding greener strategies, yet it is challenging without…

Machine Learning · Computer Science 2021-04-26 David Patterson , Joseph Gonzalez , Quoc Le , Chen Liang , Lluis-Miquel Munguia , Daniel Rothchild , David So , Maud Texier , Jeff Dean

As the field of automated machine learning (AutoML) advances, it becomes increasingly important to incorporate domain knowledge into these systems. We present an approach for doing so by harnessing the power of large language models (LLMs).…

Artificial Intelligence · Computer Science 2023-10-02 Noah Hollmann , Samuel Müller , Frank Hutter

The rapid rise in cloud computing has resulted in an alarming increase in data centers' carbon emissions, which now accounts for >3% of global greenhouse gas emissions, necessitating immediate steps to combat their mounting strain on the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-04 Shiyu Wang , Yinbo Sun , Xiaoming Shi , Shiyi Zhu , Lin-Tao Ma , James Zhang , Yifei Zheng , Jian Liu

Applying machine learning (ML) in design flow is a popular trend in EDA with various applications from design quality predictions to optimizations. Despite its promise, which has been demonstrated in both academic researches and industrial…

Machine Learning · Computer Science 2022-10-04 Jingyu Pan , Chen-Chia Chang , Zhiyao Xie , Ang Li , Minxue Tang , Tunhou Zhang , Jiang Hu , Yiran Chen

Modern database management systems (DBMS) expose hundreds of configurable knobs to control system behaviours. Determining the appropriate values for these knobs to improve DBMS performance is a long-standing problem in the database…

Databases · Computer Science 2024-12-02 Jiale Lao , Yibo Wang , Yufei Li , Jianping Wang , Yunjia Zhang , Zhiyuan Cheng , Wanghu Chen , Mingjie Tang , Jianguo Wang

Performance benchmarking is a common practice in software engineering, particularly when building large-scale, distributed, and data-intensive systems. While cloud environments offer several advantages for running benchmarks, it is often…

Software Engineering · Computer Science 2025-04-17 Sören Henning , Adriano Vogel , Esteban Perez-Wohlfeil , Otmar Ertl , Rick Rabiser