English
Related papers

Related papers: Neural-based Modeling for Performance Tuning of Sp…

200 papers

This study develops a cloud-based deep learning system for early prediction of diabetes, leveraging the distributed computing capabilities of the AWS cloud platform and deep learning technologies to achieve efficient and accurate risk…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-07 Yang Zhang , Fa Wang , Xin Huang , Xintao Li , Sibei Liu , Hansong Zhang

In this paper, we primarily focus on understanding the data preprocessing pipeline for DNN Training in the public cloud. First, we run experiments to test the performance implications of the two major data preprocessing methods using either…

Machine Learning · Computer Science 2023-04-19 Ping Gong , Yuxin Ma , Cheng Li , Xiaosong Ma , Sam H. Noh

Deep learning models have been used to support analytics beyond simple aggregation, where deeper and wider models have been shown to yield great results. These models consume a huge amount of memory and computational operations. However,…

Machine Learning · Computer Science 2021-04-22 Shaofeng Cai , Gang Chen , Beng Chin Ooi , Jinyang Gao

Performance is arguably the most crucial attribute that reflects the quality of a configurable software system. However, given the increasing scale and complexity of modern software, modeling and predicting how various configurations can…

Software Engineering · Computer Science 2024-11-05 Jingzhi Gong , Tao Chen

The rapid expansion of cloud services and their unpredictable workload demands present significant challenges in resource management. Traditional resource management approaches, primarily based on static rules and thresholds, often fail to…

Networking and Internet Architecture · Computer Science 2024-07-30 Boyang Yan

Growing competitiveness and increasing availability of data is generating tremendous interest in data-driven analytics across industries. In the retail sector, stores need targeted guidance to improve both the efficiency and effectiveness…

Applications · Statistics 2018-06-15 Haidar Almohri , Ratna Babu Chinnam , Mark Colosimo

Physics-based and data-driven models for remaining useful lifetime (RUL) prediction typically suffer from two major challenges that limit their applicability to complex real-world domains: (1) incompleteness of physics-based models and (2)…

Systems and Control · Electrical Eng. & Systems 2020-10-28 Manuel Arias Chao , Chetan Kulkarni , Kai Goebel , Olga Fink

With the explosive increase of big data in industry and academic fields, it is necessary to apply large-scale data processing systems to analysis Big Data. Arguably, Spark is state of the art in large-scale data computing systems nowadays,…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-17 Shanjiang Tang , Bingsheng He , Ce Yu , Yusen Li , Kun Li

Cloud data centers are evolving fast. At the same time, today's large-scale data analytics applications require non-trivial performance tuning that is often specific to the applications, workloads, and data center infrastructure. We propose…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-11 Qizhen Zhang , Jiacheng Wu , Ang Chen , Vincent Liu , Boon Thau Loo

The performance analytics domain in High Performance Computing (HPC) uses tabular data to solve regression problems, such as predicting the execution time. Existing Machine Learning (ML) techniques leverage the correlations among features…

Machine Learning · Computer Science 2024-01-22 Tarek Ramadan , Ankur Lahiry , Tanzima Z. Islam

Learning effective configurations in computer systems without hand-crafting models for every parameter is a long-standing problem. This paper investigates the use of deep reinforcement learning for runtime parameters of cloud databases…

Machine Learning · Computer Science 2016-11-01 Michael Schaarschmidt , Felix Gessert , Valentin Dalibard , Eiko Yoneki

Datacenter power demand has been continuously growing and is the key driver of its cost. An accurate mapping of compute resources (CPU, RAM, etc.) and hardware types (servers, accelerators, etc.) to power consumption has emerged as a…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-15 Ana Radovanovic , Bokan Chen , Saurav Talukdar , Binz Roy , Alexandre Duarte , Mahya Shahbazi

Data scaling has revolutionized research fields like natural language processing, computer vision, and robotics control, providing foundation models with remarkable multi-task and generalization capabilities. In this paper, we investigate…

Systems and Control · Electrical Eng. & Systems 2025-03-27 Shaohuai Liu , Lin Dong , Chao Tian , Le Xie

Point cloud registration involves aligning one point cloud with another or with a three-dimensional (3D) model, enabling the integration of multimodal data into a unified representation. This is essential in applications such as…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Mehdi Maboudi , Said Harb , Jackson Ferrao , Kourosh Khoshelham , Yelda Turkan , Karam Mawas

Accurate workload forecasting is critical for efficient resource management in cloud computing systems, enabling effective scheduling and autoscaling. Despite recent advances with transformer-based forecasting models, challenges remain due…

Machine Learning · Computer Science 2024-08-20 Shiyu Wang , Zhixuan Chu , Yinbo Sun , Yu Liu , Yuliang Guo , Yang Chen , Huiyang Jian , Lintao Ma , Xingyu Lu , Jun Zhou

Signal processing, communications, and control have traditionally relied on classical statistical modeling techniques. Such model-based methods utilize mathematical formulations that represent the underlying physics, prior information and…

Signal Processing · Electrical Eng. & Systems 2022-09-13 Nir Shlezinger , Jay Whang , Yonina C. Eldar , Alexandros G. Dimakis

Gaining profound insights from collected data of today's application domains like IoT, cyber-physical systems, health care, or the financial sector is business-critical and can create the next multi-billion dollar market. However, analyzing…

Software Engineering · Computer Science 2017-04-06 Thomas Hartmann , Assaad Moawad , Francois Fouquet , Gregory Nain , Jacques Klein , Yves Le Traon , Jean-Marc Jezequel

Aligning future system design with the ever-increasing compute needs of large language models (LLMs) is undoubtedly an important problem in today's world. Here, we propose a general performance modeling methodology and workload analysis of…

Hardware Architecture · Computer Science 2024-07-23 Joyjit Kundu , Wenzhe Guo , Ali BanaGozar , Udari De Alwis , Sourav Sengupta , Puneet Gupta , Arindam Mallik

This paper discusses the various models related to cloud computing. Knowing the metrics related to infrastructure is very critical to enhance the performance of cloud services. Various metrics related to clouds such as pageview response…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-05-04 Chaitanya Krishna Kande

With the growing amount of data, data processing workloads and the management of their resource usage becomes increasingly important. Since managing a dedicated infrastructure is in many situations infeasible or uneconomical, users…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-19 Dominik Scheinert , Alireza Alamgiralem , Jonathan Bader , Jonathan Will , Thorsten Wittkopp , Lauritz Thamsen