English
Related papers

Related papers: HybridTune: Spatio-temporal Data and Model Driven …

200 papers

Spatiotemporal (ST) data collected by sensors can be represented as multi-variate time series, which is a sequence of data points listed in an order of time. Despite the vast amount of useful information, the ST data usually suffer from the…

Machine Learning · Computer Science 2023-04-20 Li Jiang , Ting Zhang , Qiruyi Zuo , Chenyu Tian , George P. Chan , Wai Kin , Chan

This chapter introduces the state-of-the-art in the emerging area of combining High Performance Computing (HPC) with Big Data Analysis. To understand the new area, the chapter first surveys the existing approaches to integrating HPC with…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-01 Yuankun Fu , Fengguang Song

Spatiotemporal learning is challenging due to the intricate interplay between spatial and temporal dependencies, the high dimensionality of the data, and scalability constraints. These challenges are further amplified in scientific domains,…

Machine Learning · Computer Science 2025-04-17 David Keetae Park , Xihaier Luo , Guang Zhao , Seungjun Lee , Miruna Oprescu , Shinjae Yoo

The distributed data analytic system -- Spark is a common choice for processing massive volumes of heterogeneous data, while it is challenging to tune its parameters to achieve high performance. Recent studies try to employ auto-tuning…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-06 Yang Li , Huaijun Jiang , Yu Shen , Yide Fang , Xiaofeng Yang , Danqing Huang , Xinyi Zhang , Wentao Zhang , Ce Zhang , Peng Chen , Bin Cui

Hyper-parameter tuning (HPT) is crucial for many machine learning (ML) algorithms. But due to the large searching space, HPT is usually time-consuming and resource-intensive. Nowadays, many researchers use public cloud resources to train…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-08 Yan Li , Bo An , Junming Ma , Donggang Cao , Yasha Wang , Hong Mei

In the era of big data and Internet of things, massive sensor data are gathered with Internet of things. Quantity of data captured by sensor networks are considered to contain highly useful and valuable information. However, for a variety…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-03-10 Sai Xie , Zhe Chen

The evolution of distributed architectures and programming paradigms for performance-oriented program development, challenge the state-of-the-art technology for performance tools. The area of high performance computing is rapidly expanding…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-06-15 Ajanta De Sarkar , Nandini Mukherjee

Scientific advancements rely on high-performance computing (HPC) applications that model real-world phenomena through simulations. These applications process vast amounts of data on specialized accelerators (eg., GPUs) using special…

Software Engineering · Computer Science 2025-01-20 Matthew Davis , Aakash Kulkarni , Ziyan Chen , Yunhan Qiao , Christopher Terrazas , Manish Motwani

Cloud data centers face increasing pressure to reduce operational energy consumption as big data workloads continue to grow in scale and complexity. This paper presents a workload aware and energy efficient scheduling framework that…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-21 Milan Parikh , Aniket Abhishek Soni , Sneja Mitinbhai Shah , Ayush Raj Jha

In recent years, artificial intelligence (AI) technologies have found industrial applications in various fields. AI systems typically possess complex software and heterogeneous CPU/GPU hardware architecture, making it difficult to answer…

Software Engineering · Computer Science 2022-04-08 Vyacheslav Zhdanovskiy , Lev Teplyakov , Anton Grigoryev

This article presents an automatic approach to quickly derive a good solution for hardware resource partition and task granularity for task-based parallel applications on heterogeneous many-core architectures. Our approach employs a…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-10 Peng Zhang , Jianbin Fang , Canqun Yang , Chun Huang , Tao Tang , Zheng Wang

Nowadays Big Data are becoming more and more important. Many sectors of our economy are now guided by data-driven decision processes. Big Data and business intelligence applications are facilitated by the MapReduce programming model while,…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-12-06 Alessandro Maria Rizzi

Differences in data size per class, also known as imbalanced data distribution, have become a common problem affecting data quality. Big Data scenarios pose a new challenge to traditional imbalanced classification algorithms, since they are…

Machine Learning · Computer Science 2021-09-06 Diego García-Gil , Salvador García , Ning Xiong , Francisco Herrera

Cloud data analytics has become an integral part of enterprise business operations for data-driven insight discovery. Performance modeling of cloud data analytics is crucial for performance tuning and other critical operations in the cloud.…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-21 Khaled Zaouk , Fei Song , Chenghao Lyu , Yanlei Diao

The past decade has seen rapid growth of distributed stream data processing systems. Under these systems, a stream application is realized as a Directed Acyclic Graph (DAG) of operators, where the level of parallelism of each operator has a…

Databases · Computer Science 2023-09-22 Jinqing Lian , Xinyi Zhang , Yingxia Shao , Zenglin Pu , Qingfeng Xiang , Yawen Li , Bin Cui

Users of heterogeneous computing systems face two problems: firstly, in understanding the trade-off relationships between the observable characteristics of their applications, such as latency and quality of the result, and secondly, how to…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-03-15 Gordon Inggs , David B. Thomas , Wayne Luk

We consider the commonly encountered situation (e.g., in weather forecasting) where the goal is to predict the time evolution of a large, spatiotemporally chaotic dynamical system when we have access to both time series data of previous…

Spatio-temporal machine learning is critically needed for a variety of societal applications, such as agricultural monitoring, hydrological forecast, and traffic management. These applications greatly rely on regional features that…

Machine Learning · Computer Science 2023-03-09 Zhexiong Liu , Licheng Liu , Yiqun Xie , Zhenong Jin , Xiaowei Jia

High-fidelity simulation of complex physical systems is exorbitantly expensive and inaccessible across spatiotemporal scales. Recently, there has been an increasing interest in leveraging deep learning to augment scientific data based on…

Machine Learning · Computer Science 2022-08-03 Pu Ren , Chengping Rao , Yang Liu , Zihan Ma , Qi Wang , Jian-Xun Wang , Hao Sun

Dynamic nature of the cloud environment has made distributed resource management process a challenge for cloud service providers. The importance of maintaining the quality of service in accordance with customer expectations as well as the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-08 Sara Kardani-Moghaddam , Rajkumar Buyya , Kotagiri Ramamohanarao