English
Related papers

Related papers: Resource Usage Estimation of Data Stream Processin…

200 papers

Dataset distillation provides an effective approach to reduce memory and computational costs by optimizing a compact dataset that achieves performance comparable to the full original. However, for large-scale datasets and complex deep…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Xinhao Zhong , Shuoyang Sun , Xulin Gu , Zhaoyang Xu , Yaowei Wang , Min Zhang , Bin Chen

In data stream clustering, systematic theory of stream clustering algorithms remains relatively scarce. Recently, density-based methods have gained attention. However, existing algorithms struggle to simultaneously handle arbitrarily…

Machine Learning · Computer Science 2026-05-07 Qifen Zeng , Haomin Bao , Yuanzhuo Hu , Zirui Zhang , Yuheng Zheng , Luosheng Wen

With an ever growing number of heterogeneous applicational services running on equally heterogeneous computational systems, the problem of resource management becomes more essential. Although current solutions consider some network and time…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-05 Rui Eduardo Lopes , Duarte Raposo , Pedro V. Teixeira , Susana Sargento

To improve customer experience, datacenter operators offer support for simplifying application and resource management. For example, running workloads of workflows on behalf of customers is desirable, but requires increasingly more…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-27 Laurens Versluis , Mihai Neacşu , Alexandru Iosup

With the increasing popularity of Internet-based services and applications, power efficiency is becoming a major concern for data center operators, as high electricity consumption not only increases greenhouse gas emissions, but also…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-03-19 Dmytro Dyachuk , Michele Mazzucco

Many dynamic applications are built upon large network infrastructures, such as social networks, communication networks, biological networks and the Web. Such applications create data that can be naturally modeled as graph streams, in which…

Databases · Computer Science 2011-12-01 Peixiang Zhao , Charu C. Aggarwal , Min Wang

Parallel multiphysics simulations often suffer from load imbalances originating from the applied coupling of algorithms with spatially and temporally varying workloads. It is thus desirable to minimize these imbalances to reduce the time to…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-03 Christoph Rettinger , Ulrich Rüde

Extract-Transform-Load (ETL) processes are core components of modern data processing infrastructures. The throughput of processed data records can be adjusted by changing the amount of allocated resources, i.e.~the number of parallel…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-01 Levin Maier , Lucas Schulze , Robert Lilow , Lukas Hahn , Nikola Krasowski , Arnulf Barth , Sebastian Gaebel , Ferdi Güran , Oliver Hanau , Giovanni Wagner , Falk Borgmann , Oleg Arenz , Jan Peters

Nowadays, data-centers are largely under-utilized because resource allocation is based on reservation mechanisms which ignore actual resource utilization. Indeed, it is common to reserve resources for peak demand, which may occur only for a…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-03 Francesco Pace , Dimitrios Milios , Damiano Carra , Daniele Venzano , Pietro Michiardi

Energy consumption represents a significant cost in data center operation. A large fraction of the energy, however, is used to power idle servers when the workload is low. Dynamic provisioning techniques aim at saving this portion of the…

Performance · Computer Science 2012-02-28 Tan Lu , Minghua Chen

In this paper we consider the problem of estimating quantiles when data are received sequentially (data stream). For real life data streams, the distribution of the data typically varies with time making estimation of quantiles challenging.…

Methodology · Statistics 2017-02-02 Hugo Lewi Hammer , Anis Yazidi , Håvard Rue

Datacenter capacity is growing exponentially to satisfy the increasing demand for emerging computationally-intensive applications, such as deep learning. This trend has led to concerns over datacenters' increasing energy consumption and…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-25 Xiaoding Guan , Noman Bashir , David Irwin , Prashant Shenoy

One of the most fundamental tasks in data science is to assist a user with unknown preferences in finding high-utility tuples within a large database. To accurately elicit the unknown user preferences, a widely-adopted way is by asking the…

Databases · Computer Science 2023-07-07 Guangyi Zhang , Nikolaj Tatti , Aristides Gionis

Cloud service providers commonly use standard benchmarks like TPC-H and TPC-DS to evaluate and optimize cloud data analytics systems. However, these benchmarks rely on fixed query patterns and fail to capture the real execution statistics…

Co-scheduling of jobs in data-centers is a challenging scenario, where jobs can compete for resources yielding to severe slowdowns or failed executions. Efficient job placement on environments where resources are shared requires awareness…

Machine Learning · Computer Science 2020-07-07 David Buchaca Prats , Joan Marcual , Josep Lluís Berral , David Carrera

The proposed RMS-FlowNet is a novel end-to-end learning-based architecture for accurate and efficient scene flow estimation which can operate on point clouds of high density. For hierarchical scene flow estimation, the existing methods…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Ramy Battrawy , René Schuster , Mohammad-Ali Nikouei Mahani , Didier Stricker

Key-based workload partitioning is a common strategy used in parallel stream processing engines, enabling effective key-value tuple distribution over worker threads in a logical operator. While randomized hashing on the keys is capable of…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-12-14 Junhua Fang , Rong Zhang , Tom Z. J. Fu , Zhenjie Zhang , Aoying Zhou , Junhua Zhu

With the rapid growth in the number of devices of the Internet of Things (IoT), the volume and types of stream data are rapidly increasing in the real world. Unfortunately, the stream data has the characteristics of infinite and periodic…

Performance · Computer Science 2022-12-13 Weirong Xiu , Baozhu Li , Xusheng Du , Zheng Chu

Data is a precious resource in today's society, and is generated at an unprecedented and constantly growing pace. The need to store, analyze, and make data promptly available to a multitude of users introduces formidable challenges in…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-08 Alessandro Margara , Gianpaolo Cugola , Nicolò Felicioni , Stefano Cilloni

Cloud computing recently developed into a viable alternative to on-premises systems for executing high-performance computing (HPC) applications. With the emergence of new vendors and hardware options, there is now a growing need to…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-14 Mohammad Mohammadi , Timur Bazhirov