English
Related papers

Related papers: Model-driven Scheduling for Distributed Stream Pro…

200 papers

Modern applications increasingly rely on inference serving systems to provide low-latency insights with a diverse set of machine learning models. Existing systems often utilize resource elasticity to scale with demand. However, many…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-13 Joel Wolfrath , Daniel Frink , Abhishek Chandra

As a typical Cyber-Physical System (CPS), smart water distribution networks require monitoring of underground water pipes with high sample rates for precise data analysis and water network control. Due to poor underground wireless channel…

Social and Information Networks · Computer Science 2017-03-30 Sokratis Kartakis , Shusen Yang , Julie A. McCann

We introduce BriskStream, an in-memory data stream processing system (DSPSs) specifically designed for modern shared-memory multicore architectures. BriskStream's key contribution is an execution plan optimization paradigm, namely RLAS,…

Databases · Computer Science 2019-04-10 Shuhao Zhang , Jiong He , Amelie Chi Zhou , Bingsheng He

Data processing frameworks such as Apache Beam and Apache Spark are used for a wide range of applications, from logs analysis to data preparation for DNN training. It is thus unsurprising that there has been a large amount of work on…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-07 Ubaid Ullah Hafeez , Martin Maas , Mustafa Uysal , Richard McDougall

Serverless computing has gained popularity in edge computing due to its flexible features, including the pay-per-use pricing model, auto-scaling capabilities, and multi-tenancy support. Complex Serverless-based applications typically rely…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-01 Ke Luo , Tao Ouyang , Zhi Zhou , Xu Chen

Data stream processing frameworks provide reliable and efficient mechanisms for executing complex workflows over large datasets. A common challenge for the majority of currently available streaming frameworks is efficient utilization of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-30 Oliver Stein , Ben Blamey , Johan Karlsson , Alan Sabirsh , Ola Spjuth , Andreas Hellander , Salman Toor

The demand for distributed applications has significantly increased over the past decade, with improvements in machine learning techniques fueling this growth. These applications predominantly utilize Cloud data centers for high-performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-02 Narges Mehran , Dragi Kimovski , Hermann Hellwagner , Dumitru Roman , Ahmet Soylu , Radu Prodan

Data is rapidly increasing in volume and velocity and the Internet of Things (IoT) is one important source of this data. The IoT is a collection of connected devices (things) which are constantly recording data from their surroundings using…

Methodology · Statistics 2016-09-05 Jonathan Law , Darren Wilkinson

Querying very large RDF data sets in an efficient manner requires a sophisticated distribution strategy. Several innovative solutions have recently been proposed for optimizing data distribution with predefined query workloads. This paper…

Databases · Computer Science 2015-07-10 Olivier Curé , Hubert Naacke , Mohamed-Amine Baazizi , Bernd Amann

Several high-throughput distributed data-processing applications require multi-hop processing of streams of data. These applications include continual processing on data streams originating from a network of sensors, composing a multimedia…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-03-26 Shah Asaduzzaman , Muthucumaru Maheswaran

This paper considers the problem of resource allocation in stream processing, where continuous data flows must be processed in real time in a large distributed system. To maximize system throughput, the resource allocation strategy that…

Machine Learning · Computer Science 2019-11-21 Xiang Ni , Jing Li , Mo Yu , Wang Zhou , Kun-Lung Wu

With the continuous increase of IoT applications, their effective scheduling in edge and cloud computing has become a critical challenge. The inherent dynamism and stochastic characteristics of edge and cloud computing, along with IoT…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-01 Zhiyu Wang , Mohammad Goudarzi , Rajkumar Buyya

The demand for stream processing is increasing at an unprecedented rate. Big data is no longer limited to processing of big volumes of data. In most real-world scenarios, the need for processing stream data as it comes can only meet the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-27 Ayush Singhal , Rakesh Pant , Pradeep Sinha

Emerging distributed cloud architectures, e.g., fog and mobile edge computing, are playing an increasingly important role in the efficient delivery of real-time stream-processing applications (also referred to as augmented information…

Networking and Internet Architecture · Computer Science 2022-10-03 Yang Cai , Jaime Llorca , Antonia M. Tulino , Andreas F. Molisch

Fog computing extends the cloud computing paradigm by allocating substantial portions of computations and services towards the edge of a network, and is, therefore, particularly suitable for large-scale, geo-distributed, and data-intensive…

Signal Processing · Electrical Eng. & Systems 2019-12-03 Guangxia Li , Peilin Zhao , Xiao Lu , Jia Liu , Yulong Shen

Presence of a logically centralized controller in software-defined networks enables smart and fine-grained management of network traffic. Generally, traffic management includes measurement, analysis and control of traffic in order to…

Networking and Internet Architecture · Computer Science 2017-03-14 Hamidreza Almasi , Hossein Ajorloo

We propose nnstreamer, a software system that handles neural networks as filters of stream pipelines, applying the stream processing paradigm to neural network applications. A new trend with the wide-spread of deep neural network…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-16 MyungJoo Ham , Ji Joong Moon , Geunsik Lim , Wook Song , Jaeyun Jung , Hyoungjoo Ahn , Sangjung Woo , Youngchul Cho , Jinhyuck Park , Sewon Oh , Hong-Seok Kim

Dynamic Adaptive Streaming over HTTP (DASH) is a recently proposed standard that offers different versions of the same media content to adapt the delivery process over the Internet to dynamic bandwidth fluctuations and different user device…

Networking and Internet Architecture · Computer Science 2016-11-17 Laura Natali , Maria Luisa Merani

Processing data at high speeds is becoming increasingly critical as digital economies generate enormous data. The current paradigms for timely data processing are edge computing and data stream processing (DSP). Edge computing places…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-22 Eugene Armah , Linda Amoako Bannning

Fault tolerance is critical for distributed stream processing systems, yet achieving error-free fault tolerance often incurs substantial performance overhead. We present AF-Stream, a distributed stream processing system that addresses the…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-13 Zhinan Cheng , Qun Huang , Patrick P. C. Lee