English
Related papers

Related papers: Multi-tenant Pub/Sub Processing for Real-time Data…

200 papers

In this paper we introduce vFlow - A framework for rapid designing of batch processing applications for Cloud Computing environment. vFlow batch processing system extracts tasks from the vPlans diagrams, systematically captures the dynamics…

Software Engineering · Computer Science 2011-11-15 Hassan Gobjuka , Kamal Ahmat

Consider a network in which $n$ distributed nodes are connected to a single server. Each node continuously observes a data stream consisting of one value per discrete time step. The server has to continuously monitor a given parameter…

While ML model training and inference are both GPU-intensive, CPU-based data processing is often the bottleneck. Distributed data processing systems based on the batch or stream processing models assume homogeneous resource requirements.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-23 Frank Sifei Luan , Ron Yifeng Wang , Yile Gu , Ziming Mao , Charlotte Lin , Amog Kamsetty , Hao Chen , Cheng Su , Balaji Veeramani , Scott Lee , SangBin Cho , Clark Zinzow , Eric Liang , Ion Stoica , Stephanie Wang

Operations over data streams typically hinge on efficient mechanisms to aggregate or summarize history on a rolling basis. For high-volume data steams, it is critical to manage state in a manner that is fast and memory efficient --…

Data Structures and Algorithms · Computer Science 2024-09-24 Matthew Andres Moreno , Luis Zaman , Emily Dolson

Multi-mode real-time systems are those which support applications with different modes of operation, where each mode is characterized by a specific set of tasks. At run-time, such systems can, at any time, be requested to switch from its…

Operating Systems · Computer Science 2015-03-18 Vincent Nelis , Patrick Meumeu Yomsi , Björn Andersson , Joël Goossens

Real-time systems applications usually consist of a set of concurrent activities with timing-related properties. Developing these applications requires programming paradigms that can effectively handle the specification of concurrent…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-21 Luis Miguel Pinho

Pull-stream is a JavaScript demand-driven functional design pattern based on callback functions that enables the creation and easy composition of independent modules that are used to create streaming applications. It is used in popular open…

Programming Languages · Computer Science 2018-01-19 Erick Lavoie , Laurie Hendren

The behaviour produced by an instruction sequence under execution is a behaviour to be controlled by some execution environment: each step performed actuates the processing of an instruction by the execution environment and a reply returned…

Programming Languages · Computer Science 2009-05-15 J. A. Bergstra , C. A. Middelburg

The society produces textual data online in several ways, e.g., via reviews and social media posts. Therefore, numerous researchers have been working on discovering patterns in textual data that can indicate peoples' opinions, interests,…

Multipath TCP (MPTCP) can exploit multiple available interfaces at the end devices by establishing concurrent multiple connections between source and destination. MPTCP is a drop-in replacement for TCP and this makes it an attractive choice…

Networking and Internet Architecture · Computer Science 2017-07-14 Abhijit Mondal , Aniruddh K , Samar Shailendra

Processing data received as a stream is a task commonly performed by modern embedded devices, in a wide range of applications such as multimedia (encoding/decoding/ playing media), networking (switching and routing), digital security,…

Hardware Architecture · Computer Science 2014-03-31 I. B. Nawinne , M. S. Wickramasinghe , R. G. Ragel , S. Radhakrishnan

Distributed Stream Processing (DSP) focuses on the near real-time processing of large streams of unbounded data. To increase processing capacities, DSP systems are able to dynamically scale across a cluster of commodity nodes, ensuring a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-05 Morgan Geldenhuys , Dominik Scheinert , Odej Kao , Lauritz Thamsen

Data warehouses are overwhelmingly built through a bottom-up process, which starts with the identification of sources, continues with the extraction and transformation of data from these sources, and then loads the data into a set of data…

Databases · Computer Science 2010-09-02 Flavio Rizzolo , Iluju Kiringa , Rachel Pottinger , Kwok Wong

Web 2.0 applications like Twitter or Facebook create a continuous stream of information. This demands new ways of analysis in order to offer insight into this stream right at the moment of the creation of the information, because lots of…

Information Retrieval · Computer Science 2013-07-01 Andreas Bauer , Christian Wolff

Data communication in cloud-based distributed stream data analytics often involves a collection of parallel and pipelined TCP flows. As the standard TCP congestion control mechanism is designed for achieving "fairness" among competing flows…

Networking and Internet Architecture · Computer Science 2019-08-08 Walid Aljoby , Xin Wang , Tom Z. J. Fu , Richard T. B. Ma

Real-time text processing systems are required in many domains to quickly identify patterns, trends, sentiments, and insights. Nowadays, social networks, e-commerce stores, blogs, scientific experiments, and server logs are main sources…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-12-13 Hassan Nazeer , Waheed Iqbal , Fawaz Bokhari , Faisal Bukhari , Shuja Ur Rehman Baig

Embedded real-time devices for monitoring, controlling, and collaboration purposes in cyber-physical systems are now commonly equipped with IP networking capabilities. However, the reception and processing of IP packets generates workloads…

Networking and Internet Architecture · Computer Science 2023-05-12 Ilja Behnke , Christoph Blumschein , Robert Danicki , Philipp Wiesner , Lauritz Thamsen , Odej Kao

Automated machine learning techniques benefited from tremendous research progress in recently. These developments and the continuous-growing demand for machine learning experts led to the development of numerous AutoML tools. However, these…

Machine Learning · Computer Science 2021-06-15 Alexandru-Ionut Imbrea

Stream applications are widely deployed on the cloud. While modern distributed streaming systems like Flink and Spark Streaming can schedule and execute them efficiently, streaming dataflows are often dynamically changing, which may cause…

Systems and Control · Electrical Eng. & Systems 2021-03-17 Pengqi Lu , Liang Yuan , Yunquan Zhang , Hang Cao , Kun Li

Transactional Stream Processing Engines (TSPEs) form the backbone of modern stream applications handling shared mutable states. Yet, the full potential of these systems, specifically in exploiting parallelism and implementing dynamic…

Databases · Computer Science 2023-07-25 Yancan Mao , Jianjun Zhao , Zhonghao Yang , Shuhao Zhang , Haikun Liu , Volker Markl