English
Related papers

Related papers: A Scalable and Robust Framework for Data Stream In…

200 papers

Modern scientific instruments generate data at rates that increasingly exceed local compute capabilities and, when paired with the staging and I/O overheads of file-based transfers, also render file-based use of remote HPC resources…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-01 Flavio Castro , Weijian Zheng , Joaquin Chung , Ian Foster , Rajkumar Kettimuthu

For many modern applications in science and engineering, data are collected in a streaming fashion carrying time-varying information, and practitioners need to process them with a limited amount of memory and computational resources in a…

Machine Learning · Statistics 2018-06-13 Laura Balzano , Yuejie Chi , Yue M. Lu

The shift toward IoT-enabled, sensor-driven systems has transformed how operational data is generated, favoring continuous, real-time event streams (ES) over static event logs. This evolution presents new challenges for Streaming Process…

Analyzing textual data is a very challenging task because of the huge volume of data generated daily. Fundamental issues in text analysis include the lack of structure in document datasets, the need for various preprocessing steps %(e.g.,…

Databases · Computer Science 2016-12-20 Ciprian-Octavian Truică , Jérôme Darmont , Julien Velcin

Data streams occur widely in various real world applications. The research on streaming data mainly focuses on the data management, query evaluation and optimization on these data, however the work on reasoning procedures for streaming…

Logic in Computer Science · Computer Science 2018-08-19 Gulay Unel

Unstructured data, such as news and blogs, can provide valuable insights into the financial world. We present the NewsStream portal, an intuitive and easy-to-use tool for news analytics, which supports interactive querying and…

Information Retrieval · Computer Science 2015-11-10 Petra Kralj Novak , Miha Grcar , Borut Sluban , Igor Mozetic

The paper explores the challenges of regression analysis in evolving data streams, an area that remains relatively underexplored compared to classification. We propose a standardized evaluation process for regression and prediction interval…

Machine Learning · Computer Science 2025-02-20 Yibin Sun , Heitor Murilo Gomes , Bernhard Pfahringer , Albert Bifet

In the era of big data, managing dynamic data flows efficiently is crucial as traditional storage models struggle with real-time regulation and risk overflow. This paper introduces Data Dams, a novel framework designed to optimize data…

Streaming analysis is widely used in cloud as well as edge infrastructures. In these contexts, fine-grained application performance can be based on accurate modeling of streaming operators. This is especially beneficial for computationally…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-30 Hannaneh Najdataei , Vincenzo Gulisano , Alessandro V. Papadopoulos , Ivan Walulya , Marina Papatriantafilou , Philippas Tsigas

Modern cloud architectures demand self-adaptive capabilities to manage dynamic operational conditions. Yet, existing solutions often impose centralized control models ill-suited to microservices decentralized nature. This paper presents…

Software Engineering · Computer Science 2025-12-30 Brice Arléon Zemtsop Ndadji , Simon Bliudze , Clément Quinton

We present the design and development of a data stream system that captures data uncertainty from data collection to query processing to final result generation. Our system focuses on data that is naturally modeled as continuous random…

Databases · Computer Science 2009-09-15 Yanlei Diao , Boduo Li , Anna Liu , Liping Peng , Charles Sutton , Thanh Tran , Michael Zink

Growing data volumes and velocities in fields such as Industry 4.0 or the Internet of Things have led to the increased popularity of data stream processing systems. Enterprises can leverage these developments by enriching their core…

Performance · Computer Science 2021-03-12 Guenter Hesse , Christoph Matthies , Michael Perscheid , Matthias Uflacker , Hasso Plattner

Assessing and improving the quality of data are fundamental challenges for data-intensive systems that have given rise to applications targeting transformation and cleaning of data. However, while schema design, data cleaning, and data…

Databases · Computer Science 2017-03-28 Rada Chirkova , Jon Doyle , Juan L. Reutter

In recent years, stream data have become an immensely growing area of research for the database, computer science and data mining communities. Stream data is an ordered sequence of instances. In many applications of data stream mining data…

Databases · Computer Science 2014-02-10 Nishant Vadnere , R. G. Mehta , D. P. Rana , N. J. Mistry , M. M. Raghuwanshi

As information becomes increasingly sizable for organizations to maintain the challenge of organizing data still remains. More importantly, the on-going process of analysing incoming data occurs on a continual basis and organizations should…

Databases · Computer Science 2021-05-19 Bryar A. Hassan , Shko M. Qader

Although cloud computing offers many advantages with regards to adaption of resources, we witness either a strong resistance or a very slow adoption to those new offerings. One reason for the resistance is that (i) many technologies such as…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-05-19 André Martin , Andrey Britoy , Christof Fetzer

Training machine learning models requires feeding input data for models to ingest. Input pipelines for machine learning jobs are often challenging to implement efficiently as they require reading large volumes of data, applying complex…

Machine Learning · Computer Science 2021-02-25 Derek G. Murray , Jiri Simsa , Ana Klimovic , Ihor Indyk

Understanding and tuning the performance of extreme-scale parallel computing systems demands a streaming approach due to the computational cost of applying offline algorithms to vast amounts of performance log data. Analyzing large…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-28 Suraj P. Kesavan , Takanori Fujiwara , Jianping Kelvin Li , Caitlin Ross , Misbah Mubarak , Christopher D. Carothers , Robert B. Ross , Kwan-Liu Ma

Historically, machine learning training pipelines have predominantly relied on batch training models, retraining models every few hours. However, industrial practitioners have proved that real-time training can lead to a more adaptive and…

Software Engineering · Computer Science 2024-10-22 Srijan Saket , Vivek Chandela , Md. Danish Kalim

The growing adoption of distributed data processing frameworks in a wide diversity of application domains challenges end-to-end integration of properties like security, in particular when considering deployments in the context of…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-07 Aurélien Havet , Rafael Pires , Pascal Felber , Marcelo Pasin , Romain Rouvoy , Valerio Schiavoni