English
Related papers

Related papers: A Scalable and Robust Framework for Data Stream In…

200 papers

Emerging Big Data analytics and machine learning applications require a significant amount of computational power. While there exists a plethora of large-scale data processing frameworks which thrive in handling the various complexities of…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-26 Jan S. Rellermeyer , Sobhan Omranian Khorasani , Dan Graur , Apourva Parthasarathy

Data stream processing frameworks provide reliable and efficient mechanisms for executing complex workflows over large datasets. A common challenge for the majority of currently available streaming frameworks is efficient utilization of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-30 Oliver Stein , Ben Blamey , Johan Karlsson , Alan Sabirsh , Ola Spjuth , Andreas Hellander , Salman Toor

Software as a service (SaaS) has recently enjoyed much attention as it makes the use of software more convenient and cost-effective. At the same time, the arising of users' expectation for high quality service such as real-time information…

Software Engineering · Computer Science 2016-04-13 Feng-Lin Li , Chi-Hung Chi , Yue Wang , Cong Liu

Big Data today is being generated at an unprecedented rate from various sources such as sensors, applications, and devices, and it often needs to be enriched based on other reference information to support complex analytical queries.…

Databases · Computer Science 2020-08-18 Xikui Wang , Michael J. Carey

Streaming, big data applications face challenges in creating scalable data flow pipelines, in which multiple data streams must be collected, stored, queried, and analyzed. These data sources are characterized by their volume (in terms of…

Databases · Computer Science 2014-07-23 Scott M. Sawyer , B. David O'Gwynn

Smart city management is going through a remarkable transition, in terms of quality and diversity of services provided to the end-users. The stakeholders that deliver pervasive applications are now able to address fundamental challenges in…

Networking and Internet Architecture · Computer Science 2024-10-28 Theofanis P. Raptis , Claudio Cicconetti , Manolis Falelakis , Tassos Kanellos , Tomás Pariente Lobo

Due to recent advances in data collection techniques, massive amounts of data are being collected at an extremely fast pace. Also, these data are potentially unbounded. Boundless streams of data collected from sensors, equipments, and other…

Databases · Computer Science 2012-03-12 T Soni Madhulatha

The study of continuous-time information diffusion has been an important area of research for many applications in recent years. When only the diffusion traces (cascades) are accessible, cascade-based network inference and influence…

Social and Information Networks · Computer Science 2024-05-22 Keke Huang , Ruize Gao , Bogdan Cautis , Xiaokui Xiao

While several attempts have been made to construct a scalable and flexible architecture for analysis of streaming data, no general model to tackle this task exists. Thus, our goal is to build a scalable and maintainable architecture for…

Software Engineering · Computer Science 2019-07-22 Sheik Hoque , Andriy Miranskyy

The Internet of Things describes a network of physical devices interacting and producing vast streams of sensor data. At present there are a number of general challenges which exist while developing solutions for use cases involving the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-25 Morgan K. Geldenhuys , Jonathan Will , Benjamin J. J. Pfister , Martin Haug , Alexander Scharmann , Lauritz Thamsen

Modern digital applications extensively integrate Artificial Intelligence models into their core systems, offering significant advantages for automated decision-making. However, these AI-based systems encounter reliability and safety…

Machine Learning · Computer Science 2024-11-05 Marcos Barcina-Blanco , Jesus L. Lobo , Pablo Garcia-Bringas , Javier Del Ser

The increasing complexity of IoT applications and the continuous growth in data generated by connected devices have led to significant challenges in managing resources and meeting performance requirements in computing continuum…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-22 Sergio Laso , Ilir Murturi , Pantelis Frangoudis , Juan Luis Herrera , Juan M. Murillo , Schahram Dustdar

Real-time Big Data architectures evolved into specialized layers for handling data streams' ingestion, storage, and processing over the past decade. Layered streaming architectures integrate pull-based read and push-based write RPC…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-14 Ovidiu-Cristian Marcu , Pascal Bouvry

Human beings keep exploring the physical space using information means. Only recently, with the rapid development of information technologies and the increasing accumulation of data, human beings can learn more about the unknown world with…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-24 Tongya Zheng , Gang Chen , Xinyu Wang , Chun Chen , Xingen Wang , Sihui Luo

Data stream algorithms tackle operations on high-volume sequences of read-once data items. Data stream scenarios include inherently real-time systems like sensor networks and financial markets. They also arise in purely-computational…

Data Structures and Algorithms · Computer Science 2024-03-04 Matthew Andres Moreno , Santiago Rodriguez Papa , Emily Dolson

Data streaming relies on continuous queries to process unbounded streams of data in a real-time fashion. It is commonly demanding in computation capacity, given that the relevant applications involve very large volumes of data. Data…

Data Structures and Algorithms · Computer Science 2016-06-16 Vincenzo Gulisano , Yiannis Nikolakopoulos , Daniel Cederman , Marina Papatriantafilou , Philippas Tsigas

This paper introduces a scheme for data stream processing which is robust to batch duration. Streaming frameworks process streams in batches retrieved at fixed time intervals. In a common setting a pattern recognition algorithm is applied…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-20 David Tolpin

Data is a precious resource in today's society, and is generated at an unprecedented and constantly growing pace. The need to store, analyze, and make data promptly available to a multitude of users introduces formidable challenges in…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-08 Alessandro Margara , Gianpaolo Cugola , Nicolò Felicioni , Stefano Cilloni

Objective: To (1) demonstrate the implementation of a data science platform built on open-source technology within a large, academic healthcare system and (2) describe two computational healthcare applications built on such a platform.…

Efficient data streaming is essential for real-time data analytics, visualization, and machine learning model training, particularly when dealing with high-volume datasets. Various streaming technologies and serialization protocols have…

Software Engineering · Computer Science 2024-11-05 Samuel Jackson , Nathan Cummings , Saiful Khan