中文
相关论文

相关论文: Building Analytics Pipelines for Querying Big Stre…

200 篇论文

To conduct real-time analytics computations, big data stream processing engines are required to process unbounded data streams at millions of events per second. However, current streaming engines exhibit low throughput and high tuple…

分布式、并行与集群计算 · 计算机科学 2023-08-11 Shinhyung Yang , Jiun Jeong , Bernhard Scholz , Bernd Burgstaller

We present Pathway, a new unified data processing framework that can run workloads on both bounded and unbounded data streams. The framework was created with the original motivation of resolving challenges faced when analyzing and…

Process management and process orchestration/execution are currently hot topics; prevalent trends such as automation and Industry 4.0 require solutions which allow domain-experts to easily model and execute processes in various domains,…

Edge applications generate a large influx of sensor data on massive scales, and these massive data streams must be processed shortly to derive actionable intelligence. However, traditional data processing systems are not well-suited for…

数据库 · 计算机科学 2025-07-31 Cheng-Wei Ching , Xin Chen , Chaeeun Kim , Tongze Wang , Dong Chen , Dilma Da Silva , Liting Hu

Stream computing is the use of multiple autonomic and parallel modules together with integrative processors at a higher level of abstraction to embody "intelligent" processing. The biological basis of this computing is sketched and the…

人工智能 · 计算机科学 2008-01-10 Subhash Kak

Big data trend has enforced the data-centric systems to have continuous fast data streams. In recent years, real-time analytics on stream data has formed into a new research field, which aims to answer queries about what-is-happening-now…

机器学习 · 统计学 2016-12-28 Amir Hossein Akhavan Rahnama

Industry 4.0 is becoming more and more important for manufacturers as the developments in the area of Internet of Things advance. Another technology gaining more attention is data stream processing systems. Although such streaming…

数据库 · 计算机科学 2020-07-20 Guenter Hesse , Werner Sinzig , Christoph Matthies , Matthias Uflacker

Data streaming relies on continuous queries to process unbounded streams of data in a real-time fashion. It is commonly demanding in computation capacity, given that the relevant applications involve very large volumes of data. Data…

数据结构与算法 · 计算机科学 2016-06-16 Vincenzo Gulisano , Yiannis Nikolakopoulos , Daniel Cederman , Marina Papatriantafilou , Philippas Tsigas

Analysis of microservices' performance is a considerably challenging task due to the multifaceted nature of these systems. Each request to a microservices system might raise several Remote Procedure Calls (RPCs) to services deployed on…

软件工程 · 计算机科学 2024-04-23 Luca Traini , Jessica Leone , Giovanni Stilo , Antinisca Di Marco

Stream Processing (SP) has evolved as the leading paradigm to process and gain value from the high volume of streaming data produced e.g. in the domain of the Internet of Things. An SP system is a middleware that deploys a network of…

分布式、并行与集群计算 · 计算机科学 2019-01-30 Henriette Röger , Ruben Mayer

Academic research tends to focus on new models for document understanding creating a wide gap in the literature between model definition and running models at production scale. To close that gap, we present a microservice architecture that…

The rapid technological advances in the Internet of Things (IoT) allows the blueprint of Smart Cities to become feasible by integrating heterogeneous cloud/fog/edge computing paradigms to collaboratively provide variant smart services in…

分布式、并行与集群计算 · 计算机科学 2020-04-07 Qian Qu , Ronghua Xu , Seyed Yahya Nikouei , Yu Chen

Despite many advances in query optimization, indexing techniques, and data storage, modern data platforms still face difficulties in delivering robust query performance under high concurrency and computationally intensive queries. This…

数据库 · 计算机科学 2026-03-06 Adriano Vogel , Sören Henning , Otmar Ertl

The emergence of the Internet of Things has seen the introduction of numerous connected devices used for the monitoring and control of even Critical Infrastructures. Distributed stream processing has become key to analyzing data generated…

分布式、并行与集群计算 · 计算机科学 2021-02-26 Morgan Geldenhuys , Lauritz Thamsen , Kain Kordian Gontarska , Felix Lorenz , Odej Kao

As more and more devices connect to Internet of Things, unbounded streams of data will be generated, which have to be processed "on the fly" in order to trigger automated actions and deliver real-time services. Spark Streaming is a popular…

分布式、并行与集群计算 · 计算机科学 2018-09-12 Jia-Chun Lin , Ming-Chang Lee , Ingrid Chieh Yu , Einar Broch Johnsen

Streaming data can arise from a variety of contexts. Important use cases are continuous sensor measurements such as temperature, light or radiation values. In the process, streaming data may also contain data errors that should be cleaned…

数据库 · 计算机科学 2025-07-29 Valerie Restat , Niklas Rodenhausen , Carina Antonin , Uta Störl

The rise of real-time data and the proliferation of Internet of Things (IoT) devices have highlighted the limitations of cloud-centric solutions, particularly regarding latency, bandwidth, and privacy. These challenges have driven the…

分布式、并行与集群计算 · 计算机科学 2025-10-08 Clarisse Sousa , Tiago Fonseca , Luis Lino Ferreira , Ricardo Venâncio , Ricardo Severino

The pervasive availability of streaming data is driving interest in distributed Fast Data platforms for streaming applications. Such latency-sensitive applications need to respond to dynamism in the input rates and task behavior using…

分布式、并行与集群计算 · 计算机科学 2018-03-28 Nanjangud C. Narendra , Sambit Nayak , Anshu Shukla

Data stream processing is an increasingly important topic due to the prevalence of smart devices and the demand for real-time analytics. Geo-distributed streaming systems, where cloud-based queries utilize data streams from multiple…

分布式、并行与集群计算 · 计算机科学 2022-11-22 Joel Wolfrath , Abhishek Chandra

Real-time text processing systems are required in many domains to quickly identify patterns, trends, sentiments, and insights. Nowadays, social networks, e-commerce stores, blogs, scientific experiments, and server logs are main sources…

分布式、并行与集群计算 · 计算机科学 2017-12-13 Hassan Nazeer , Waheed Iqbal , Fawaz Bokhari , Faisal Bukhari , Shuja Ur Rehman Baig