English
Related papers

Related papers: Towards Concurrent Stateful Stream Processing on M…

200 papers

Real-time Big Data architectures evolved into specialized layers for handling data streams' ingestion, storage, and processing over the past decade. Layered streaming architectures integrate pull-based read and push-based write RPC…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-14 Ovidiu-Cristian Marcu , Pascal Bouvry

Dataflow devices represent an avenue towards saving the control and data movement overhead of Load-Store Architectures. Various dataflow accelerators have been proposed, but how to efficiently schedule applications on such devices remains…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-06 Tiziano De Matteis , Lukas Gianinazzi , Johannes de Fine Licht , Torsten Hoefler

Fault-tolerance techniques for stream processing engines can be categorized into passive and active approaches. A typical passive approach periodically checkpoints a processing task's runtime states and can recover a failed task by…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-02-05 Li Su , Yongluan Zhou

Comprehending the performance bottlenecks at the core of the intricate hardware-software interactions exhibited by highly parallel programs on HPC clusters is crucial. This paper sheds light on the issue of automatically asynchronous MPI…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-06 Ayesha Afzal , Georg Hager , Stefano Markidis , Gerhard Wellein

Distributed Stream Processing Systems (DSPS) like Apache Storm and Spark Streaming enable composition of continuous dataflows that execute persistently over data streams. They are used by Internet of Things (IoT) applications to analyze…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-10 Shilpa Chaturvedi , Sahil Tyagi , Yogesh Simmhan

Operations over data streams typically hinge on efficient mechanisms to aggregate or summarize history on a rolling basis. For high-volume data steams, it is critical to manage state in a manner that is fast and memory efficient --…

Data Structures and Algorithms · Computer Science 2024-09-24 Matthew Andres Moreno , Luis Zaman , Emily Dolson

The immense growth of data demands switching from traditional data processing solutions to systems, which can process a continuous stream of real time data. Various applications employ stream processing systems to provide solutions to…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-06-07 Maninder Pal Singh , Mohammad A. Hoque , Sasu Tarkoma

Distributed stateful stream processing enables the deployment and execution of large scale continuous computations in the cloud, targeting both low latency and high throughput. One of the most fundamental challenges of this paradigm is…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-30 Paris Carbone , Gyula Fóra , Stephan Ewen , Seif Haridi , Kostas Tzoumas

In recent years, there has been an increasing interest in extending traditional stream processing engines with logical, rule-based, reasoning capabilities. This poses significant theoretical and practical challenges since rules can derive…

Artificial Intelligence · Computer Science 2018-11-16 Alessandro Ronca , Mark Kaminski , Bernardo Cuenca Grau , Boris Motik , Ian Horrocks

Networking is considered a datacenter tax, and hyperscalers push hard to provide high-performance networking with minimal resource expenditure. To keep up with the ever-increasing network rates, many CPU cycles are spent on the networking…

Hardware Architecture · Computer Science 2025-03-11 Amin Mamandipoor , Huy Dinh Tran , Mohammad Alian

Emerging distributed cloud architectures, e.g., fog and mobile edge computing, are playing an increasingly important role in the efficient delivery of real-time stream-processing applications (also referred to as augmented information…

Networking and Internet Architecture · Computer Science 2022-10-03 Yang Cai , Jaime Llorca , Antonia M. Tulino , Andreas F. Molisch

The development of cost-effective highperformance parallel computing on multi-processor supercomputers makes it attractive to port excessively time consuming simulation software from personal computers (PC) to super computes. The power…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Ning Lu , Z. Todd Taylor , David P. Chassin , Ross T. Guttromson , R. Scott Studham

Streaming computing effectively manages large-scale streaming data in real-time, making it ideal for applications such as real-time recommendations, anomaly detection, and monitoring, all of which require immediate processing. In this…

Databases · Computer Science 2024-11-26 Jinlong Hu , Tingfeng Qiu

We present TFORM, the version of the symbolic manipulation system FORM that can make simultaneous use of several processors in a shared memory architecture. The implementation uses Posix threads, also called pthreads, and is therefore…

High Energy Physics - Phenomenology · Physics 2014-11-18 M. Tentyukov , J. A. M. Vermaseren

Microprocessor roadmaps clearly show a trend towards multiple core CPUs. Modern operating systems already make use of these CPU architectures by distributing tasks between processing cores thereby increasing system performance. This review…

Software Engineering · Computer Science 2016-09-08 M. Vaidehi , T. R. Gopalakrishnan Nair

Event-based sensors are well suited for real-time processing due to their fast response times and encoding of the sensory data as successive temporal differences. These and other valuable properties, such as a high dynamic range, are…

Machine Learning · Computer Science 2024-10-10 Mark Schöne , Neeraj Mohan Sushma , Jingyue Zhuge , Christian Mayr , Anand Subramoney , David Kappel

DGCC protocol has been shown to achieve good performance on multi-core in-memory system. However, distributed transactions complicate the dependency resolution, and therefore, an effective transaction partitioning strategy is essential to…

Databases · Computer Science 2017-03-09 Chang Yao , Meihui Zhang , Qian Lin , Beng Chin Ooi , Jiatao Xu

Distributed Stream Processing systems are becoming an increasingly essential part of Big Data processing platforms as users grow ever more reliant on their ability to provide fast access to new results. As such, making timely decisions…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-27 Morgan K. Geldenhuys , Benjamin J. J. Pfister , Dominik Scheinert , Lauritz Thamsen , Odej Kao

This paper first presents a parallel solution for the Flowshop Scheduling Problem in parallel environment, and then proposes a novel load balancing strategy. The proposed Proportional Fairness Strategy (PFS) takes computational performance…

Networking and Internet Architecture · Computer Science 2008-09-22 Zheng Sun , Xiaohong Huang , Yan Ma

The demand for high performance embedded processors, for consumer electronics, is rapidly increasing for the past few years. Many of these embedded processors depend upon custom built Instruction Ser Architecture (ISA) such as game…

Hardware Architecture · Computer Science 2012-04-06 Muhammad Adeel Akram , Aamir Khan , Muhammad Masood Sarfaraz