中文
相关论文

相关论文: Better Write Amplification for Streaming Data Proc…

200 篇论文

The shift toward IoT-enabled, sensor-driven systems has transformed how operational data is generated, favoring continuous, real-time event streams (ES) over static event logs. This evolution presents new challenges for Streaming Process…

Today, massive amounts of streaming data from smart devices need to be analyzed automatically to realize the Internet of Things. The Complex Event Processing (CEP) paradigm promises low-latency pattern detection on event streams. However,…

分布式、并行与集群计算 · 计算机科学 2017-06-27 Christian Mayer , Ruben Mayer , Majd Abdo

In many emerging applications, data streams are monitored in a network environment. Due to limited communication bandwidth and other resource constraints, a critical and practical demand is to online compress data streams continuously with…

数据结构与算法 · 计算机科学 2008-12-01 Emad Soroush , Kui Wu , Jian Pei

We introduce a novel algorithm to perform graph clustering in the edge streaming setting. In this model, the graph is presented as a sequence of edges that can be processed strictly once. Our streaming algorithm has an extremely low memory…

机器学习 · 计算机科学 2017-12-13 Alexandre Hollocou , Julien Maudet , Thomas Bonald , Marc Lelarge

Graph processing has become an important part of various areas of computing, including machine learning, medical applications, social network analysis, computational sciences, and others. A growing amount of the associated graph processing…

分布式、并行与集群计算 · 计算机科学 2023-08-01 Maciej Besta , Marc Fischer , Vasiliki Kalavri , Michael Kapralov , Torsten Hoefler

Distributed data processing platforms for cloud computing are important tools for large-scale data analytics. Apache Hadoop MapReduce has become the de facto standard in this space, though its programming interface is relatively low-level,…

分布式、并行与集群计算 · 计算机科学 2018-03-30 Bilal Akil , Ying Zhou , Uwe Röhm

In this paper we consider the operator mapping problem for in-network stream processing applications. In-network stream processing consists in applying a tree of operators in steady-state to multiple data objects that are continually…

分布式、并行与集群计算 · 计算机科学 2008-07-11 Anne Benoit , Henri Casanova , Veronika Rehn-Sonigo , Yves Robert

We present the stream processing library that achieves the highest performance of existing OCaml streaming libraries, attaining the speed and memory efficiency of hand-written state machines. It supports finite and infinite streams with the…

编程语言 · 计算机科学 2022-11-28 Oleg Kiselyov , Tomoaki Kobayashi , Aggelos Biboudis , Nick Palladinos

The exponential growth of data in current times and the demand to gain information and knowledge from the data present new challenges for database researchers. Known database systems and algorithms are no longer capable of effectively…

数据库 · 计算机科学 2017-12-06 Yaron Gonen

Event processing will play an increasingly important role in constructing enterprise applications that can immediately react to business critical events. Various technologies have been proposed in recent years, such as event processing,…

数据库 · 计算机科学 2007-05-23 Roger S. Barga , Jonathan Goldstein , Mohamed Ali , Mingsheng Hong

When IP-packet processing is unconditionally carried out on behalf of an operating system kernel thread, processing systems can experience overload in high incoming traffic scenarios. This is especially worrying for embedded real-time…

网络与互联网体系结构 · 计算机科学 2022-04-20 Christoph Blumschein , Ilja Behnke , Lauritz Thamsen , Odej Kao

Graph partitioning is an important preprocessing step to distributed graph processing. In edge partitioning, the edge set of a given graph is split into $k$ equally-sized partitions, such that the replication of vertices across partitions…

分布式、并行与集群计算 · 计算机科学 2020-01-22 Ruben Mayer , Kamil Orujzade , Hans-Arno Jacobsen

MapReduce, the popular programming paradigm for large-scale data processing, has traditionally been deployed over tightly-coupled clusters where the data is already locally available. The assumption that the data and compute resources are…

分布式、并行与集群计算 · 计算机科学 2012-07-31 Benjamin Heintz , Abhishek Chandra , Ramesh K. Sitaraman

Applications are increasingly written as dynamic workflows underpinned by an execution framework that manages asynchronous computations across distributed hardware. However, execution frameworks typically offer one-size-fits-all solutions…

分布式、并行与集群计算 · 计算机科学 2024-10-18 J. Gregory Pauloski , Klaudiusz Rydzy , Valerie Hayot-Sasson , Ian Foster , Kyle Chard

The distributed system use to enhance the performance of all types of multimedia service in the next generation network. The packet loss occurs in the video on demand system due to delay and huge traffic load from the both sides of client…

网络与互联网体系结构 · 计算机科学 2012-06-18 Soumen Kanrar

Offline batch inference, which leverages the flexibility of request batching to achieve higher throughput and lower costs, is becoming more popular for latency-insensitive applications. Meanwhile, recent progress in model capability and…

机器学习 · 计算机科学 2024-11-26 Yilong Zhao , Shuo Yang , Kan Zhu , Lianmin Zheng , Baris Kasikci , Yang Zhou , Jiarong Xing , Ion Stoica

Shared memory multiprocessors come back to popularity thanks to rapid spreading of commodity multi-core architectures. As ever, shared memory programs are fairly easy to write and quite hard to optimise; providing multi-core programmers…

分布式、并行与集群计算 · 计算机科学 2009-09-10 Marco Aldinucci , Massimo Torquati , Massimiliano Meneghin

Approximate computing aims for efficient execution of workflows where an approximate output is sufficient instead of the exact output. The idea behind approximate computing is to compute over a representative sample instead of the entire…

分布式、并行与集群计算 · 计算机科学 2017-09-12 Do Le Quoc , Ruichuan Chen , Pramod Bhatotia , Christof Fetze , Volker Hilt , Thorsten Strufe

This paper describes HyperStream, a large-scale, flexible and robust software package, written in the Python language, for processing streaming data with workflow creation capabilities. HyperStream overcomes the limitations of other…

机器学习 · 计算机科学 2019-08-09 Tom Diethe , Meelis Kull , Niall Twomey , Kacper Sokol , Hao Song , Miquel Perello-Nieto , Emma Tonkin , Peter Flach

This paper presents a cross-layer video delivery scheme, StreamOptix, and proposes a joint optimization algorithm for video delivery that leverages the characteristics of the physical (PHY), medium access control (MAC), and application…

多媒体 · 计算机科学 2024-06-10 Mufan Liu , Le Yang , Yifan Wang , Yiling Xu , Ye-Kui Wang , Yunfeng Guan