A Scalable Stream-Oriented Framework for Cluster Applications
分布式、并行与集群计算
2007-05-23 v1 数据库
网络与互联网体系结构
操作系统
编程语言
摘要
This paper presents a stream-oriented architecture for structuring cluster applications. Clusters that run applications based on this architecture can scale to tenths of thousands of nodes with significantly less performance loss or reliability problems. Our architecture exploits the stream nature of the data flow and reduces congestion through load balancing, hides latency behind data pushes and transparently handles node failures. In our ongoing work, we are developing an implementation for this architecture and we are able to run simple data mining applications on a cluster simulator.
引用
@article{arxiv.cs/0504051,
title = {A Scalable Stream-Oriented Framework for Cluster Applications},
author = {Tassos S. Argyros and David R. Cheriton},
journal= {arXiv preprint arXiv:cs/0504051},
year = {2007}
}