Poster: A Real-World Distributed Infrastructure for Processing Financial Data at Scale
Abstract
Financial markets are event- and data-driven to an extremely high degree. For making decisions and triggering actions stakeholders require notifications about significant events and reliable background information that meet their individual requirements in terms of timeliness, accuracy, and completeness. As one of Europe's leading providers of financial data and regulatory solutions vwd processes an average of 18 billion event notifications from 500+ data sources for 30 million symbols per day. Our large-scale distributed event-based systems handle daily peak rates of 1+ million event notifications per second and additional load generated by singular pivotal events with global impact. In this poster we give practical insights into our IT systems. We outline the infrastructure we operate and the event-driven architecture we apply at vwd. In particular we showcase the (geo)distributed publish/subscribe broker network we operate across locations and countries to provide market data to our customers with varying quality of information (QoI) properties.
Cite
@article{arxiv.2011.01040,
title = {Poster: A Real-World Distributed Infrastructure for Processing Financial Data at Scale},
author = {Sebastian Frischbier and Mario Paic and Alexander Echler and Christian Roth},
journal= {arXiv preprint arXiv:2011.01040},
year = {2021}
}
Comments
Authors' version of the accepted submission; final version published by ACM as part of the proceedings of DEBS '19: The 13th ACM International Conference on Distributed and Event-based Systems (DEBS '19); 2 pages, 1 figure; vwd Vereinigte Wirtschaftsdienste GmbH is by now known as Infront Financial Technology GmbH (part of the Infront group)