English

Evaluating the SiteStory Transactional Web Archive With the ApacheBench Tool

Performance 2012-10-08 v2 Digital Libraries

Abstract

Conventional Web archives are created by periodically crawling a web site and archiving the responses from the Web server. Although easy to implement and common deployed, this form of archiving typically misses updates and may not be suitable for all preservation scenarios, for example a site that is required (perhaps for records compliance) to keep a copy of all pages it has served. In contrast, transactional archives work in conjunction with a Web server to record all pages that have been served. Los Alamos National Laboratory has developed SiteSory, an open-source transactional archive written in Java solution that runs on Apache Web servers, provides a Memento compatible access interface, and WARC file export features. We used the ApacheBench utility on a pre-release version of to measure response time and content delivery time in different environments and on different machines. The performance tests were designed to determine the feasibility of SiteStory as a production-level solution for high fidelity automatic Web archiving. We found that SiteStory does not significantly affect content server performance when it is performing transactional archiving. Content server performance slows from 0.076 seconds to 0.086 seconds per Web page access when the content server is under load, and from 0.15 seconds to 0.21 seconds when the resource has many embedded and changing resources.

Cite

@article{arxiv.1209.1811,
  title  = {Evaluating the SiteStory Transactional Web Archive With the ApacheBench Tool},
  author = {Justin F. Brunelle and Michael L. Nelson},
  journal= {arXiv preprint arXiv:1209.1811},
  year   = {2012}
}

Comments

13 pages, Technical Report

R2 v1 2026-06-21T22:02:07.038Z