English

The shocklet transform: A decomposition method for the identification of local, mechanism-driven dynamics in sociotechnical time series

Physics and Society 2019-12-19 v3 Data Structures and Algorithms Signal Processing Data Analysis, Statistics and Probability

Abstract

We introduce a qualitative, shape-based, timescale-independent time-domain transform used to extract local dynamics from sociotechnical time series---termed the Discrete Shocklet Transform (DST)---and an associated similarity search routine, the Shocklet Transform And Ranking (STAR) algorithm, that indicates time windows during which panels of time series display qualitatively-similar anomalous behavior. After distinguishing our algorithms from other methods used in anomaly detection and time series similarity search, such as the matrix profile, seasonal-hybrid ESD, and discrete wavelet transform-based procedures, we demonstrate the DST's ability to identify mechanism-driven dynamics at a wide range of timescales and its relative insensitivity to functional parameterization. As an application, we analyze a sociotechnical data source (usage frequencies for a subset of words on Twitter) and highlight our algorithms' utility by using them to extract both a typology of mechanistic local dynamics and a data-driven narrative of socially-important events as perceived by English-language Twitter.

Keywords

Cite

@article{arxiv.1906.11710,
  title  = {The shocklet transform: A decomposition method for the identification of local, mechanism-driven dynamics in sociotechnical time series},
  author = {David Rushing Dewhurst and Thayer Alshaabi and Dilan Kiley and Michael V. Arnold and Joshua R. Minot and Christopher M. Danforth and Peter Sheridan Dodds},
  journal= {arXiv preprint arXiv:1906.11710},
  year   = {2019}
}

Comments

29 pages (20 body, 9 appendix), 20 figures (13 body, 7 appendix), three online appendices available at http://compstorylab.org/shocklets/ (two displaying interactive visualizations and one containing over 10,000 figures), open-source implementation of STAR algorithm and discrete shocklet transform available at https://gitlab.com/compstorylab/discrete-shocklet-transform