We introduce FRONTMATTER: a tool to automatically mine both user interface models and behavior of Android apps at a large scale with high precision. Given an app, FRONTMATTER statically extracts all declared screens, the user interface elements, their textual and graphical features, as well as Android APIs invoked by interacting with them. Executed on tens of thousands of real-world apps, FRONTMATTER opens the door for comprehensive mining of mobile user interfaces, jumpstarting empirical research at a large scale, addressing questions such as "How many travel apps require registration?", "Which apps do not follow accessibility guidelines?", "Does the user interface correspond to the description?", and many more. FRONTMATTER and the mined dataset are available under an open-source license.
@article{arxiv.2105.03144,
title = {What do all these Buttons do? Statically Mining Android User Interfaces at Scale},
author = {Konstantin Kuznetsov and Chen Fu and Song Gao and David N. Jansen and Lijun Zhang and Andreas Zeller},
journal= {arXiv preprint arXiv:2105.03144},
year = {2021}
}