Deriving personalized insights from popular wearable trackers requires complex numerical reasoning that challenges standard LLMs, necessitating tool-based approaches like code generation. Large language model (LLM) agents present a promising yet largely untapped solution for this analysis at scale. We introduce the Personal Health Insights Agent (PHIA), a system leveraging multistep reasoning with code generation and information retrieval to analyze and interpret behavioral health data. To test its capabilities, we create and share two benchmark datasets with over 4000 health insights questions. A 650-hour human expert evaluation shows that PHIA significantly outperforms a strong code generation baseline, achieving 84% accuracy on objective, numerical questions and, for open-ended ones, earning 83% favorable ratings while being twice as likely to achieve the highest quality rating. This work can advance behavioral health by empowering individuals to understand their data, enabling a new era of accessible, personalized, and data-driven wellness for the wider population.
@article{arxiv.2406.06464,
title = {Transforming Wearable Data into Personal Health Insights using Large Language Model Agents},
author = {Mike A. Merrill and Akshay Paruchuri and Naghmeh Rezaei and Geza Kovacs and Javier Perez and Yun Liu and Erik Schenck and Nova Hammerquist and Jake Sunshine and Shyam Tailor and Kumar Ayush and Hao-Wei Su and Qian He and Cory Y. McLean and Mark Malhotra and Shwetak Patel and Jiening Zhan and Tim Althoff and Daniel McDuff and Xin Liu},
journal= {arXiv preprint arXiv:2406.06464},
year = {2025}
}
Comments
53 pages, 7 main figures, 2 main tables, accepted to Nature Communications