English

Developing Medical AI : a cloud-native audio-visual data collection study

Human-Computer Interaction 2021-10-08 v1 Machine Learning

Abstract

Designing Artificial Intelligence (AI) solutions that can operate in real-world situations is a highly complex task. Deploying such solutions in the medical domain is even more challenging. The promise of using AI to improve patient care and reduce cost has encouraged many companies to undertake such endeavours. For our team, the goal has been to improve early identification of deteriorating patients in the hospital. Identifying patient deterioration in lower acuity wards relies, to a large degree on the attention and intuition of clinicians, rather than on the presence of physiological monitoring devices. In these care areas, an automated tool which could continuously observe patients and notify the clinical staff of suspected deterioration, would be extremely valuable. In order to develop such an AI-enabled tool, a large collection of patient images and audio correlated with corresponding vital signs, past medical history and clinical outcome would be indispensable. To the best of our knowledge, no such public or for-pay data set currently exists. This lack of audio-visual data led to the decision to conduct exactly such study. The main contributions of this paper are, the description of a protocol for audio-visual data collection study, a cloud-architecture for efficiently processing and consuming such data, and the design of a specific data collection device.

Keywords

Cite

@article{arxiv.2110.03660,
  title  = {Developing Medical AI : a cloud-native audio-visual data collection study},
  author = {Sagi Schein and Greg Arutiunian and Vitaly Burshtein and Gal Sadeh and Michelle Townshend and Bruce Friedman and Shada Sadr-azodi},
  journal= {arXiv preprint arXiv:2110.03660},
  year   = {2021}
}
R2 v1 2026-06-24T06:42:57.896Z