DevOps环境下REST API测试：针对演化中的医疗IoT应用的研究

医疗IoT应用 often 通过REST API集成各种第三方医疗应用程序和医疗设备， resulting in complex and interdependent的REST API networks。奥斯陆市卫生部门与various industry partners合作开发这些丰富于多样化REST API的医疗IoT applications。遵循DevOps process, these REST APIs continuously evolve to accommodate evolving needs such as new features, services, and devices. Oslo City的primary goal is to utilize automated solutions for continuous testing of these REST APIs at each evolution stage, thereby ensuring their dependability. Although the literature offers various automated REST API testing tools, their effectiveness in regression testing of the evolving REST APIs of healthcare IoT applications within a DevOps context remains undetermined. This paper evaluates state-of-the-art and well-established REST API testing tools, specifically, RESTest, EvoMaster, Schemathesis, RESTler, and RestTestGen, for the regression testing of a real-world healthcare IoT application, considering failures, faults, coverage, regressions, and cost. We conducted experiments using all accessible REST APIs (17 APIs with 120 endpoints), and 14 releases evolved during DevOps. Overall, all tools generated tests leading to several failures, 18 potential faults, up to 84% coverage, and 23 regressions. Over 70% of tests generated by all tools fail to detect failures, resulting in significant overhead.