English

Per-Platform GPIO Overhead in Hardware-Validated Edge ML Inference Timing

Systems and Control 2026-05-05 v1 Systems and Control

Abstract

Edge machine learning (ML) deployments increasingly rely on per-inference timing measured by software clocks such as Python's perf_counter, but these measurements are not always validated against external hardware references on embedded Linux, and edge ML benchmarking methodologies typically do not isolate platform-dependent instrumentation overhead. This paper reports a preliminary characterization of GPIO call overhead in hardware-validated edge ML inference timing on two embedded platforms running a one-dimensional convolutional neural network (1-D CNN) arrhythmia classifier on electrocardiogram (ECG) data from the MIT-BIH Arrhythmia Database, with five classes per the Association for the Advancement of Medical Instrumentation (AAMI) EC57 standard. Across n=10n = 10 trials on each platform at a controlled steady-state baseline, the per-platform constant on the Jetson Orin Nano (TensorRT FP16, Jetson.GPIO) is approximately 20μ-20\,\mus, and on the Raspberry Pi 4 (ONNX Runtime CPU, pigpio) approximately 86μ-86\,\mus, yielding a cross-platform asymmetry of approximately 66μ66\,\mus that is large relative to commonly used uniform validation tolerances. The Jetson constant is well-approximated by direct GPIO call duration (the direct profile accounts for ~88% of the platform constant), while the Pi direct profile over-predicts the platform constant by ~19%, motivating empirical per-platform calibration in the deployed measurement context. The Pi constant is not a single sharp value but exhibits a cross-day range of approximately 6μ6\,\mus across the three sessions sampled, while the Jetson constant reproduces to within approximately 0.14μ0.14\,\mus. These preliminary results suggest that cross-platform edge ML timing studies may benefit from platform-aware and potentially session-aware validation gates.

Cite

@article{arxiv.2605.02835,
  title  = {Per-Platform GPIO Overhead in Hardware-Validated Edge ML Inference Timing},
  author = {Akul Swami and Nikhil Chougule},
  journal= {arXiv preprint arXiv:2605.02835},
  year   = {2026}
}

Comments

4 pages, 3 tables. Work in Progress. Submitted to IEEE SMC 2026 Work-in-Progress track

R2 v1 2026-07-01T12:48:56.257Z