English

CycleGAN for Interpretable Online EMT Compensation

Computer Vision and Pattern Recognition 2021-01-06 v1

Abstract

Purpose: Electromagnetic Tracking (EMT) can partially replace X-ray guidance in minimally invasive procedures, reducing radiation in the OR. However, in this hybrid setting, EMT is disturbed by metallic distortion caused by the X-ray device. We plan to make hybrid navigation clinical reality to reduce radiation exposure for patients and surgeons, by compensating EMT error. Methods: Our online compensation strategy exploits cycle-consistent generative adversarial neural networks (CycleGAN). 3D positions are translated from various bedside environments to their bench equivalents. Domain-translated points are fine-tuned to reduce error in the bench domain. We evaluate our compensation approach in a phantom experiment. Results: Since the domain-translation approach maps distorted points to their lab equivalents, predictions are consistent among different C-arm environments. Error is successfully reduced in all evaluation environments. Our qualitative phantom experiment demonstrates that our approach generalizes well to an unseen C-arm environment. Conclusion: Adversarial, cycle-consistent training is an explicable, consistent and thus interpretable approach for online error compensation. Qualitative assessment of EMT error compensation gives a glimpse to the potential of our method for rotational error compensation.

Keywords

Cite

@article{arxiv.2101.01444,
  title  = {CycleGAN for Interpretable Online EMT Compensation},
  author = {Henry Krumb and Dhritimaan Das and Romol Chadda and Anirban Mukhopadhyay},
  journal= {arXiv preprint arXiv:2101.01444},
  year   = {2021}
}

Comments

Conditionally accepted for publication in IJCARS & presentation at IPCAI

R2 v1 2026-06-23T21:47:27.327Z