Deep learning at the edge enables real-time streaming ptychographic imaging
Abstract
Coherent microscopy techniques provide an unparalleled multi-scale view of materials across scientific and technological fields, from structural materials to quantum devices, from integrated circuits to biological cells. Driven by the construction of brighter sources and high-rate detectors, coherent X-ray microscopy methods like ptychography are poised to revolutionize nanoscale materials characterization. However, associated significant increases in data and compute needs mean that conventional approaches no longer suffice for recovering sample images in real-time from high-speed coherent imaging experiments. Here, we demonstrate a workflow that leverages artificial intelligence at the edge and high-performance computing to enable real-time inversion on X-ray ptychography data streamed directly from a detector at up to 2 kHz. The proposed AI-enabled workflow eliminates the sampling constraints imposed by traditional ptychography, allowing low dose imaging using orders of magnitude less data than required by traditional methods.
Cite
@article{arxiv.2209.09408,
title = {Deep learning at the edge enables real-time streaming ptychographic imaging},
author = {Anakha V Babu and Tao Zhou and Saugat Kandel and Tekin Bicer and Zhengchun Liu and William Judge and Daniel J. Ching and Yi Jiang and Sinisa Veseli and Steven Henke and Ryan Chard and Yudong Yao and Ekaterina Sirazitdinova and Geetika Gupta and Martin V. Holt and Ian T. Foster and Antonino Miceli and Mathew J. Cherukara},
journal= {arXiv preprint arXiv:2209.09408},
year = {2022}
}