English

Joint Cryo-ET Alignment and Reconstruction with Neural Deformation Fields

Image and Video Processing 2023-10-17 v1 Signal Processing

Abstract

We propose a framework to jointly determine the deformation parameters and reconstruct the unknown volume in electron cryotomography (CryoET). CryoET aims to reconstruct three-dimensional biological samples from two-dimensional projections. A major challenge is that we can only acquire projections for a limited range of tilts, and that each projection undergoes an unknown deformation during acquisition. Not accounting for these deformations results in poor reconstruction. The existing CryoET software packages attempt to align the projections, often in a workflow which uses manual feedback. Our proposed method sidesteps this inconvenience by automatically computing a set of undeformed projections while simultaneously reconstructing the unknown volume. We achieve this by learning a continuous representation of the undeformed measurements and deformation parameters. We show that our approach enables the recovery of high-frequency details that are destroyed without accounting for deformations.

Keywords

Cite

@article{arxiv.2211.14534,
  title  = {Joint Cryo-ET Alignment and Reconstruction with Neural Deformation Fields},
  author = {Valentin Debarnot and Sidharth Gupta and Konik Kothari and Ivan Dokmanic},
  journal= {arXiv preprint arXiv:2211.14534},
  year   = {2023}
}
R2 v1 2026-06-28T07:13:31.162Z