English

ESAR: Event-Based Synthetic Aperture Reconstruction

Image and Video Processing 2026-07-16 v1 Computer Vision and Pattern Recognition Signal Processing

Abstract

Event cameras report asynchronous polarity events when changes in log--radiance exceed a fixed contrast threshold, producing signed temporal contrast measurements rather than conventional image frames. We formulate monocular event-based imaging as a synthetic-aperture inverse problem for a static ground-domain log--radiance field θRNg\theta \in \mathbb{R}^{N_g}. Instead of reconstructing a latent pixel-time volume vRNpNtv \in \mathbb{R}^{N_pN_t}, we impose the geometric relation v=Pθv=P\theta, where PP maps the fixed scene into motion-dependent latent views. Aggregating events over finite time intervals gives the linearized model APθ=b+η, AP\theta = b+\eta, where AA is a temporal differencing operator, bb contains signed binned event counts, and η\eta represents measurement and modeling errors. This decomposition exposes a synthetic-aperture structure: under near-nadir motion, successive projections are approximately shifted views of a common scene, while the composite operator APAP remains ill-conditioned because it combines spatial averaging with temporal differencing. We therefore use regularized inversion to recover θ\theta. Numerical experiments on simulated data and real near-nadir Falcon Neuro event data show that the proposed θ\theta-based formulation recovers coherent large-scale spatial structure, relative to dynamic latent-image and learned event-reconstruction baselines, while suppressing fine-scale texture.

Cite

@article{arxiv.2607.15073,
  title  = {ESAR: Event-Based Synthetic Aperture Reconstruction},
  author = {Harbir Antil and Daniel Blauvelt and David Sayre},
  journal= {arXiv preprint arXiv:2607.15073},
  year   = {2026}
}