English

On robust recovery of signals from indirect observations

Statistics Theory 2025-02-07 v2 Machine Learning Statistics Theory

Abstract

We consider an uncertain linear inverse problem as follows. Given observation ω=Ax+ζ\omega=Ax_*+\zeta where ARm×pA\in {\bf R}^{m\times p} and ζRm\zeta\in {\bf R}^{m} is observation noise, we want to recover unknown signal xx_*, known to belong to a convex set XRn{\cal X}\subset{\bf R}^{n}. As opposed to the "standard" setting of such problem, we suppose that the model noise ζ\zeta is "corrupted" -- contains an uncertain (deterministic dense or singular) component. Specifically, we assume that ζ\zeta decomposes into ζ=Nν+ξ\zeta=N\nu_*+\xi where ξ\xi is the random noise and NνN\nu_* is the "adversarial contamination" with known NRn\cal N\subset {\bf R}^n such that νN\nu_*\in \cal N and NRm×nN\in {\bf R}^{m\times n}. We consider two "uncertainty setups" in which N\cal N is either a convex bounded set or is the set of sparse vectors (with at most ss nonvanishing entries). We analyse the performance of "uncertainty-immunized" polyhedral estimates -- a particular class of nonlinear estimates as introduced in [15, 16] -- and show how "presumably good" estimates of the sort may be constructed in the situation where the signal set is an ellitope (essentially, a symmetric convex set delimited by quadratic surfaces) by means of efficient convex optimization routines.

Keywords

Cite

@article{arxiv.2501.01935,
  title  = {On robust recovery of signals from indirect observations},
  author = {Yannis Bekri and Anatoli Juditsky and Arkadi Nemirovski},
  journal= {arXiv preprint arXiv:2501.01935},
  year   = {2025}
}