English

Data-Driven Priors in the Maximum Entropy on the Mean Method for Linear Inverse Problems

Machine Learning 2024-12-25 v1 Machine Learning Optimization and Control

Abstract

We establish the theoretical framework for implementing the maximumn entropy on the mean (MEM) method for linear inverse problems in the setting of approximate (data-driven) priors. We prove a.s. convergence for empirical means and further develop general estimates for the difference between the MEM solutions with different priors μ\mu and ν\nu based upon the epigraphical distance between their respective log-moment generating functions. These estimates allow us to establish a rate of convergence in expectation for empirical means. We illustrate our results with denoising on MNIST and Fashion-MNIST data sets.

Keywords

Cite

@article{arxiv.2412.17916,
  title  = {Data-Driven Priors in the Maximum Entropy on the Mean Method for Linear Inverse Problems},
  author = {Matthew King-Roskamp and Rustum Choksi and Tim Hoheisel},
  journal= {arXiv preprint arXiv:2412.17916},
  year   = {2024}
}

Comments

25 pages, 13 figures

R2 v1 2026-06-28T20:47:21.091Z