Computing Augustin Information via Hybrid Geodesically Convex Optimization
Information Theory
2024-05-10 v2 math.IT
Optimization and Control
Abstract
We propose a Riemannian gradient descent with the Poincar\'e metric to compute the order- Augustin information, a widely used quantity for characterizing exponential error behaviors in information theory. We prove that the algorithm converges to the optimum at a rate of . As far as we know, this is the first algorithm with a non-asymptotic optimization error guarantee for all positive orders. Numerical experimental results demonstrate the empirical efficiency of the algorithm. Our result is based on a novel hybrid analysis of Riemannian gradient descent for functions that are geodesically convex in a Riemannian metric and geodesically smooth in another.
Keywords
Cite
@article{arxiv.2402.02731,
title = {Computing Augustin Information via Hybrid Geodesically Convex Optimization},
author = {Guan-Ren Wang and Chung-En Tsai and Hao-Chung Cheng and Yen-Huan Li},
journal= {arXiv preprint arXiv:2402.02731},
year = {2024}
}
Comments
17 pages, 2 figures, ISIT 2024