English

Approximating the Total Variation Distance between Gaussians

Data Structures and Algorithms 2025-03-17 v1 Machine Learning Probability

Abstract

The total variation distance is a metric of central importance in statistics and probability theory. However, somewhat surprisingly, questions about computing it algorithmically appear not to have been systematically studied until very recently. In this paper, we contribute to this line of work by studying this question in the important special case of multivariate Gaussians. More formally, we consider the problem of approximating the total variation distance between two multivariate Gaussians to within an ϵ\epsilon-relative error. Previous works achieved a fixed constant relative error approximation via closed-form formulas. In this work, we give algorithms that given any two nn-dimensional Gaussians D1,D2D_1,D_2, and any error bound ϵ>0\epsilon > 0, approximate the total variation distance D:=dTV(D1,D2)D := d_{TV}(D_1,D_2) to ϵ\epsilon-relative accuracy in poly(n,1ϵ,log1D)\text{poly}(n,\frac{1}{\epsilon},\log \frac{1}{D}) operations. The main technical tool in our work is a reduction that helps us extend the recent progress on computing the TV-distance between discrete random variables to our continuous setting.

Keywords

Cite

@article{arxiv.2503.11099,
  title  = {Approximating the Total Variation Distance between Gaussians},
  author = {Arnab Bhattacharyya and Weiming Feng and Piyush Srivastava},
  journal= {arXiv preprint arXiv:2503.11099},
  year   = {2025}
}

Comments

Accepted by AISTATS 2025

R2 v1 2026-06-28T22:20:09.777Z