English
Related papers

Related papers: On Computing the Total Variation Distance of Hidde…

200 papers

Labelled Markov chains (LMCs) are widely used in probabilistic verification, speech recognition, computational biology, and many other fields. Checking two LMCs for equivalence is a classical problem subject to extensive studies, while the…

Logic in Computer Science · Computer Science 2014-05-16 Taolue Chen , Stefan Kiefer

Labeled Markov Chains (or LMCs for short) are useful mathematical objects to model complex probabilistic languages. A central challenge is to compare two LMCs, for example to assess the accuracy of an abstraction or to quantify the effect…

Logic in Computer Science · Computer Science 2025-11-25 Adrien Banse , Alessandro Abate , Raphaël M. Jungers

We show that computing the total variation distance between two product distributions is $\#\mathsf{P}$-complete. This is in stark contrast with other distance measures such as Kullback-Leibler, Chi-square, and Hellinger, which tensorize…

Computational Complexity · Computer Science 2024-05-15 Arnab Bhattacharyya , Sutanu Gayen , Kuldeep S. Meel , Dimitrios Myrisiotis , A. Pavan , N. V. Vinodchandran

We introduce a general class of distances (metrics) between Markov chains, which are based on linear behaviour. This class encompasses distances given topologically (such as the total variation distance or trace distance) as well as by…

Formal Languages and Automata Theory · Computer Science 2016-06-27 Przemysław Daca , Thomas A. Henzinger , Jan Křetínský , Tatjana Petrov

Total variation distance (TV distance) is a fundamental notion of distance between probability distributions. In this work, we introduce and study the problem of computing the TV distance of two product distributions over the domain…

Data Structures and Algorithms · Computer Science 2023-08-21 Arnab Bhattacharyya , Sutanu Gayen , Kuldeep S. Meel , Dimitrios Myrisiotis , A. Pavan , N. V. Vinodchandran

The total variation distance is a metric of central importance in statistics and probability theory. However, somewhat surprisingly, questions about computing it algorithmically appear not to have been systematically studied until very…

Data Structures and Algorithms · Computer Science 2025-03-17 Arnab Bhattacharyya , Weiming Feng , Piyush Srivastava

The total variation distance is a core statistical distance between probability measures that satisfies the metric axioms, with value always falling in $[0,1]$. This distance plays a fundamental role in machine learning and signal…

Machine Learning · Computer Science 2018-07-02 Frank Nielsen , Ke Sun

For a given Markov chain Monte Carlo algorithm we introduce a distance between two configurations that quantifies the difficulty of transition from one configuration to the other configuration. We argue that the distance takes a universal…

High Energy Physics - Lattice · Physics 2018-03-21 Masafumi Fukuma , Nobuyuki Matsumoto , Naoya Umeda

The paper provides an estimate of the total variation distance between distributions of polynomials defined on a space equipped with a logarithmically concave measure in terms of the $L^2$-distance between these polynomials.

Probability · Mathematics 2018-12-07 Egor Kosov

Dealing with finite Markov chains in discrete time, the focus often lies on convergence behavior and one tries to make different copies of the chain meet as fast as possible and then stick together. There is, however, a very peculiar kind…

Probability · Mathematics 2017-02-15 Timo Hirscher , Anders Martinsson

We suggest new recursive formulas to compute the exact value of the Kullback-Leibler distance (KLD) between two general Hidden Markov Trees (HMTs). For homogeneous HMTs with regular topology, such as homogeneous Hidden Markov Models (HMMs),…

Information Theory · Computer Science 2012-10-10 Vittorio Perduca , Grégory Nuel

In this article, we consider products of ergodic Markov chains and discuss their cutoffs in the total variation. Through a new inequality relating the total variation and the Hellinger distance, we may identify the total variation cutoffs…

Probability · Mathematics 2017-02-13 Guan-Yu Chen , Takashi Kumagai

We consider a Markov chain on $\mathbb{R}^d$ with invariant measure $\mu$. We are interested in the rate of convergence of the empirical measures towards the invariant measure with respect to various dual distances, including in particular…

Probability · Mathematics 2022-10-13 Adrian Riekert

Perturbation theory for Markov chains addresses the question how small differences in the transitions of Markov chains are reflected in differences between their distributions. We prove powerful and flexible bounds on the distance of the…

Computation · Statistics 2017-02-27 Daniel Rudolf , Nikolaus Schweizer

We study the problem of approximating the total variation distance between two mixtures of product distributions over an $n$-dimensional discrete domain. Given two mixtures $\mathbb{P}$ and $\mathbb{Q}$ with $k_1$ and $k_2$ product…

Data Structures and Algorithms · Computer Science 2026-05-06 Weiming Feng , Yucheng Fu , Minji Yang , Anqi Zhang

Motivated by a derandomization of Markov chain Monte Carlo (MCMC), this paper investigates deterministic random walks, which is a deterministic process analogous to a random walk. While there are several progresses on the analysis of the…

Discrete Mathematics · Computer Science 2015-08-17 Takeharu Shiraga , Yukiko Yamauchi , Shuji Kijima , Masafumi Yamashita

The goal of this paper is to estimate the total variation distance between two general stochastic polynomials. As a consequence one obtains an invariance principle for such polynomials. This generalizes known results concerning the total…

Probability · Mathematics 2019-12-03 Vlad Bally , Lucia Caramellino

The problem of estimating an unknown discrete distribution from its samples is a fundamental tenet of statistical learning. Over the past decade, it attracted significant research effort and has been solved for a variety of divergence…

Machine Learning · Computer Science 2018-10-30 Yi Hao , Alon Orlitsky , Venkatadheeraj Pichapati

We provide quantitative upper bounds on the total variation mixing time of the Markov chain corresponding to the unadjusted Hamiltonian Monte Carlo (uHMC) algorithm. For two general classes of models and fixed time discretization step size…

Probability · Mathematics 2022-10-13 Nawaf Bou-Rabee , Andreas Eberle

Mixtures of high dimensional Gaussian distributions have been studied extensively in statistics and learning theory. While the total variation distance appears naturally in the sample complexity of distribution learning, it is analytically…

Probability · Mathematics 2022-03-11 Sami Davies , Arya Mazumdar , Soumyabrata Pal , Cyrus Rashtchian
‹ Prev 1 2 3 10 Next ›