English
Related papers

Related papers: Total Variation Distance Meets Probabilistic Infer…

200 papers

Total variation distance (TV distance) is a fundamental notion of distance between probability distributions. In this work, we introduce and study the problem of computing the TV distance of two product distributions over the domain…

Data Structures and Algorithms · Computer Science 2023-08-21 Arnab Bhattacharyya , Sutanu Gayen , Kuldeep S. Meel , Dimitrios Myrisiotis , A. Pavan , N. V. Vinodchandran

Total variation distance (TV distance) is an important measure for the difference between two distributions. Recently, there has been progress in approximating the TV distance between product distributions: a deterministic algorithm for a…

Data Structures and Algorithms · Computer Science 2023-09-27 Weiming Feng , Liqiang Liu , Tianren Liu

We investigate some previously unexplored (or underexplored) computational aspects of total variation (TV) distance. First, we give a simple deterministic polynomial-time algorithm for checking equivalence between mixtures of product…

Data Structures and Algorithms · Computer Science 2024-12-16 Arnab Bhattacharyya , Sutanu Gayen , Kuldeep S. Meel , Dimitrios Myrisiotis , A. Pavan , N. V. Vinodchandran

With the proliferation of generative AI and the increasing volume of generative data (also called as synthetic data), assessing the fidelity of generative data has become a critical concern. In this paper, we propose a discriminative…

Machine Learning · Statistics 2024-05-27 Lan Tao , Shirong Xu , Chi-Hua Wang , Namjoon Suh , Guang Cheng

Total variation (TV) minimization is one of the most important techniques in modern signal/image processing, and has wide range of applications. While there are numerous recent works on the restoration guarantee of the TV minimization in…

Analysis of PDEs · Mathematics 2022-07-18 Jian-Feng Cai , Jae Kyu Choi , Ke Wei

Spin systems form an important class of undirected graphical models. For two Gibbs distributions $\mu$ and $\nu$ induced by two spin systems on the same graph $G = (V, E)$, we study the problem of approximating the total variation distance…

Data Structures and Algorithms · Computer Science 2025-06-16 Weiming Feng , Hongyang Liu , Minji Yang

The total variation distance is a metric of central importance in statistics and probability theory. However, somewhat surprisingly, questions about computing it algorithmically appear not to have been systematically studied until very…

Data Structures and Algorithms · Computer Science 2025-03-17 Arnab Bhattacharyya , Weiming Feng , Piyush Srivastava

Models of discrete-valued outcomes are easily misspecified if the data exhibit zero-inflation, overdispersion or contamination. Without additional knowledge about the existence and nature of this misspecification, model inference and…

Methodology · Statistics 2020-10-27 Jeremias Knoblauch , Lara Vomfell

We are interested in the estimation of the distance in total variation $$ \Delta := \|P_{f(X)} - P_{g(X)}\|_{\mathrm var} $$ between distributions of random variables $f(X)$ and $g(X)$ in terms of proximity of $f$ and $g.$ We propose a…

Probability · Mathematics 2017-06-21 Youri Davydov

This work is about the total variation (TV) minimization which is used for recovering gradient-sparse signals from compressed measurements. Recent studies indicate that TV minimization exhibits a phase transition behavior from failure to…

Information Theory · Computer Science 2019-09-17 Sajad Daei , Farzan Haddadi , Arash Amini

We (claim to) prove the extremely surprising fact that NP=RP. It is achieved by creating a Fully Polynomial-Time Randomized Approximation Scheme (FPRAS) for approximately counting the number of independent sets in bounded degree graphs,…

Computational Complexity · Computer Science 2020-08-06 András Faragó

Two-sample testing, where we aim to determine whether two distributions are equal or not equal based on samples from each one, is challenging if we cannot place assumptions on the properties of the two distributions. In particular,…

Machine Learning · Statistics 2026-04-13 Rohan Hore , Rina Foygel Barber

We consider the initial situation where a dataset has been over-partitioned into $k$ clusters and seek a domain independent way to merge those initial clusters. We identify the total variation distance (TVD) as suitable for this goal. By…

Machine Learning · Computer Science 2019-12-10 Christian Reiser , Jörg Schlötterer , Michael Granitzer

Distance distributions are a key building block in stochastic geometry modelling of wireless networks and in many other fields in mathematics and science. In this paper, we propose a novel framework for analytically computing the closed…

Information Theory · Computer Science 2019-03-20 Ross Pure , Salman Durrani , Fei Tong , Jianping Pan

Let $f: {\Bbb R}^n \longrightarrow {\Bbb R}$ be a positive definite quadratic form and let $y \in {\Bbb R}^n$ be a point. We present a fully polynomial randomized approximation scheme (FPRAS) for computing $\sum_{x \in {\Bbb Z}^n}…

Numerical Analysis · Mathematics 2023-06-06 Alexander Barvinok

This paper addresses the task of estimating a covariance matrix under a patternless sparsity assumption. In contrast to existing approaches based on thresholding or shrinkage penalties, we propose a likelihood-based method that regularizes…

Methodology · Statistics 2021-09-13 Jason Xu , Kenneth Lange

We show that computing the total variation distance between two product distributions is $\#\mathsf{P}$-complete. This is in stark contrast with other distance measures such as Kullback-Leibler, Chi-square, and Hellinger, which tensorize…

Computational Complexity · Computer Science 2024-05-15 Arnab Bhattacharyya , Sutanu Gayen , Kuldeep S. Meel , Dimitrios Myrisiotis , A. Pavan , N. V. Vinodchandran

We study the problem of approximating the total variation distance between two mixtures of product distributions over an $n$-dimensional discrete domain. Given two mixtures $\mathbb{P}$ and $\mathbb{Q}$ with $k_1$ and $k_2$ product…

Data Structures and Algorithms · Computer Science 2026-05-06 Weiming Feng , Yucheng Fu , Minji Yang , Anqi Zhang

We give a simple polynomial-time approximation algorithm for the total variation distance between two product distributions.

Data Structures and Algorithms · Computer Science 2024-02-14 Weiming Feng , Heng Guo , Mark Jerrum , Jiaheng Wang

This paper considers the problem of regression over distributions, which is becoming increasingly important in machine learning. Existing approaches often ignore the geometry of the probability space or are computationally expensive. To…

Machine Learning · Computer Science 2025-10-31 Maksim Maslov , Alexander Kugaevskikh , Matthew Ivanov
‹ Prev 1 2 3 10 Next ›