English
Related papers

Related papers: Computational Explorations of Total Variation Dist…

200 papers

We present an algorithm for testing halfspaces over arbitrary, unknown rotation-invariant distributions. Using $\tilde O(\sqrt{n}\epsilon^{-7})$ random examples of an unknown function $f$, the algorithm determines with high probability…

Data Structures and Algorithms · Computer Science 2018-11-02 Nathaniel Harms

We study the problem of minimizing the Wasserstein distance between a probability distribution and an algebraic variety. We consider the setting of finite state spaces and describe the solution depending on the choice of the ground metric…

Optimization and Control · Mathematics 2020-01-15 T. Ö. Çelik , A. Jamneshan , G. Montúfar , B. Sturmfels , L. Venturello

Computer experiments are pivotal for modeling complex real-world systems. Maximizing information extraction and ensuring accurate surrogate modeling necessitates space-filling designs, where design points extensively cover the input domain.…

Methodology · Statistics 2025-08-01 Hui Lan , Xu He

We consider the problem of allocating samples to a finite set of discrete distributions in order to learn them uniformly well in terms of four common distance measures: $\ell_2^2$, $\ell_1$, $f$-divergence, and separation distance. To…

Machine Learning · Statistics 2019-12-10 Shubhanshu Shekhar , Tara Javidi , Mohammad Ghavamzadeh

Different types of two- and three-dimensional representations of a finite metric space are studied that focus on the accurate representation of the linear order among the distances rather than their actual values. Lower and upper bounds for…

Combinatorics · Mathematics 2007-05-23 Jobst Heitzig

While medical imaging typically provides massive amounts of data, the extraction of relevant information for predictive diagnosis remains a difficult challenge. Functional MRI (fMRI) data, that provide an indirect measure of task-related or…

Computer Vision and Pattern Recognition · Computer Science 2011-02-22 Vincent Michel , Alexandre Gramfort , Gaël Varoquaux , Evelyn Eger , Bertrand Thirion

Recently, we have witnessed the success of total variation (TV) for many imaging applications. However, traditional TV is defined on the original pixel domain, which limits its potential. In this work, we suggest a new TV regularization…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Yisi Luo , Xile Zhao , Kai Ye , Deyu Meng

We study the problem of estimating the Earth Mover's Distance (EMD) between probability distributions when given access only to samples. We give closeness testers and additive-error estimators over domains in $[0, \Delta]^d$, with sample…

Data Structures and Algorithms · Computer Science 2009-04-03 Khanh Do Ba , Huy L Nguyen , Huy N Nguyen , Ronitt Rubinfeld

This article studies the denoising performance of total variation (TV) image regularization. More precisely, we study geometrical properties of the solution to the so-called Rudin-Osher-Fatemi total variation denoising method. The first…

Optimization and Control · Mathematics 2016-12-21 Antonin Chambolle , Vincent Duval , Gabriel Peyré , Clarice Poon

Motivated by putting empirical work based on (synthetic) election data on a more solid mathematical basis, we analyze six distances among elections, including, e.g., the challenging-to-compute but very precise swap distance and the distance…

Computer Science and Game Theory · Computer Science 2022-05-03 Niclas Boehmer , Piotr Faliszewski , Rolf Niedermeier , Stanisław Szufa , Tomasz Wąs

The recently proposed Thermodynamic Variational Objective (TVO) leverages thermodynamic integration to provide a family of variational inference objectives, which both tighten and generalize the ubiquitous Evidence Lower Bound (ELBO).…

Machine Learning · Computer Science 2020-07-02 Rob Brekelmans , Vaden Masrani , Frank Wood , Greg Ver Steeg , Aram Galstyan

Probabilistic context-free grammars (PCFGs) are used to define distributions over strings, and are powerful modelling tools in a number of areas, including natural language processing, software engineering, model checking, bio-informatics,…

Formal Languages and Automata Theory · Computer Science 2014-07-08 Colin de la Higuera , James Scicluna , Mark-Jan Nederhof

What advantage do \emph{sequential} procedures provide over batch algorithms for testing properties of unknown distributions? Focusing on the problem of testing whether two distributions $\mathcal{D}_1$ and $\mathcal{D}_2$ on $\{1,\dots,…

Data Structures and Algorithms · Computer Science 2022-05-13 Omar Fawzi , Nicolas Flammarion , Aurélien Garivier , Aadil Oufkir

A novel numerical method for the estimation of large time-varying parameter (TVP) models is proposed. The updating and smoothing estimates of the TVP model are derived within the context of generalised linear least squares and through…

Methodology · Statistics 2018-01-23 Stella Hadjiantoni , Erricos J. Kontoghiorghes

Mixtures of Gaussian (or normal) distributions arise in a variety of application areas. Many heuristics have been proposed for the task of finding the component Gaussians given samples from the mixture, such as the EM algorithm, a…

Probability · Mathematics 2007-05-23 Sanjeev Arora , Ravi Kannan

The total variation (TV) regularization has phenomenally boosted various variational models for image processing tasks. We propose to combine the backward diffusion process in the earlier literature of image enhancement with the TV…

Image and Video Processing · Electrical Eng. & Systems 2023-06-14 Congpei An , Hao-Ning Wu , Xiaoming Yuan

While known algorithms for sensitivity analysis and parameter tuning in probabilistic networks have a running time that is exponential in the size of the network, the exact computational complexity of these problems has not been established…

Artificial Intelligence · Computer Science 2012-06-18 Johan Kwisthout , Linda C. van der Gaag

The truncated variation, $TV^c$, is a fairly new concept introduced in [5]. Roughly speaking, given a c\`adl\`ag function $f$, its truncated variation is "the total variation which does not pay attention to small changes of $f$, below some…

Probability · Mathematics 2012-10-29 Rafał M. Łochowski , Piotr Miłoś

We present the first $\varepsilon$-differentially private, computationally efficient algorithm that estimates the means of product distributions over $\{0,1\}^d$ accurately in total-variation distance, whilst attaining the optimal sample…

Data Structures and Algorithms · Computer Science 2024-01-29 Vikrant Singhal

Optimal Transport (OT) metrics allow for defining discrepancies between two probability measures. Wasserstein distance is for longer the celebrated OT-distance frequently-used in the literature, which seeks probability distributions to be…

Machine Learning · Computer Science 2021-10-14 Mokhtar Z. Alaya , Gilles Gasso , Maxime Berar , Alain Rakotomamonjy