English
Related papers

Related papers: Pinsker's inequality for adapted total variation

200 papers

We consider the total variation (TV) minimization problem used for compressive sensing and solve it using the generalized alternating projection (GAP) algorithm. Extensive results demonstrate the high performance of proposed algorithm on…

Information Theory · Computer Science 2015-11-13 Xin Yuan

We study the convergence of Langevin-Simulated Annealing type algorithms with multiplicative noise, i.e. for $V : \mathbb{R}^d \to \mathbb{R}$ a potential function to minimize, we consider the stochastic differential equation $dY_t = -…

Probability · Mathematics 2022-05-31 Pierre Bras , Gilles Pagès

This letter addresses the problem of estimating block sparse signal with unknown group partitions in a multiple measurement vector (MMV) setup. We propose a Bayesian framework by applying an adaptive total variation (TV) penalty on the…

Signal Processing · Electrical Eng. & Systems 2025-03-13 Hamza Djelouat , Reijo Leinonen , Mikko J. Sillanpää , Bhaskar D. Rao , Markku Juntti

The total variation (TV)-seminorm is considered for piecewise polynomial, globally discontinuous (DG) and continuous (CG) finite element functions on simplicial meshes. A novel, discrete variant (DTV) based on a nodal quadrature formula is…

Numerical Analysis · Mathematics 2018-08-17 Marc Herrmann , Roland Herzog , Stephan Schmidt , José Vidal-Núñez , Gerd Wachsmuth

Quantum Wasserstein divergences are modified versions of quantum Wasserstein distances defined by channels, and they are conjectured to be genuine metrics on quantum state spaces by De Palma and Trevisan. We prove triangle inequality for…

Mathematical Physics · Physics 2025-04-03 Gergely Bunth , József Pitrik , Tamás Titkos , Dániel Virosztek

Understanding proper distance measures between distributions is at the core of several learning tasks such as generative models, domain adaptation, clustering, etc. In this work, we focus on mixture distributions that arise naturally in…

Machine Learning · Computer Science 2019-10-30 Yogesh Balaji , Rama Chellappa , Soheil Feizi

We show that the distance in total variation between $(\mathrm{Tr}\ U, \frac{1}{\sqrt{2}}\mathrm{Tr}\ U^2, \cdots, \frac{1}{\sqrt{m}}\mathrm{Tr}\ U^m)$ and a real Gaussian vector, where $U$ is a Haar distributed orthogonal or symplectic…

Probability · Mathematics 2021-03-08 Klara Courteaut , Kurt Johansson

Personalized recommender systems are playing an increasingly important role as more content and services become available and users struggle to identify what might interest them. Although matrix factorization and deep learning based methods…

Information Retrieval · Computer Science 2021-01-14 Chen Ma , Liheng Ma , Yingxue Zhang , Ruiming Tang , Xue Liu , Mark Coates

The distance and divergence of the probability measures play a central role in statistics, machine learning, and many other related fields. The Wasserstein distance has received much attention in recent years because of its distinctions…

Statistics Theory · Mathematics 2021-03-11 Qijun Tong , Kei Kobayashi

Total Variation (TV) is a popular regularization strategy that promotes piece-wise constant signals by constraining the $\ell_1$-norm of the first order derivative of the estimated signal. The resulting optimization problem is usually…

Optimization and Control · Mathematics 2020-10-20 Hamza Cherkaoui , Jeremias Sulam , Thomas Moreau

The notion of entropy-regularized optimal transport, also known as Sinkhorn divergence, has recently gained popularity in machine learning and statistics, as it makes feasible the use of smoothed optimal transportation distances for data…

Statistics Theory · Mathematics 2019-11-05 Jérémie Bigot , Elsa Cazelles , Nicolas Papadakis

The Wasserstein distance $\mathcal{W}_p$ is an important instance of an optimal transport cost. Its numerous mathematical properties as well as applications to various fields such as mathematical finance and statistics have been well…

Probability · Mathematics 2025-07-09 Jose Blanchet , Martin Larsson , Jonghwa Park , Johannes Wiesel

We use Stein's method to bound the Wasserstein distance of order $2$ between a measure $\nu$ and the Gaussian measure using a stochastic process $(X_t)_{t \geq 0}$ such that $X_t$ is drawn from $\nu$ for any $t > 0$. If the stochastic…

Probability · Mathematics 2020-05-12 Thomas Bonis

We introduce Wasserstein consensus alternating direction method of multipliers (ADMM) and its entropic-regularized version: Sinkhorn consensus ADMM, to solve measure-valued optimization problems with convex additive objectives. Several…

Optimization and Control · Mathematics 2023-09-15 Iman Nodozi , Abhishek Halder

We propose a framework, named Aggregated Wasserstein, for computing a dissimilarity measure or distance between two Hidden Markov Models with state conditional distributions being Gaussian. For such HMMs, the marginal distribution at any…

Machine Learning · Computer Science 2016-08-08 Yukun Chen , Jianbo Ye , Jia Li

We use here a particle system to prove a convergence result as well as a deviation inequality for solutions of granular media equation when the confinement potential and the interaction potential are no more uniformly convex. Proof is…

Probability · Mathematics 2007-05-23 Patrick Cattiaux , Guillin Arnaud , Malrieu Florent

When two different parties use the same learning rule on their own data, how can we test whether the distributions of the two outcomes are similar? In this paper, we study the similarity of outcomes of learning rules through the lens of the…

Machine Learning · Computer Science 2023-05-24 Alkis Kalavasis , Amin Karbasi , Shay Moran , Grigoris Velegkas

In recent years, total variation (TV) and Euler's elastica (EE) have been successfully applied to image processing tasks such as denoising and inpainting. This paper investigates how to extend TV and EE to the supervised learning settings…

Machine Learning · Computer Science 2012-06-22 Tong Lin , Hanlin Xue , Ling Wang , Hongbin Zha

Convergence rate to the stationary distribution for continuous-time Markov processes can be studied using Lyapunov functions. Recent work by the author provided explicit rates of convergence in special case of a reflected jump-diffusion on…

Probability · Mathematics 2020-03-25 Andrey Sarantsev

We consider a modified quadratic variation of the Hermite process based on some well-chosen increments of this process. These special increments have the very useful property to be independent and identically distributed up to…

Probability · Mathematics 2023-04-24 Antoine Ayache , Ciprian A Tudor