English
Related papers

Related papers: Trivergence of Probability Distributions, at glanc…

200 papers

Efficient textual data distributions (TDD) alignment and generation are open research problems in textual analytics and NLP. It is presently difficult to parsimoniously and methodologically confirm that two or more natural language datasets…

Computation and Language · Computer Science 2021-07-06 Jim Samuel , Ratnakar Palle , Eduardo Correa Soares

Quantifying the difference between probability distributions is crucial in machine learning. However, estimating statistical divergences from empirical samples is challenging due to unknown underlying distributions. This work proposes the…

Machine Learning · Computer Science 2024-10-25 Jhoan K. Hoyos-Osorio , Luis G. Sanchez-Giraldo

If two probability density functions (PDFs) have values for their first $n$ moments which are quite close to each other (upper bounds of their differences are known), can it be expected that the PDFs themselves are very similar? Shown below…

Statistics Theory · Mathematics 2018-08-16 Pranava Chaitanya Jayanti , Konstantina Trivisa

The problem of searching for a model-based scene interpretation is analyzed within a probabilistic framework. Object models are formulated as generative models for range data of the scene. A new statistical criterion, the truncated object…

Computer Vision and Pattern Recognition · Computer Science 2007-05-23 Ulrich Hillenbrand , Gerd Hirzinger

In this paper we present the probabilistic typed natural deduction calculus TPTND, designed to reason about and derive trustworthiness properties of probabilistic computational processes, like those underlying current AI applications.…

Logic in Computer Science · Computer Science 2025-02-14 Fabio Aurelio D'Asaro , Francesco Genco , Giuseppe Primiero

It has been argued persuasively that, in order to evaluate climate models, the probability distributions of model output need to be compared to the corresponding empirical distributions of observed data. Distance measures between…

Methodology · Statistics 2013-07-17 Thordis L. Thorarinsdottir , Tilmann Gneiting , Nadine Gissibl

Similarity comparisons of the form "Is object a more similar to b than to c?" are useful for computer vision and machine learning applications. Unfortunately, an embedding of $n$ points is specified by $n^3$ triplets, making collecting…

Computer Vision and Pattern Recognition · Computer Science 2014-04-15 Michael J. Wilber , Iljung S. Kwak , Serge J. Belongie

Wide conditions are provided to guarantee asymptotic unbiasedness and L^2-consistency of the introduced estimates of the Kullback-Leibler divergence for probability measures in R^d having densities w.r.t. the Lebesgue measure. These…

Statistics Theory · Mathematics 2019-07-02 Alexander Bulinski , Denis Dimitrov

The problem of comparing probability distributions is at the heart of many tasks in statistics and machine learning. Established comparison methods treat the standard setting that the distributions are supported in the same space. Recently,…

Metric Geometry · Mathematics 2024-10-01 Roan Talbut , Daniele Tramontano , Yueqi Cao , Mathias Drton , Anthea Monod

This paper deals with three major types of convergence of probability measures on metric spaces: weak convergence, setwise converges, and convergence in the total variation. First, it describes and compares necessary and sufficient…

Probability · Mathematics 2014-07-04 Eugene A. Feinberg , Pavlo O. Kasyanov , Michael Z. Zgurovsky

Probabilistic submeasures generalizing the classical (numerical) submeasures are introduced and discussed in connection with some classes of aggregation functions. A special attention is paid to triangular norm-based probabilistic…

Classical Analysis and ODEs · Mathematics 2012-07-12 Lenka Halčinová , Ondrej Hutník , Radko Mesiar

We present a definition of the distance between probability distributions. Our definition is based on the $L_1$ norm on space of probability measures. We compare our distance with the well-known Kullback-Leibler divergence and with the…

General Relativity and Quantum Cosmology · Physics 2008-11-26 Robert J. Budzyński , Witold Kondracki , Andrzej Królak

There are many information and divergence measures exist in the literature on information theory and statistics. The most famous among them are Kullback-Leiber's (1951)relative information and Jeffreys (1946) J-divergence, Information…

Probability · Mathematics 2007-05-23 Inder Jeet Taneja

Discrete normal distributions are defined as the distributions with prescribed means and covariance matrices which maximize entropy on the integer lattice support. The set of discrete normal distributions form an exponential family with…

Information Theory · Computer Science 2022-01-25 Frank Nielsen

In [3], algorithms to compute the density of the distance to a random variable uniformly distributed in (a) a ball, (b) a disk, (c) a line segment, or (d) a polygone were introduced. For case (d), the algorithm, based on Green's theorem,…

Computational Geometry · Computer Science 2019-06-06 Vincent Guigues

A method to approximate continuous multi-dimensional probability density functions (PDFs) using their projections and correlations is described. The method is particularly useful for event classification when estimates of systematic…

Data Analysis, Statistics and Probability · Physics 2009-10-31 Dean Karlen

We introduce a divergence measure between data distributions based on operators in reproducing kernel Hilbert spaces defined by kernels. The empirical estimator of the divergence is computed using the eigenvalues of positive definite Gram…

Machine Learning · Computer Science 2023-05-31 Jhoan Keider Hoyos Osorio , Oscar Skean , Austin J. Brockmeier , Luis Gonzalo Sanchez Giraldo

We survey a new area of parameter-free similarity distance measures useful in data-mining, pattern recognition, learning and automatic semantics extraction. Given a family of distances on a set of objects, a distance is universal up to a…

Information Retrieval · Computer Science 2007-05-23 Paul Vitanyi

A general piecewise (including pointwise) probability distribution with space-saving notation and its hierarchical particular cases are considered. The explicit closed-form normalization, expectation, and variance formulas along with the…

Probability · Mathematics 2022-02-01 Lev Gelimson

Recently a new class of planar tessellations, named T-tessellations, was introduced. Splits, merges and a third local modification named flip where shown to be sufficient for exploring the space of T-tessellations. Based on these local…

Statistics Theory · Mathematics 2015-12-31 Kiên Kiêu , Katarzyna Adamczyk-Chauvat