English
Related papers

Related papers: Using proper divergence functions to evaluate clim…

200 papers

The book is structured into four main chapters. Chapter 1 introduces the foundational concepts of divergence measures, including the well-known Kullback-Leibler divergence and its limitations. It then presents a detailed exploration of…

Methodology · Statistics 2024-09-04 Shinto Eguchi

Computing the similarity between two probability distributions is a recurring theme across control. We introduce a unified family of distances between the probability distributions of two random variables that is based on the discrepancy…

Systems and Control · Electrical Eng. & Systems 2025-10-03 Alexandros E. Tzikas , Arec Jamgochian , Nazim Kemal Ure , Mykel J. Kochenderfer , Stephen P. Boyd

$f$-divergences, which quantify discrepancy between probability distributions, are ubiquitous in information theory, machine learning, and statistics. While there are numerous methods for estimating $f$-divergences from data, a limit…

Statistics Theory · Mathematics 2023-10-13 Sreejith Sreekumar , Ziv Goldfeld , Kengo Kato

In opinion dynamics, as in general usage, polarisation is subjective. To understand polarisation, we need to develop more precise methods to measure the agreement in society. This paper presents four mathematical measures of polarisation…

Physics and Society · Physics 2023-01-11 Johnathan A. Adams , Gentry White , Robyn P. Araujo

The evaluation of climate models is a crucial step in climate studies. It consists of quantifying the resemblance of model outputs to reference data to identify models with superior capacity to replicate specific climate variables. Clearly,…

Atmospheric and Oceanic Physics · Physics 2023-07-11 Mario J. Gómez , Luis A. Barboza , Hugo G. Hidalgo , Eric J. Alfaro

We propose a methodology for intercomparing climate models and evaluating their performance against benchmarks based on the use of the Wasserstein distance (WD). This distance provides a rigorous way to measure quantitatively the difference…

Atmospheric and Oceanic Physics · Physics 2020-11-16 Gabriele Vissio , Valerio Lembo , Valerio Lucarini , Michael Ghil

Real-life data are often non-IID due to complex distributions and interactions, and the sensitivity to the distribution of samples can differ among learning models. Accordingly, a key question for any supervised or unsupervised model is…

Machine Learning · Computer Science 2023-10-03 Zhilin Zhao , Longbing Cao

This book deals with functions allowing to express the dissimilarity (discrepancy) between two data fields or ''divergence functions'' with the aim of applications to linear inverse problems. Most of the divergences found in the litterature…

Optimization and Control · Mathematics 2020-03-04 Henri Lantéri

Accurately forecasting the probability distribution of phenomena of interest is a classic and ever more widespread goal in statistics and decision theory. In comparison to point forecasts, probabilistic forecasts aim to provide a more…

Statistics Theory · Mathematics 2025-05-05 Erez Buchweitz , João Vitor Romano , Ryan J. Tibshirani

Assessing the consistency between short-term global temperature trends in observations and climate model projections is a challenging problem. While climate models capture many processes governing short-term climate fluctuations, they are…

Atmospheric and Oceanic Physics · Physics 2013-09-23 Patrick J. Michaels , Paul C. Knappenberger , John R. Christy , Chad S. Herman , Lucia M. Liljegren , James D. Annan

A number of fundamental quantities in statistical signal processing and information theory can be expressed as integral functions of two probability density functions. Such quantities are called density functionals as they map density…

Information Theory · Computer Science 2018-02-14 Alan Wisler , Visar Berisha , Andreas Spanias , Alfred O. Hero

Divergence measures have a long association with statistical inference, machine learning and information theory. The density power divergence and related measures have produced many useful (and popular) statistical procedures, which provide…

Statistics Theory · Mathematics 2022-09-07 Souvik Ray , Subrata Pal , Sumit Kumar Kar , Ayanendranath Basu

$f$-divergences are a general class of divergences between probability measures which include as special cases many commonly used divergences in probability, mathematical statistics and information theory such as Kullback-Leibler…

Statistics Theory · Mathematics 2013-10-16 Adityanand Guntuboyina , Sujayam Saha , Geoffrey Schiebinger

What does it mean to say that, for example, the probability for rain tomorrow is between 20% and 30%? The theory for the evaluation of precise probabilistic forecasts is well-developed and is grounded in the key concepts of proper scoring…

Machine Learning · Computer Science 2024-10-31 Christian Fröhlich , Robert C. Williamson

Divergence functions are measures of distance or dissimilarity between probability distributions that serve various purposes in statistics and applications. We propose decompositions of Wasserstein and Cram\'er distances$-$which compare two…

Methodology · Statistics 2025-08-08 Johannes Resin , Daniel Wolffram , Johannes Bracher , Timo Dimitriadis

We introduce a new discrepancy score between two distributions that gives an indication on their similarity. While much research has been done to determine if two samples come from exactly the same distribution, much less research…

Machine Learning · Computer Science 2012-10-16 Maayan Harel , Shie Mannor

The aim of this paper is to introduce new statistical criterions for estimation, suitable for inference in models with common continuous support. This proposal is in the direct line of a renewed interest for divergence based inference tools…

Statistics Theory · Mathematics 2015-03-19 Michel Broniatowski , Aida Toma , Igor Vajda

A loss function measures the discrepancy between the true values (observations) and their estimated fits, for a given instance of data. A loss function is said to be proper (unbiased, Fisher consistent) if the fits are defined over a unit…

Information Theory · Computer Science 2018-05-11 Amichai Painsky , Gregory W. Wornell

We compute the expected value of the Kullback-Leibler divergence to various fundamental statistical models with respect to canonical priors on the probability simplex. We obtain closed formulas for the expected model approximation errors,…

Machine Learning · Statistics 2014-06-18 Guido F. Montufar , Johannes Rauh

Inferring and comparing complex, multivariable probability density functions is fundamental to problems in several fields, including probabilistic learning, network theory, and data analysis. Classification and prediction are the two faces…

Information Theory · Computer Science 2017-03-30 David J. Galas , T. Gregory Dewey , James Kunert-Graf , Nikita A. Sakhanenko