English
Related papers

Related papers: Scoring Alternative Forecast Distributions: Comple…

200 papers

We study optimal solutions to an abstract optimization problem for measures, which is a generalization of classical variational problems in information theory and statistical physics. In the classical problems, information and relative…

Optimization and Control · Mathematics 2021-11-23 Roman V. Belavkin

Testing whether two multivariate samples exhibit the same extremal behavior is an important problem in various fields including environmental and climate sciences. While several ad-hoc approaches exist in the literature, they often lack…

Statistics Theory · Mathematics 2026-02-03 Sebastian Engelke , Philippe Naveau , Chen Zhou

We address the problem of uncertainty quantification and propose measures of total, aleatoric, and epistemic uncertainty based on a known decomposition of (strictly) proper scoring rules, a specific type of loss function, into a divergence…

Machine Learning · Computer Science 2025-05-29 Paul Hofman , Yusuf Sale , Eyke Hüllermeier

In binary classification tasks, accurate representation of probabilistic predictions is essential for various real-world applications such as predicting payment defaults or assessing medical risks. The model must then be well-calibrated to…

Machine Learning · Computer Science 2024-08-08 Agathe Fernandes Machado , Arthur Charpentier , Emmanuel Flachaire , Ewen Gallic , François Hu

The capability of a novel Kullback-Leibler divergence method is examined herein within the Kalman filter framework to select the input-parameter-state estimation execution with the most plausible results. This identification suffers from…

Signal Processing · Electrical Eng. & Systems 2025-11-05 Marios Impraimakis

Formalising the confrontation of opinions (models) to observations (data) is the task of Inferential Statistics. Information Theory provides us with a basic functional, the relative entropy (or Kullback-Leibler divergence), an asymmetrical…

Information Theory · Computer Science 2015-03-13 François Bavaud

Recently, continual learning has received a lot of attention. One of the significant problems is the occurrence of \emph{concept drift}, which consists of changing probabilistic characteristics of the incoming data. In the case of the…

Machine Learning · Computer Science 2022-10-11 Sebastián Basterrech , Michal Woźniak

Selecting an appropriate divergence measure is a critical aspect of machine learning, as it directly impacts model performance. Among the most widely used, we find the Kullback-Leibler (KL) divergence, originally introduced in kinetic…

Mathematical Physics · Physics 2025-07-16 Gennaro Auricchio , Giovanni Brigati , Paolo Giudici , Giuseppe Toscani

Complex, high-dimensional data is ubiquitous across many scientific disciplines, including machine learning, biology, and the social sciences. One of the primary methods of visualizing these datasets is with two-dimensional scatter plots…

Machine Learning · Computer Science 2025-10-13 Kiran Smelser , Kaviru Gunaratne , Jacob Miller , Stephen Kobourov

The classical paradigm of scoring rules is to discriminate between two different forecasts by comparing them with observations. The probability distribution of the observed record is assumed to be perfect as a verification benchmark. In…

Methodology · Statistics 2021-08-06 Julie Bessac , Philippe Naveau

Bayesian nonparametric statistics is an area of considerable research interest. While recently there has been an extensive concentration in developing Bayesian nonparametric procedures for model checking, the use of the Dirichlet process,…

Statistics Theory · Mathematics 2019-03-15 Luai Al-Labadi , Viskakh Patel , Kasra Vakiloroayaei , Clement Wan

In a variety of applications it is important to extract information from a probability measure $\mu$ on an infinite dimensional space. Examples include the Bayesian approach to inverse problems and possibly conditioned) continuous time…

Probability · Mathematics 2016-06-02 Frank Pinski , Gideon Simpson , Andrew Stuart , Hendrik Weber

We analyze dynamical properties of the Shannon information entropy of a continuous probability distribution, which is driven by a standard diffusion process. This entropy choice is confronted with another option, employing the conditional…

Statistical Mechanics · Physics 2016-08-31 Piotr Garbaczewski

We address quantum estimation in situations where one has at disposal data from the measurement of an incomplete set of observables and some a priori information on the state itself. By expressing the a priori information in terms of a bias…

Quantum Physics · Physics 2009-11-13 Stefano Olivares , Matteo G. A. Paris

As the popularity of hierarchical point forecast reconciliation methods increases, there is a growing interest in probabilistic forecast reconciliation. Many studies have utilized machine learning or deep learning techniques to implement…

Artificial Intelligence · Computer Science 2023-11-22 Guanyu Zhang , Feng Li , Yanfei Kang

Experimental designs are tools which can drastically reduce the number of simulations required by time-consuming computer codes. One strategy for selecting the values of the inputs, whose response is to be observed, is to choose these…

Statistics Theory · Mathematics 2009-04-17 Astrid Jourdan , Jessica Franco

We propose a new model selection method, the posterior averaging information criterion, for Bayesian model assessment from a predictive perspective. The theoretical foundation is built on the Kullback-Leibler divergence to quantify the…

Methodology · Statistics 2020-09-22 Shouhao Zhou

The Kullback-Leibler (KL) divergence is a foundational measure for comparing probability distributions. Yet in multivariate settings, its single value often obscures the underlying reasons for divergence, conflating mismatches in individual…

Other Computer Science · Computer Science 2025-05-06 William Cook

Randomness in scientific estimation is generally assumed to arise from unmeasured or uncontrolled factors. However, when combining subjective probability estimates, heterogeneity stemming from people's cognitive or information diversity is…

Methodology · Statistics 2015-05-28 Ville Satopää , Robin Pemantle , Lyle Ungar

Many forecasts consist not of point predictions but concern the evolution of quantities. For example, a central bank might predict the interest rates during the next quarter, an epidemiologist might predict trajectories of infection rates,…

Methodology · Statistics 2021-11-12 Patric Bonnier , Harald Oberhauser