English
Related papers

Related papers: Proper local scoring rules on discrete sample spac…

200 papers

Given an $n$-sample of random vectors $(X_i,Y_i)_{1 \leq i \leq n}$ whose joint law is unknown, the long-standing problem of supervised classification aims to \textit{optimally} predict the label $Y$ of a given a new observation $X$. In…

Statistics Theory · Mathematics 2014-11-06 Sébastien Gadat , Thierry Klein , Clément Marteau

We provide self-contained proof of a theorem relating probabilistic coherence of forecasts to their non-domination by rival forecasts with respect to any proper scoring rule. The theorem appears to be new but is closely related to results…

Machine Learning · Statistics 2016-11-15 Joel Predd , Robert Seiringer , Elliott H. Lieb , Daniel Osherson , Vincent Poor , Sanjeev Kulkarni

The classic concept of "calibrated forecasts" and its more recent refinement, "calibeating," are defined with respect to the standard quadratic scoring rule. We extend these notions to the class of $\textit{proper}$ scoring rules (for which…

Theoretical Economics · Economics 2026-05-28 Dean P. Foster , Sergiu Hart

To assess the quality of a probabilistic prediction for stochastic dynamical systems (SDSs), scoring rules assign a numerical score based on the predictive distribution and the measured state. In this paper, we propose an…

Information Theory · Computer Science 2025-04-25 Tao Xu , Yushan Li , Jianping He

Multi-dimensional distributions whose marginal distributions are uniform are called copulas. Among them, the one that satisfies given constraints on expectation and is closest to the independent distribution in the sense of Kullback-Leibler…

Methodology · Statistics 2022-04-11 Yici Chen , Tomonari Sei

In Bayesian inference, predictive distributions are typically in the form of samples generated via Markov chain Monte Carlo (MCMC) or related algorithms. In this paper, we conduct a systematic analysis of how to make and evaluate…

Methodology · Statistics 2020-06-25 Fabian Krüger , Sebastian Lerch , Thordis L. Thorarinsdottir , Tilmann Gneiting

This paper shows that a wide class of effective learning rules -- those that improve a scalar performance measure over a given time window -- can be rewritten as natural gradient descent with respect to a suitably defined loss function and…

Machine Learning · Computer Science 2024-09-26 Lucas Shoji , Kenta Suzuki , Leo Kozachkov

Scoring systems are classification models that only require users to add, subtract and multiply a few meaningful numbers to make a prediction. These models are often used because they are practical and interpretable. In this paper, we…

Machine Learning · Statistics 2014-04-14 Berk Ustun , Stefano Tracà , Cynthia Rudin

Contextual learning seeks to learn a decision policy that maps an individual's characteristics to an action through data collection. In operations management, such data may come from various sources, and a central question is when data…

Optimization and Control · Mathematics 2026-04-10 Mingrui Ding , Qiuhong Zhao , Siyang Gao , Jing Dong

We construct a classifier which attains the rate of convergence $\log n/n$ under sparsity and margin assumptions. An approach close to the one met in approximation theory for the estimation of function is used to obtain this result. The…

Statistics Theory · Mathematics 2016-08-16 Guillaume Lecué

Probabilistic forecasts in the form of probability distributions over future events have become popular in several fields including meteorology, hydrology, economics, and demography. In typical applications, many alternative statistical…

Computation · Statistics 2018-07-31 Alexander Jordan , Fabian Krüger , Sebastian Lerch

We consider the centralized optimal estimation problem in spatially distributed systems. We use the setting of spatially invariant systems as an idealization for which concrete and detailed results are given. Such estimators are known to…

Systems and Control · Electrical Eng. & Systems 2024-11-05 Juncal Arbelaiz , Bassam Bamieh , Anette E. Hosoi , Ali Jadbabaie

Scoring rules promote rational and honest decision-making, which is important for model evaluation and becoming increasingly important for automated procedures such as `AutoML'. In this paper we survey common squared and logarithmic scoring…

Statistics Theory · Mathematics 2025-06-03 Raphael Sonabend , John Zobolas , Riccardo Be Bin , Philipp Kopper , Lukas Burk , Andreas Bender

A confidence distribution is a distribution for a parameter of interest based on a parametric statistical model. As such, it serves the same purpose for frequentist statisticians as a posterior distribution for Bayesians, since it allows to…

Methodology · Statistics 2021-09-06 Erlis Ruli , Laura Ventura , Monica Musio

Distributional regression aims at estimating the conditional distribution of a targetvariable given explanatory co-variates. It is a crucial tool for forecasting whena precise uncertainty quantification is required. A popular methodology…

Statistics Theory · Mathematics 2024-11-22 Clément Dombry , Ahmed Zaoui

Probabilistic forecasting relies on past observations to provide a probability distribution for a future outcome, which is often evaluated against the realization using a scoring rule. Here, we perform probabilistic forecasting with…

Machine Learning · Statistics 2024-03-06 Lorenzo Pacchiardi , Rilwan Adewoyin , Peter Dueben , Ritabrata Dutta

Given a loss function $F:\mathcal{X} \rightarrow \R^+$ that can be written as the sum of losses over a large set of inputs $a_1,\ldots, a_n$, it is often desirable to approximate $F$ by subsampling the input points. Strong theoretical…

Optimization and Control · Mathematics 2020-03-20 Anant Raj , Cameron Musco , Lester Mackey

Statistical system models provide the basis for the examination of various sorts of distributions. Classification distributions are a very common and versatile form of statistics in e.g. real economic, social, and IT systems. The…

Computation · Statistics 2019-12-20 Uwe Petersohn , Thomas Dedek , Sandra Zimmer , Hans Biskupski

Consider a real-valued function that can only be observed with stochastic noise at a finite set of design points within a Euclidean space. We wish to determine whether there exists a convex function that goes through the true function…

Other Statistics · Statistics 2018-07-30 Nanjing Jian , Shane G. Henderson

We consider a measurable stationary Gaussian stochastic process. A criterion for testing hypotheses about the covariance function of such a process using estimates for its norm in the space $L_p(\mathbb {T}),\,p\geq1$, is constructed.

Probability · Mathematics 2015-03-19 Yuriy Kozachenko , Viktor Troshki