English
Related papers

Related papers: From Proper Scoring Rules to Max-Min Optimal Forec…

200 papers

Conformal prediction offers a distribution-free framework for constructing prediction sets with finite-sample coverage. Yet, efficiently leveraging multiple conformity scores to reduce prediction set size remains a major open challenge.…

Methodology · Statistics 2025-11-18 Congbin Xu , Yue Yu , Haojie Ren , Zhaojun Wang , Changliang Zou

In this brief paper, we present a naive aggregation algorithm for a typical learning problem with expert advice setting, in which the task of improving generalization, i.e., model validation, is embedded in the learning process as a…

Machine Learning · Computer Science 2024-09-09 Getachew K Befekadu

A scoring rule is a loss function measuring the quality of a quoted probability distribution $Q$ for a random variable $X$, in the light of the realized outcome $x$ of $X$; it is proper if the expected score, under any distribution $P$ for…

Statistics Theory · Mathematics 2012-06-01 A. Philip Dawid , Steffen Lauritzen , Matthew Parry

Rating aggregation plays a crucial role in various fields, such as product recommendations, hotel rankings, and teaching evaluations. However, traditional averaging methods can be affected by participation bias, where some raters do not…

Machine Learning · Computer Science 2025-02-07 Yongkang Guo , Yuqing Kong , Jialiang Liu

In this paper, we study the accuracy of values aggregated over classes predicted by a classification algorithm. The problem is that the resulting aggregates (e.g., sums of a variable) are known to be biased. The bias can be large even for…

Machine Learning · Statistics 2019-12-02 Q. A. Meertens , C. G. H. Diks , H. J. van den Herik , F W Takes

We consider the problem of aggregating a general collection of affine estimators for fixed design regression. Relevant examples include some commonly used statistical estimators such as least squares, ridge and robust least squares…

Statistics Theory · Mathematics 2013-11-13 Dong Dai , Philippe Rigollet , Lucy Xia , Tong Zhang

In deadline-constrained data aggregation in wireless sensor networks (WSNs), the imposed sink deadline along with the interference constraint hinders participation of all sensor nodes in data aggregation. Thus, exploiting the wisdom of the…

Networking and Internet Architecture · Computer Science 2014-08-01 Bahram Alinia , Mohammad H. Hajiesmaili , Ahmad Khonsari

Matching methods are widely used for causal inference in observational studies. Among them, nearest neighbor matching is arguably the most popular. However, nearest neighbor matching does not generally yield an average treatment effect…

Statistics Theory · Mathematics 2021-10-06 Yixin Wang , José R. Zubizarreta

The quality of probabilistic forecasts is crucial for decision-making under uncertainty. While proper scoring rules incentivize truthful reporting of precise forecasts, they fall short when forecasters face epistemic uncertainty about their…

Machine Learning · Computer Science 2025-07-18 Anurag Singh , Siu Lun Chau , Krikamol Muandet

Kriging is a widely employed technique, in particular for computer experiments, in machine learning or in geostatistics. An important challenge for Kriging is the computational burden when the data set is large. This article focuses on a…

Statistics Theory · Mathematics 2021-03-01 François Bachoc , Nicolas Durrande , Didier Rullière , Clément Chevalier

In mixture model-based clustering applications, it is common to fit several models from a family and report clustering results from only the `best' one. In such circumstances, selection of this best model is achieved using a model selection…

Methodology · Statistics 2017-10-09 Yuhong Wei , Paul D. McNicholas

Simulating energy systems is vital for energy planning to understand the effects of fluctuating renewable energy sources and integration of multiple energy sectors. Capacity expansion is a powerful tool for energy analysts and consists of…

Systems and Control · Electrical Eng. & Systems 2020-12-21 Mette Gamst , Stefanie Buchholz , David Pisinger

Long range forecasts are the starting point of many decision support systems that need to draw inference from high-level aggregate patterns on forecasted values. State of the art time-series forecasting methods are either subject to concept…

Machine Learning · Computer Science 2022-05-27 Prathamesh Deshpande , Sunita Sarawagi

Given a random variable $O \in \mathbb{R}$ and a set of experts $E$, we describe a method for finding a subset of experts $S \subseteq E$ whose aggregated opinion best predicts the outcome of $O$. Therefore, the problem can be regarded as a…

Data Structures and Algorithms · Computer Science 2015-04-28 MohammadAmin Fazli , Azin Ghazimatin , Jafar Habibi , Hamid Haghshenas

Many Numerical Weather Prediction (NWP) models and their associated Model Output Statistics (MOS) are available. Combining all of these predictions in an optimal way is however not straightforward. This can be achieved thanks to Expert…

Optimization and Control · Mathematics 2025-06-19 Léo Pfitzner , Olivier Wintenberger , Olivier Mestre , Marion Riverain

Machine learning algorithms dedicated to financial time series forecasting have gained a lot of interest. But choosing between several algorithms can be challenging, as their estimation accuracy may be unstable over time. Online aggregation…

Statistical Finance · Quantitative Finance 2023-07-07 Carl Remlinger , Brière Marie , Alasseur Clémence , Joseph Mikael

Performative predictions are forecasts which influence the outcomes they aim to predict, undermining the existence of correct forecasts and standard methods of elicitation and estimation. We show that conditioning forecasts on covariates…

Statistics Theory · Mathematics 2025-10-27 Philip Boeken , Onno Zoeter , Joris M. Mooij

We propose a clustering-based iterative algorithm to solve certain optimization problems in machine learning, where we start the algorithm by aggregating the original data, solving the problem on aggregated data, and then in subsequent…

Machine Learning · Statistics 2017-01-23 Young Woong Park , Diego Klabjan

Density aggregation is a central problem in machine learning, for instance when combining predictions from a Deep Ensemble. The choice of aggregation remains an open question with two commonly proposed approaches being linear pooling…

We propose an inexact variable-metric proximal point algorithm to accelerate gradient-based optimization algorithms. The proposed scheme, called QNing can be notably applied to incremental first-order methods such as the stochastic…

Machine Learning · Statistics 2019-01-30 Hongzhou Lin , Julien Mairal , Zaid Harchaoui