English
Related papers

Related papers: Distribution Calibration for Regression

200 papers

Understanding variable dependence, particularly eliciting their statistical properties given a set of covariates, provides the mathematical foundation in practical operations management such as risk analysis and decision-making given…

Methodology · Statistics 2023-09-06 Yunyun Wang , Tatsushi Oka , Dan Zhu

We develop a new method for multivariate scalar on multidimensional distribution regression. Traditional approaches typically analyze isolated univariate scalar outcomes or consider unidimensional distributional representations as…

Methodology · Statistics 2023-10-17 Rahul Ghosal , Marcos Matabuena

Distributed calibration based on consensus optimization is a computationally efficient method to calibrate large radio interferometers such as LOFAR and SKA. Calibrating along multiple directions in the sky and removing the bright…

Instrumentation and Methods for Astrophysics · Physics 2021-10-29 Sarod Yatawatta

The classic concept of "calibrated forecasts" and its more recent refinement, "calibeating," are defined with respect to the standard quadratic scoring rule. We extend these notions to the class of $\textit{proper}$ scoring rules (for which…

Theoretical Economics · Economics 2026-05-28 Dean P. Foster , Sergiu Hart

Obtaining reliable and accurate quantification of uncertainty estimates from deep neural networks is important in safety-critical applications. A well-calibrated model should be accurate when it is certain about its prediction and indicate…

Machine Learning · Computer Science 2020-12-16 Ranganath Krishnan , Omesh Tickoo

Regression evaluation has been performed for decades. Some metrics have been identified to be robust against shifting and scaling of the data but considering the different distributions of data is much more difficult to address (imbalance…

Machine Learning · Computer Science 2020-09-14 Mario Michael Krell , Bilal Wehbe

It is becoming increasingly common in regression to train neural networks that model the entire distribution even if only the mean is required for prediction. This additional modeling often comes with performance gain and the reasons behind…

Machine Learning · Computer Science 2024-10-22 Ehsan Imani , Kai Luedemann , Sam Scholnick-Hughes , Esraa Elelimy , Martha White

In this paper, we study the problem of deriving fast and accurate classification algorithms with uncertainty quantification. Gaussian process classification provides a principled approach, but the corresponding computational burden is…

Machine Learning · Computer Science 2018-05-29 Dimitrios Milios , Raffaello Camoriano , Pietro Michiardi , Lorenzo Rosasco , Maurizio Filippone

We consider the problem of model multiplicity in downstream decision-making, a setting where two predictive models of equivalent accuracy cannot agree on the best-response action for a downstream loss function. We show that even when the…

Machine Learning · Computer Science 2024-05-31 Ally Yalei Du , Dung Daniel Ngo , Zhiwei Steven Wu

For users to trust model predictions, they need to understand model outputs, particularly their confidence - calibration aims to adjust (calibrate) models' confidence to match expected accuracy. We argue that the traditional calibration…

Computation and Language · Computer Science 2022-10-25 Chenglei Si , Chen Zhao , Sewon Min , Jordan Boyd-Graber

We propose a novel machine learning approach for forecasting the distribution of stock returns using a rich set of firm-level and market predictors. Our method combines a two-stage quantile neural network with spline interpolation to…

General Finance · Quantitative Finance 2025-08-05 Jozef Barunik , Martin Hronec , Ondrej Tobek

This paper proposes a new approach to estimating the distribution of a response variable conditioned on observing some factors. The proposed approach possesses desirable properties of flexibility, interpretability, tractability and…

Methodology · Statistics 2023-03-16 Cheng Peng , Stanislav Uryasev

Predicting risks of chronic diseases has become increasingly important in clinical practice. When a prediction model is developed in a given source cohort, there is often a great interest to apply the model to other cohorts. However, due to…

Methodology · Statistics 2020-03-05 Zheng Jiayin , Zheng Yingye , Hsu Li

The generalization ability of machine learning models degrades significantly when the test distribution shifts away from the training distribution. We investigate the problem of training models that are robust to shifts caused by changes in…

Machine Learning · Computer Science 2023-09-19 Jiaheng Wei , Harikrishna Narasimhan , Ehsan Amid , Wen-Sheng Chu , Yang Liu , Abhishek Kumar

Probabilistic predictions can be evaluated through comparisons with observed label frequencies, that is, through the lens of calibration. Recent scholarship on algorithmic fairness has started to look at a growing variety of…

Machine Learning · Computer Science 2023-05-16 Benedikt Höltgen , Robert C Williamson

We develop a method to generate predictive regions that cover a multivariate response variable with a user-specified probability. Our work is composed of two components. First, we use a deep generative model to learn a representation of the…

Machine Learning · Computer Science 2022-12-26 Shai Feldman , Stephen Bates , Yaniv Romano

Robust regression has attracted a great amount of attention in the literature recently, particularly for taking asymmetricity into account simultaneously and for high-dimensional analysis. However, the majority of research on the topics…

Methodology · Statistics 2023-07-25 Sanna Soomro , Keming Yu , Yan Yu

Most classification models work by first predicting a posterior probability distribution over all classes and then selecting that class with the largest estimated probability. In many settings however, the quality of posterior probability…

Computation and Language · Computer Science 2020-05-04 Taehee Jung , Dongyeop Kang , Hua Cheng , Lucas Mentch , Thomas Schaaf

A decision-theoretic characterization of perfect calibration is that an agent seeking to minimize a proper loss in expectation cannot improve their outcome by post-processing a perfectly calibrated predictor. Hu and Wu (FOCS'24) use this to…

Machine Learning · Computer Science 2025-11-18 Parikshit Gopalan , Konstantinos Stavropoulos , Kunal Talwar , Pranay Tankala

We propose a novel regression adjustment method designed for estimating distributional treatment effect parameters in randomized experiments. Randomized experiments have been extensively used to estimate treatment effects in various…

Econometrics · Economics 2024-07-24 Undral Byambadalai , Tatsushi Oka , Shota Yasui