English
Related papers

Related papers: Estimating discriminatory power and PD curves when…

200 papers

The predictiveness curve is a valuable tool for predictive evaluation, risk stratification, and threshold selection in a target population, given a single biomarker or a prediction model. In the presence of competing risks, regression…

Methodology · Statistics 2025-08-04 Wei Tao , Jing Ning , Wen Li , Wenyaw Chan , Xi Luo , Ruosha Li

In this paper we develop a framework for estimating Probability of Default (PD) based on stochastic models governing an appropriate asset value processes. In particular, we build upon a L\'evy-driven Ornstein-Uhlenbeck process and consider…

Risk Management · Quantitative Finance 2023-09-25 Kyriakos Georgiou , Athanasios N. Yannacopoulos

Bayesian error analysis paves the way to the construction of credible and plausible error regions for a point estimator obtained from a given dataset. We introduce the concept of region accuracy for error regions (a generalization of the…

Quantum Physics · Physics 2019-07-15 Changhun Oh , Yong Siah Teo , Hyunseok Jeong

Reliable estimation of predictive uncertainty is crucial for machine learning applications, particularly in high-stakes scenarios where hedging against risks is essential. Despite its significance, there is no universal agreement on how to…

Machine Learning · Computer Science 2025-06-17 Kajetan Schweighofer , Lukas Aichberger , Mykyta Ielanskyi , Sepp Hochreiter

The area under the ROC curve (AUC) is a widely used performance measure in machine learning. Increasingly, however, in several applications, ranging from ranking to biometric screening to medicine, performance is measured not in terms of…

Machine Learning · Computer Science 2016-11-29 Harikrishna Narasimhan , Shivani Agarwal

We consider the problem of estimating a dose-response curve. Continuous treatments arise often in practice, e.g. in the form of time spent on an operation, distance traveled to a location or dosage of a drug. Letting $A$ denote a continuous…

Methodology · Statistics 2026-04-14 Matteo Bonvini , Edward H. Kennedy

We discuss two novel approaches to the classical two-sample problem. Our starting point are properly standardized and combined, very popular in several areas of statistics and data analysis, ordinal dominance and receiver characteristic…

Methodology · Statistics 2024-01-26 Teresa Ledwina , Adam Zagdański

We introduce Parametric Density Path Optimization (PDPO), a novel method for computing action-minimizing paths between probability densities. The core idea is to represent the target probability path as the pushforward of a reference…

Optimization and Control · Mathematics 2025-12-08 Sebastian Gutierrez Hernandez , Peng Chen , Haomin Zhou

Confidence curves are used in uncertainty validation to assess how large uncertainties ($u_{E}$) are associated with large errors ($E$). An oracle curve is commonly used as reference to estimate the quality of the tested datasets. The…

Data Analysis, Statistics and Probability · Physics 2022-12-20 Pascal Pernot

This paper studies the numerical approximation of parametric time-dependent partial differential equations (PDEs) by proper orthogonal decomposition reduced order models (POD-ROMs). Although many papers in the literature consider reduced…

Numerical Analysis · Mathematics 2025-04-28 Bosco García-Arcilla , Alicia García-Mascaraque , Julia Novo

We consider the problem of correctly identifying the \textit{mode} of a discrete distribution $\mathcal{P}$ with sufficiently high probability by observing a sequence of i.i.d. samples drawn from $\mathcal{P}$. This problem reduces to the…

Differential equations are pivotal in modeling and understanding the dynamics of various systems, offering insights into their future states through parameter estimation fitted to time series data. In fields such as economy, politics, and…

Machine Learning · Statistics 2024-04-24 Hyeontae Jo , Sung Woong Cho , Hyung Ju Hwang

This work presents a distributed method for control centers to monitor the operating condition of a power network, i.e., to estimate the network state, and to ultimately determine the occurrence of threatening situations. State estimation…

Optimization and Control · Mathematics 2011-07-13 Fabio Pasqualetti , Ruggero Carli , Francesco Bullo

Existing statistical methods in causal inference often assume the positivity condition, where every individual has some chance of receiving any treatment level regardless of covariates. This assumption could be violated in observational…

Methodology · Statistics 2025-01-22 Yikun Zhang , Yen-Chi Chen , Alexander Giessing

While probabilistic forecast verification for categorical forecasts is well established, some of the existing concepts and methods have not found their equivalent for the case of continuous variables. New tools dedicated to the assessment…

Atmospheric and Oceanic Physics · Physics 2015-10-02 Zied Ben Bouallegue , Pierre Pinson , Petra Friederichs

Researchers commonly use difference-in-differences (DiD) designs to evaluate public policy interventions. While methods exist for estimating effects in the context of binary interventions, policies often result in varied exposures across…

Methodology · Statistics 2025-02-07 Gary Hettinger , Youjin Lee , Nandita Mitra

Recalibration of binary probabilistic classifiers to a target prior probability is an important task in areas like credit risk management. However, recalibration of a classifier learned on a training dataset to a target on a test dataset in…

Machine Learning · Computer Science 2026-02-02 Dirk Tasche

Classification models typically predict a score and use a decision threshold to produce a classification. Appropriate model evaluation should carefully consider the context in which a model will be used, including the relative value of…

Machine Learning · Computer Science 2025-09-30 Louise AC Millard , Peter A Flach

We study the robustness of system estimation to parametric perturbations in system dynamics and initial conditions. We define the problem of sensitivity-based parametric uncertainty quantification in dynamical system estimation. The main…

Systems and Control · Electrical Eng. & Systems 2025-09-09 Ayush Pandey

Accurate conditional prediction in the regression setting plays an important role in many real-world problems. Typically, a point prediction often falls short since no attempt is made to quantify the prediction accuracy. Classically, under…

Methodology · Statistics 2025-09-04 Kejin Wu , Dimitris N. Politis