English
Related papers

Related papers: Consistent Validation for Predictive Methods in Sp…

200 papers

Matrix-valued covariance functions are crucial to geostatistical modeling of multivariate spatial data. The classical assumption of symmetry of a multivariate covariance function is overlay restrictive and has been considered as unrealistic…

Statistics Theory · Mathematics 2017-11-28 Alfredo Alegría , Emilio Porcu , Reinhard Furrer

In our contemporary era, meteorological weather forecasts increasingly incorporate ensemble predictions of visibility - a parameter of great importance in aviation, maritime navigation, and air quality assessment, with direct implications…

Applications · Statistics 2025-08-22 Mária Lakatos , Sándor Baran

Covariate shift relaxes the widely-employed independent and identically distributed (IID) assumption by allowing different training and testing input distributions. Unfortunately, common methods for addressing covariate shift by trying to…

Machine Learning · Computer Science 2018-01-02 Anqi Liu , Brian D. Ziebart

Increasingly demanding performance requirements for dynamical systems motivates the adoption of nonlinear and adaptive control techniques. One challenge is the nonlinearity of the resulting closed-loop system complicates verification that…

Systems and Control · Computer Science 2017-10-03 John F. Quindlen , Ufuk Topcu , Girish Chowdhary , Jonathan P. How

Conformal prediction is a popular method to construct prediction intervals with marginal coverage guarantees from black-box machine learning models. In applications with potentially high-impact events, such as flooding or financial crises,…

Methodology · Statistics 2026-04-02 Olivier C. Pasche , Henry Lam , Sebastian Engelke

We provide a computationally and statistically efficient method for estimating the parameters of a stochastic covariance model observed on a regular spatial grid in any number of dimensions. Our proposed method, which we call the Debiased…

Methodology · Statistics 2022-04-27 Arthur P. Guillaumin , Adam M. Sykulski , Sofia C. Olhede , Frederik J. Simons

Conformal prediction builds marginally valid prediction intervals that cover the unknown outcome of a randomly drawn test point with a prescribed probability. However, in practice, data-driven methods are often used to identify specific…

Methodology · Statistics 2025-04-21 Ying Jin , Zhimei Ren

The complexity and accuracy of current and future precision cosmology observational campaigns has made it essential to develop an efficient technique for directly combining simulation and observational datasets to determine cosmological and…

Astrophysics · Physics 2009-11-11 Katrin Heitmann , David Higdon , Charles Nakhleh , Salman Habib

We introduce a general methodology for quantitative model checking and control synthesis with supermartingale certificates. We show that every specification that is invariant to time shifts admits a stochastic invariant that bounds its…

Logic in Computer Science · Computer Science 2025-04-08 Alessandro Abate , Mirco Giacobbe , Diptarko Roy

Standard supervised learning procedures are validated against a test set that is assumed to have come from the same distribution as the training data. However, in many problems, the test data may have come from a different distribution. We…

Machine Learning · Statistics 2019-08-28 Tim Coleman , Kimberly Kaufeld , Mary Frances Dorn , Lucas Mentch

Stochastic multi-agent systems are a central modeling framework for autonomous controllers, communication protocols, and cyber-physical infrastructures. In many such systems, however, transition probabilities are only estimated from data…

Logic in Computer Science · Computer Science 2026-02-17 Raphaël Berthon , Joost-Pieter Katoen , Munyque Mittelmann , Aniello Murano

Classical Krylov subspace projection methods for the solution of linear problem $Ax = b$ output an approximate solution $\widetilde{x}\simeq x$. Recently, it has been recognized that projection methods can be understood from a statistical…

Numerical Analysis · Mathematics 2024-02-09 Vladimir Fanaskov

Spatial prediction is a fundamental task in geography. In recent years, with advances in geospatial artificial intelligence (GeoAI), numerous models have been developed to improve the accuracy of geographic variable predictions. Beyond…

Machine Learning · Statistics 2025-04-29 Xiayin Lou , Peng Luo , Liqiu Meng

Spatio-temporal covariances are important for describing the spatio-temporal variability of underlying random processes in geostatistical data. For second-order stationary processes, there exist subclasses of covariance functions that…

Applications · Statistics 2017-05-05 Huang Huang , Ying Sun

Weighted conformal prediction (WCP) has been commonly used to quantify prediction uncertainty under covariate shift. However, the effectiveness of WCP relies heavily on the degree of overlap between the training and test covariate…

Methodology · Statistics 2026-04-02 Mufang Ying , Wenge Guo , Koulik Khamaru , Ying Hung

Dataset shift is common in credit scoring scenarios, and the inconsistency between the distribution of training data and the data that actually needs to be predicted is likely to cause poor model performance. However, most of the current…

Machine Learning · Computer Science 2021-12-21 Hongyi Qian , Baohui Wang , Ping Ma , Lei Peng , Songfeng Gao , You Song

When a machine learning model is deployed, its predictions can alter its environment, as better informed agents strategize to suit their own interests. With such alterations in mind, existing approaches to uncertainty quantification break.…

Machine Learning · Statistics 2024-11-05 Daniel Csillag , Claudio José Struchiner , Guilherme Tegoni Goedert

Conformal Predictive Systems (CPS) offer a versatile framework for constructing predictive distributions, allowing for calibrated inference and informative decision-making. However, their applicability has been limited to scenarios adhering…

Machine Learning · Computer Science 2024-10-17 Jef Jonkers , Glenn Van Wallendael , Luc Duchateau , Sofie Van Hoecke

This paper investigates the cross-correlations across multiple climate model errors. We build a Bayesian hierarchical model that accounts for the spatial dependence of individual models as well as cross-covariances across different climate…

Applications · Statistics 2012-03-02 Huiyan Sang , Mikyoung Jun , Jianhua Z. Huang

In a regression model, prediction is typically performed after model selection. The large variability in the model selection makes the prediction unstable. Thus, it is essential to reduce the variability in model selection and improve…

Computation · Statistics 2024-04-11 Wataru Yoshida , Kei Hirose