English
Related papers

Related papers: Conformal Prediction for Compositional Data

200 papers

We introduce our method, conformal highest conditional density sets (CHCDS), that forms conformal prediction sets using existing estimated conditional highest density predictive regions. We prove the validity of the method, and that…

Methodology · Statistics 2025-04-09 Max Sampson , Kung-Sik Chan

Optimal decision-making compels us to anticipate the future at different horizons. However, in many domains connecting together predictions from multiple time horizons and abstractions levels across their organization becomes all the more…

Machine Learning · Computer Science 2023-07-06 Julien Leprince , Henrik Madsen , Jan Kloppenborg Møller , Wim Zeiler

In this paper, we introduce a conformal prediction method to construct prediction sets in a oneshot federated learning setting. More specifically, we define a quantile-of-quantiles estimator and prove that for any distribution, it is…

Machine Learning · Statistics 2023-08-01 Pierre Humbert , Batiste Le Bars , Aurélien Bellet , Sylvain Arlot

The Regression Discontinuity Design (RDD) is a quasi-experimental design that estimates the causal effect of a treatment when its assignment is defined by a threshold value for a continuous assignment variable. The RDD assumes that subjects…

Applications · Statistics 2020-03-27 Federico Ricciardi , Silvia Liverani , Gianluca Baio

Conformal prediction is a statistical tool for producing prediction regions of machine learning models that are valid with high probability. However, applying conformal prediction to time series data leads to conservative prediction…

Systems and Control · Electrical Eng. & Systems 2024-01-10 Matthew Cleaveland , Insup Lee , George J. Pappas , Lars Lindemann

As deep learning predictive models become an integral part of a large spectrum of precision agricultural systems, a barrier to the adoption of such automated solutions is the lack of user trust in these highly complex, opaque and uncertain…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Paul Melki , Lionel Bombrun , Boubacar Diallo , Jérôme Dias , Jean-Pierre da Costa

In this paper, we address the problem of predicting a response variable in the context of both, spatially correlated and high-dimensional data. To reduce the dimensionality of the predictor variables, we apply the sufficient dimension…

Methodology · Statistics 2025-02-06 Liliana Forzani , Rodrigo García Arancibia , Antonella Gieco , Pamela Llop , Anne Yao

Simulating coupled PDE systems is computationally intensive, and prior efforts have largely focused on training surrogates on the joint (coupled) data, which requires a large amount of data. In the paper, we study compositional diffusion…

Machine Learning · Statistics 2025-10-24 Somayajulu L. N. Dhulipala , Deep Ray , Nicholas Forman

Full conformal prediction is a framework that implicitly formulates distribution-free confidence prediction regions for a wide range of estimators. However, a classical limitation of the full conformal framework is the computation of the…

Machine Learning · Statistics 2026-01-27 Davidson Lova Razafindrakoto , Alain Celisse , Jérôme Lacaille

Interest has been growing in decision-focused machine learning methods which train models to account for how their predictions are used in downstream optimization problems. Doing so can often improve performance on subsequent decision…

Machine Learning · Computer Science 2025-03-03 Santiago Cortes-Gomez , Carlos Patiño , Yewon Byun , Steven Wu , Eric Horvitz , Bryan Wilder

A reliable representation of uncertainty is essential for the application of modern machine learning methods in safety-critical settings. In this regard, the use of credal sets (i.e., convex sets of probability distributions) has recently…

Machine Learning · Computer Science 2026-03-10 Paul Hofman , Timo Löhr , Maximilian Muschalik , Yusuf Sale , Eyke Hüllermeier

This paper presents a new conformal method for generating simultaneous forecasting bands guaranteed to cover the entire path of a new random trajectory with sufficiently high probability. Prompted by the need for dependable uncertainty…

Machine Learning · Statistics 2024-05-16 Yanfei Zhou , Lars Lindemann , Matteo Sesia

Conformal inference is a statistical method used to construct prediction sets for point predictors, providing reliable uncertainty quantification with probability guarantees. This method utilizes historical labeled data to estimate the…

Machine Learning · Computer Science 2024-11-05 Xiaoyi Su , Zhixin Zhou , Rui Luo

To facilitate effective decision-making, precipitation datasets should include uncertainty estimates. Quantile regression with machine learning has been proposed for issuing such estimates. Distributional regression offers distinct…

Machine Learning · Computer Science 2025-01-07 Georgia Papacharalampous , Hristos Tyralis , Nikolaos Doulamis , Anastasios Doulamis

High-dimensional compositional data, such as those from human microbiome studies, pose unique statistical challenges due to the simplex constraint and excess zeros. While dimension reduction is indispensable for analyzing such data,…

Methodology · Statistics 2025-09-09 Junyoung Park , Cheolwoo Park , Jeongyoun Ahn

Conformal prediction is a non-parametric technique for constructing prediction intervals or sets from arbitrary predictive models under the assumption that the data is exchangeable. It is popular as it comes with theoretical guarantees on…

Machine Learning · Statistics 2025-12-01 Jase Clarkson , Wenkai Xu , Mihai Cucuringu , Yvik Swan , Gesine Reinert

We propose a multi-scale extension of conformal prediction, an approach that constructs prediction sets with finite-sample coverage guarantees under minimal statistical assumptions. Classic conformal prediction relies on a single notion of…

Statistics Theory · Mathematics 2025-02-11 Ali Baheri , Marzieh Amiri Shahbazi

Applications such as the analysis of microbiome data have led to renewed interest in statistical methods for compositional data, i.e., multivariate data in the form of probability vectors that contain relative proportions. In particular,…

Methodology · Statistics 2021-09-13 Shiqing Yu , Mathias Drton , Ali Shojaie

Compositional data and multivariate count data with known totals are challenging to analyse due to the non-negativity and sum-to-one constraints on the sample space. It is often the case that many of the compositional components are highly…

Methodology · Statistics 2020-12-24 Janice L. Scealy , Andrew T. A. Wood

Common techniques for the spatial discretisation of PDEs on a macroscale grid include finite difference, finite elements and finite volume methods. Such methods typically impose assumed microscale structures on the subgrid fields, so…

Dynamical Systems · Mathematics 2022-04-15 J. E. Bunder , A. J. Roberts