English

Split Localized Conformal Prediction

Machine Learning 2023-02-21 v2 Machine Learning

Abstract

Conformal prediction is a simple and powerful tool that can quantify uncertainty without any distributional assumptions. Many existing methods only address the average coverage guarantee, which is not ideal compared to the stronger conditional coverage guarantee. Existing methods of approximating conditional coverage require additional models or time effort, which makes them not easy to scale. In this paper, we propose a modified non-conformity score by leveraging the local approximation of the conditional distribution using kernel density estimation. The modified score inherits the spirit of split conformal methods, which is simple and efficient and can scale to high dimensional settings. We also proposed a unified framework that brings together our method and several state-of-the-art. We perform extensive empirical evaluations: results measured by both average and conditional coverage confirm the advantage of our method.

Keywords

Cite

@article{arxiv.2206.13092,
  title  = {Split Localized Conformal Prediction},
  author = {Xing Han and Ziyang Tang and Joydeep Ghosh and Qiang Liu},
  journal= {arXiv preprint arXiv:2206.13092},
  year   = {2023}
}

Comments

21 pages, 7 figures, 8 tables