English

Neyman-Pearson Classification under Both Null and Alternative Distributions Shift

Machine Learning 2025-11-11 v1 Machine Learning

Abstract

We consider the problem of transfer learning in Neyman-Pearson classification, where the objective is to minimize the error w.r.t. a distribution μ1\mu_1, subject to the constraint that the error w.r.t. a distribution μ0\mu_0 remains below a prescribed threshold. While transfer learning has been extensively studied in traditional classification, transfer learning in imbalanced classification such as Neyman-Pearson classification has received much less attention. This setting poses unique challenges, as both types of errors must be simultaneously controlled. Existing works address only the case of distribution shift in μ1\mu_1, whereas in many practical scenarios shifts may occur in both μ0\mu_0 and μ1\mu_1. We derive an adaptive procedure that not only guarantees improved Type-I and Type-II errors when the source is informative, but also automatically adapt to situations where the source is uninformative, thereby avoiding negative transfer. In addition to such statistical guarantees, the procedures is efficient, as shown via complementary computational guarantees.

Keywords

Cite

@article{arxiv.2511.06641,
  title  = {Neyman-Pearson Classification under Both Null and Alternative Distributions Shift},
  author = {Mohammadreza M. Kalan and Yuyang Deng and Eitan J. Neugut and Samory Kpotufe},
  journal= {arXiv preprint arXiv:2511.06641},
  year   = {2025}
}
R2 v1 2026-07-01T07:28:48.992Z