English

Likelihood-Aware Semantic Alignment for Full-Spectrum Out-of-Distribution Detection

Computer Vision and Pattern Recognition 2023-12-05 v1

Abstract

Full-spectrum out-of-distribution (F-OOD) detection aims to accurately recognize in-distribution (ID) samples while encountering semantic and covariate shifts simultaneously. However, existing out-of-distribution (OOD) detectors tend to overfit the covariance information and ignore intrinsic semantic correlation, inadequate for adapting to complex domain transformations. To address this issue, we propose a Likelihood-Aware Semantic Alignment (LSA) framework to promote the image-text correspondence into semantically high-likelihood regions. LSA consists of an offline Gaussian sampling strategy which efficiently samples semantic-relevant visual embeddings from the class-conditional Gaussian distribution, and a bidirectional prompt customization mechanism that adjusts both ID-related and negative context for discriminative ID/OOD boundary. Extensive experiments demonstrate the remarkable OOD detection performance of our proposed LSA especially on the intractable Near-OOD setting, surpassing existing methods by a margin of 15.26%15.26\% and 18.88%18.88\% on two F-OOD benchmarks, respectively.

Keywords

Cite

@article{arxiv.2312.01732,
  title  = {Likelihood-Aware Semantic Alignment for Full-Spectrum Out-of-Distribution Detection},
  author = {Fan Lu and Kai Zhu and Kecheng Zheng and Wei Zhai and Yang Cao},
  journal= {arXiv preprint arXiv:2312.01732},
  year   = {2023}
}

Comments

16 pages, 7 figures

R2 v1 2026-06-28T13:40:06.527Z