English

Learning Multi-Modal Prototypes for Cross-Domain Few-Shot Object Detection

Computer Vision and Pattern Recognition 2026-02-24 v1

Abstract

Cross-Domain Few-Shot Object Detection (CD-FSOD) aims to detect novel classes in unseen target domains given only a few labeled examples. While open-vocabulary detectors built on vision-language models (VLMs) transfer well, they depend almost entirely on text prompts, which encode domain-invariant semantics but miss domain-specific visual information needed for precise localization under few-shot supervision. We propose a dual-branch detector that Learns Multi-modal Prototypes, dubbed LMP, by coupling textual guidance with visual exemplars drawn from the target domain. A Visual Prototype Construction module aggregates class-level prototypes from support RoIs and dynamically generates hard-negative prototypes in query images via jittered boxes, capturing distractors and visually similar backgrounds. In the visual-guided branch, we inject these prototypes into the detection pipeline with components mirrored from the text branch as the starting point for training, while a parallel text-guided branch preserves open-vocabulary semantics. The branches are trained jointly and ensembled at inference by combining semantic abstraction with domain-adaptive details. On six cross-domain benchmark datasets and standard 1/5/10-shot settings, our method achieves state-of-the-art or highly competitive mAP.

Keywords

Cite

@article{arxiv.2602.18811,
  title  = {Learning Multi-Modal Prototypes for Cross-Domain Few-Shot Object Detection},
  author = {Wanqi Wang and Jingcai Guo and Yuxiang Cai and Zhi Chen},
  journal= {arXiv preprint arXiv:2602.18811},
  year   = {2026}
}

Comments

Accepted to CVPR 2026 Findings

R2 v1 2026-07-01T10:45:37.842Z