English

Advancing Analytic Class-Incremental Learning through Vision-Language Calibration

Machine Learning 2026-05-08 v3

Abstract

Class-incremental learning (CIL) with pre-trained models (PTMs) faces a critical trade-off between efficient adaptation and long-term stability. While analytic learning enables rapid, recursive closed-form updates, its efficacy is often compromised by accumulated errors and feature incompatibility. In this paper, we first conduct a systematic study to dissect the failure modes of PTM-based analytic CIL, identifying representation rigidity as the primary bottleneck. Motivated by this insight, we propose VILA, a novel dual-branch framework that advances analytic CIL via a two-level vision-language calibration strategy. Specifically, we coherently fuse plastic, task-adapted features with a frozen, universal visual anchor at the feature level through geometric calibration, and leverage cross-modal semantic priors at the decision level to rectify prediction bias. This confluence maintains analytic-learning's extreme efficiency while overcoming its inherent brittleness. Extensive experiments across eight benchmarks demonstrate that VILA consistently yields superior performance, particularly in fine-grained and long-sequence scenarios. Our framework harmonizes high-fidelity prediction with the simplicity of analytic learning. Our code is available at https://github.com/byzhaoAI/VILA.

Keywords

Cite

@article{arxiv.2602.13670,
  title  = {Advancing Analytic Class-Incremental Learning through Vision-Language Calibration},
  author = {Binyu Zhao and Wei Zhang and Xingrui Yu and Zhaonian Zou and Ivor Tsang},
  journal= {arXiv preprint arXiv:2602.13670},
  year   = {2026}
}

Comments

20 pages, 11 figures, 9 tables. Accepted by ICML2026

R2 v1 2026-07-01T10:36:40.383Z