English

Empowering VLMs for Few-Shot Multimodal Time Series Classification via Tailored Agentic Reasoning

Artificial Intelligence 2026-05-19 v2 Machine Learning Multiagent Systems Multimedia

Abstract

In this paper, we propose the first VLM\underline{\textbf{M}} a\underline{\textbf{a}}gentic r\underline{\textbf{r}}easoning framework for few-s\underline{\textbf{s}}hot multimodal T\underline{\textbf{T}}ime S\underline{\textbf{S}}eries C\underline{\textbf{C}}lassification (MarsTSC\textbf{MarsTSC}), which introduces a self-evolving knowledge bank as a dynamic context iteratively refined via reflective agentic reasoning. The framework comprises three collaborative roles: i) Generator conducts reliable classification via reasoning; ii) Reflector diagnoses the root causes of reasoning errors to yield discriminative insights targeting the temporal features overlooked by Generator; iii) Modifier applies verified updates to the knowledge bank to prevent context collapse. We further introduce a test-time update strategy to enable cautious, continuous knowledge bank refinement to mitigate few-shot bias and distribution shift. Extensive experiments across 12 mainstream time series benchmarks demonstrate that MarsTSC\textbf{MarsTSC} delivers substantial and consistent performance gains across 6 VLM backbones, outperforming both classical and foundation model-based time series baselines under few-shot conditions, while producing interpretable rationales that ground each classification decision in human-readable feature evidence.

Keywords

Cite

@article{arxiv.2605.09395,
  title  = {Empowering VLMs for Few-Shot Multimodal Time Series Classification via Tailored Agentic Reasoning},
  author = {Lin Li and Jiawei Huang and Qihao Quan and Dan Li and Boxin Li and Xiao Zhang and Erli Meng and Wenjie Feng and Jian Lou and See-Kiong Ng},
  journal= {arXiv preprint arXiv:2605.09395},
  year   = {2026}
}

Comments

18 pages, 12 figures, 6 tables. Preprint