English

Discrete Prototypical Memories for Federated Time Series Foundation Models

Machine Learning 2026-04-07 v1 Artificial Intelligence

Abstract

Leveraging Large Language Models (LLMs) as federated learning (FL)-based time series foundation models offers a promising way to transfer the generalization capabilities of LLMs to time series data while preserving access to private data. However, the semantic misalignment between time-series data and the text-centric latent space of existing LLMs often leads to degraded performance. Meanwhile, the parameter-sharing mechanism in existing FL methods model heterogeneous cross-domain time-series data into a unified continuous latent space, which contradicts the fact that time-series semantics frequently manifest as discrete and recurring regimes. To address these limitations, we propose \textsc{FeDPM}, a federated framework for time-series foundation models based on discrete prototypical memories. Specifically, we learn local prototypical memory priors for intra-domain time-series data. We then align cross-domain memories to promote a unified discrete latent space and introduce a domain-specific memory update mechanism to balance shared and personalized prototypical knowledge. Extensive experiments demonstrate the efficiency and effectiveness of \textsc{FeDPM}. The code is publicly available at https://anonymous.4open.science/r/FedUnit-64D1.

Keywords

Cite

@article{arxiv.2604.04475,
  title  = {Discrete Prototypical Memories for Federated Time Series Foundation Models},
  author = {Liwei Deng and Qingxiang Liu and Xinhe Niu and Shengchao Chen and Sheng Sun and Yuankai Wu and Guodong Long and Yuxuan Liang},
  journal= {arXiv preprint arXiv:2604.04475},
  year   = {2026}
}

Comments

13 pages,5 figures