English
Related papers

Related papers: Time to Embed: Unlocking Foundation Models for Tim…

200 papers

Time series forecasting is a fundamental task emerging from diverse data-driven applications. Many advanced autoregressive methods such as ARIMA were used to develop forecasting models. Recently, deep learning based methods such as DeepAr,…

Recent advancements in language modeling have shown promising results when applied to time series data. In particular, fine-tuning pre-trained large language models (LLMs) for time series classification tasks has achieved state-of-the-art…

Machine Learning · Computer Science 2025-06-03 Rachneet Kaur , Zhen Zeng , Tucker Balch , Manuela Veloso

Multivariate time series underpin modern critical infrastructure, making the prediction of anomalies a vital necessity for proactive risk mitigation. While Joint-Embedding Predictive Architectures (JEPA) offer a promising framework for…

Machine Learning · Computer Science 2026-02-05 Yanan He , Yunshi Wen , Xin Wang , Tengfei Ma

For the advancements of time series classification, scrutinizing previous studies, most existing methods adopt a common learning-to-classify paradigm - a time series classifier model tries to learn the relation between sequence inputs and…

Machine Learning · Computer Science 2024-03-20 Mingyue Cheng , Yiheng Chen , Qi Liu , Zhiding Liu , Yucong Luo

There exists a correlation between geospatial activity temporal patterns and type of land use. A novel self-supervised approach is proposed to stratify landscape based on mobility activity time series. First, the time series signal is…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Yi Cao , Swetava Ganguli , Vipul Pandey

Learning complex time series forecasting models usually requires a large amount of data, as each model is trained from scratch for each task/data set. Leveraging learning experience with similar datasets is a well-established technique for…

Machine Learning · Computer Science 2022-08-19 Lukas Brinkmeyer , Rafael Rego Drumond , Johannes Burchert , Lars Schmidt-Thieme

Nowadays, the deployment of deep learning models on edge devices for addressing real-world classification problems is becoming more prevalent. Moreover, there is a growing popularity in the approach of early classification, a technique that…

Machine Learning · Computer Science 2023-06-27 Leonardos Pantiskas , Kees Verstoep , Mark Hoogendoorn , Henri Bal

Time series modeling has attracted extensive research efforts; however, achieving both reliable efficiency and interpretability from a unified model still remains a challenging problem. Among the literature, shapelets offer interpretable…

Machine Learning · Computer Science 2020-12-01 Ziqiang Cheng , Yang Yang , Wei Wang , Wenjie Hu , Yueting Zhuang , Guojie Song

Foundation models for time series are emerging as powerful general-purpose backbones, yet their potential for domain-specific biomedical signals such as electroencephalography (EEG) remains rather unexplored. In this work, we investigate…

Machine Learning · Computer Science 2025-11-03 Théo Gnassounou , Yessin Moakher , Shifeng Xie , Vasilii Feofanov , Ievgen Redko

The integration of Fourier transform and deep learning opens new avenues for time series forecasting. We reconsider the Fourier transform from a basis functions perspective. Specifically, the real and imaginary parts of the frequency…

Machine Learning · Computer Science 2025-08-05 Runze Yang , Longbing Cao , Xin You , Kun Fang , Jianxun Li , Jie Yang

Modern large language models (LLMs) excel at tasks that require storing and retrieving knowledge, such as factual recall and question answering. Transformers are central to this capability because they can encode information during training…

Machine Learning · Statistics 2026-03-18 Nuri Mert Vural , Alberto Bietti , Mahdi Soltanolkotabi , Denny Wu

As retrieval-augmented generation prevails in large language models, embedding models are becoming increasingly crucial. Despite the growing number of general embedding models, prior work often overlooks the critical role of training data…

Computation and Language · Computer Science 2025-01-16 Xinshuo Hu , Zifei Shan , Xinping Zhao , Zetian Sun , Zhenyu Liu , Dongfang Li , Shaolin Ye , Xinyuan Wei , Qian Chen , Baotian Hu , Haofen Wang , Jun Yu , Min Zhang

Time series analysis faces significant challenges in handling variable-length data and achieving robust generalization. While Transformer-based models have advanced time series tasks, they often struggle with feature redundancy and limited…

Machine Learning · Computer Science 2025-09-23 Kai Zhang , Siming Sun , Zhengyu Fan , Qinmin Yang , Xuejun Jiang

Bases have become an integral part of modern deep learning-based models for time series forecasting due to their ability to act as feature extractors or future references. To be effective, a basis must be tailored to the specific set of…

Machine Learning · Computer Science 2024-01-19 Zelin Ni , Hang Yu , Shizhan Liu , Jianguo Li , Weiyao Lin

Time series (TS) data are ubiquitous across various application areas, rendering time series forecasting (TSF) a fundamental task. With the astounding advances in large language models (LLMs), a variety of methods have been developed to…

Artificial Intelligence · Computer Science 2025-08-25 Zhuomin Chen , Dan Li , Jiahui Zhou , Shunyu Wu , Haozheng Ye , Jian Lou , See-Kiong Ng

Spatio-temporal deep learning models aims to utilize useful patterns in such data to support tasks like prediction. However, previous deep learning models designed for specific tasks typically require separate training for each use case,…

We introduce a general framework for leveraging graph stream data for temporal prediction-based applications. Our proposed framework includes novel methods for learning an appropriate graph time-series representation, modeling and weighting…

Machine Learning · Computer Science 2020-09-22 Di Jin , Sungchul Kim , Ryan A. Rossi , Danai Koutra

Time series modeling holds significant importance in many real-world applications and has been extensively studied. While pre-trained foundation models have made impressive strides in the fields of natural language processing (NLP) and…

Computation and Language · Computer Science 2025-02-20 Juyuan Zhang , Wei Zhu , Jiechao Gao

Tabular Foundation Models have recently established the state of the art in supervised tabular learning, by leveraging pretraining to learn generalizable representations of numerical and categorical structured data. However, they lack…

Medical time series are central to healthcare, enabling continuous monitoring and supporting timely clinical decisions. Despite recent progress, existing methods struggle to jointly model local-global dynamics and handle nonstationarities…

Machine Learning · Computer Science 2026-05-26 Da Zhang , Bingyu Li , Zhiyuan Zhao , Hongyuan Zhang , Junyu Gao , Xuelong Li