English
Related papers

Related papers: A Unified Shape-Aware Foundation Model for Time Se…

200 papers

General-purpose foundation models for neural time series can help accelerate neuroscientific discoveries and enable applications such as brain computer interfaces (BCIs). A key component in scaling these models is population-level…

Machine Learning · Computer Science 2025-11-18 Eshani Patel , Yisong Yue , Geeling Chau

Transformer-based models have emerged as powerful tools for multivariate time series forecasting (MTSF). However, existing Transformer models often fall short of capturing both intricate dependencies across variate and temporal dimensions…

Machine Learning · Computer Science 2024-06-10 Juncheng Liu , Chenghao Liu , Gerald Woo , Yiwei Wang , Bryan Hooi , Caiming Xiong , Doyen Sahoo

This paper presents a unified approach to understanding dynamic scenes from casual videos. Large pretrained vision foundation models, such as vision-language, video depth prediction, motion tracking, and segmentation models, offer promising…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 David Yifan Yao , Albert J. Zhai , Shenlong Wang

Normalization and scaling are fundamental preprocessing steps in time series modeling, yet their role in Transformer-based models remains underexplored from a theoretical perspective. In this work, we present the first formal analysis of…

Machine Learning · Computer Science 2026-02-20 Sofiane Ennadir , Tianze Wang , Oleg Smirnov , Sahar Asadi , Lele Cao

Recently reconstruction-based deep models have been widely used for time series anomaly detection, but as their capacity and generalization capability increase, these models tend to over-generalize, often reconstructing unseen anomalies…

Machine Learning · Computer Science 2026-01-30 Samuel Yoon , Jongwon Kim , Juyoung Ha , Young Myoung Ko

The availability of large amounts of time series data, paired with the performance of deep-learning algorithms on a broad class of problems, has recently led to significant interest in the use of sequence-to-sequence models for time series…

Machine Learning · Computer Science 2019-02-27 Vitaly Kuznetsov , Zelda Mariet

Real-world time series come with text: metadata, descriptions, news, reports. Yet time series foundation models process numerical sequences in isolation, and the multimodal text-and-time-series models that attempt to bridge the two all…

Machine Learning · Computer Science 2026-05-21 Paul Quinlan , Jeremy Levasseur , Qingguo Li , Xiaodan Zhu

We propose a post-hoc adaptive conformal anomaly detection method for monitoring time series that leverages predictions from pre-trained foundation models without requiring additional fine-tuning. Our method yields an interpretable anomaly…

Machine Learning · Computer Science 2026-04-23 Natalia Martinez Gil , Fearghal O'Donncha , Wesley M. Gifford , Nianjun Zhou , Dhaval C. Patel , Roman Vaculin

Unsupervised representation learning approaches aim to learn discriminative feature representations from unlabeled data, without the requirement of annotating every sample. Enabling unsupervised representation learning is extremely crucial…

Machine Learning · Computer Science 2023-08-04 Qianwen Meng , Hangwei Qian , Yong Liu , Yonghui Xu , Zhiqi Shen , Lizhen Cui

Existing Multivariate Time Series Anomaly Detection (MTSAD) frameworks increasingly rely on integrating Graph Neural Networks (GNNs) with sequence models to capture complex spatio-temporal dependencies. However, less attention is paid to…

Artificial Intelligence · Computer Science 2026-05-19 Suofei Zhang , Yaxuan Zheng , Haifeng Hu

In machine learning, effective modeling requires a holistic consideration of how to encode inputs, make predictions (i.e., decoding), and train the model. However, in time-series forecasting, prior work has predominantly focused on encoder…

Machine Learning · Computer Science 2025-12-30 Jaebin Lee , Hankook Lee

Time Series Classification (TSC) has been an important and challenging task in data mining, especially on multivariate time series and multi-view time series data sets. Meanwhile, transfer learning has been widely applied in computer vision…

Machine Learning · Computer Science 2019-10-18 Donglin Zhan , Shiyu Yi , Dongli Xu , Xiao Yu , Denglin Jiang , Siqi Yu , Haoting Zhang , Wenfang Shangguan , Weihua Zhang

Self-supervised foundation models have achieved remarkable success across domains, including time series. However, the potential of non-contrastive methods, a paradigm that has driven significant advances in computer vision, remains…

Machine Learning · Computer Science 2026-03-03 Yessin Moakher , Youssef Attia El Hili , Vasilii Feofanov

Modern time series classifiers display impressive predictive capabilities, yet their decision-making processes mostly remain black boxes to the user. At the same time, model-agnostic explainers, such as the recently proposed SHAP, promise…

Machine Learning · Computer Science 2023-11-21 Felix Mujkanovic , Vanja Doskoč , Martin Schirneck , Patrick Schäfer , Tobias Friedrich

Recent research on time series foundation models has primarily focused on forecasting, leaving it unclear how generalizable their learned representations are. In this study, we examine whether frozen pre-trained forecasting models can…

Machine Learning · Computer Science 2025-10-31 Andreas Auer , Daniel Klotz , Sebastinan Böck , Sepp Hochreiter

Motion time series collected from mobile and wearable devices such as smartphones and smartwatches offer significant insights into human behavioral patterns, with wide applications in healthcare, automation, IoT, and AR/XR due to their…

Signal Processing · Electrical Eng. & Systems 2024-10-29 Xiyuan Zhang , Diyan Teng , Ranak Roy Chowdhury , Shuheng Li , Dezhi Hong , Rajesh K. Gupta , Jingbo Shang

Time series data are valuable but are often inscrutable. Gaining trust in time series classifiers for finance, healthcare, and other critical applications may rely on creating interpretable models. Researchers have previously been forced to…

Machine Learning · Computer Science 2021-11-09 Yuhui Wang , Diane J. Cook

Time-series data exists in every corner of real-world systems and services, ranging from satellites in the sky to wearable devices on human bodies. Learning representations by extracting and inferring valuable information from these time…

Machine Learning · Computer Science 2026-05-19 Patara Trirat , Yooju Shin , Junhyeok Kang , Youngeun Nam , Jihye Na , Minyoung Bae , Joeun Kim , Byunghyun Kim , Jae-Gil Lee

Designing effective models for learning time series representations is foundational for time series analysis. Many previous works have explored time series representation modeling approaches and have made progress in this area. Despite…

Machine Learning · Computer Science 2024-12-17 Mingyue Cheng , Jiqian Yang , Tingyue Pan , Qi Liu , Zhi Li

Time series are series of values ordered by time. This kind of data can be found in many real world settings. Classifying time series is a difficult task and an active area of research. This paper investigates the use of transfer learning…

Machine Learning · Computer Science 2019-09-23 Marc Wenninger , Sebastian P. Bayerl , Jochen Schmidt , Korbinian Riedhammer