English
Related papers

Related papers: Only the Curve Shape Matters: Training Foundation …

200 papers

Shapelets are phase independent subsequences designed for time series classification. We propose three adaptations to the Shapelet Transform (ST) to capture multivariate features in multivariate time series classification. We create a…

Machine Learning · Computer Science 2017-12-19 Aaron Bostrom , Anthony Bagnall

Predicting future values in multivariate time series is vital across various domains. This work explores the use of large language models (LLMs) for this task. However, LLMs typically handle one-dimensional data. We introduce MultiCast, a…

Machine Learning · Computer Science 2024-05-24 Georgios Chatzigeorgakidis , Konstantinos Lentzos , Dimitrios Skoutas

Time series foundation models are pre-trained on large datasets and are able to achieve state-of-the-art performance in diverse tasks. However, to date, there has been limited work demonstrating how well these models perform in medical…

Machine Learning · Computer Science 2024-11-21 Mingzhu Liu , Angela H. Chen , George H. Chen

In this paper, we consider the problem of generalised visual object counting, with the goal of developing a computational model for counting the number of objects from arbitrary semantic categories, using arbitrary number of "exemplars",…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Chang Liu , Yujie Zhong , Andrew Zisserman , Weidi Xie

Human experts typically integrate numerical and textual multimodal information to analyze time series. However, most traditional deep learning predictors rely solely on unimodal numerical data, using a fixed-length window for training and…

Computation and Language · Computer Science 2024-12-17 Chengsen Wang , Qi Qi , Jingyu Wang , Haifeng Sun , Zirui Zhuang , Jinming Wu , Lei Zhang , Jianxin Liao

In deep time series forecasting, the Fourier Transform (FT) is extensively employed for frequency representation learning. However, it often struggles in capturing multi-scale, time-sensitive patterns. Although the Wavelet Transform (WT)…

Machine Learning · Computer Science 2026-02-09 Ziyu Zhou , Jiaxi Hu , Qingsong Wen , James T. Kwok , Yuxuan Liang

Transformer-based models have emerged as powerful tools for multivariate time series forecasting (MTSF). However, existing Transformer models often fall short of capturing both intricate dependencies across variate and temporal dimensions…

Machine Learning · Computer Science 2024-06-10 Juncheng Liu , Chenghao Liu , Gerald Woo , Yiwei Wang , Bryan Hooi , Caiming Xiong , Doyen Sahoo

Geodetic time series -- such as Global Navigation Satellite System (GNSS) positions, satellite altimetry-derived sea surface height (SSH), and tide gauge (TG) records -- is essential for monitoring surface deformation and sea level change.…

Conventional uncertainty-aware temporal difference (TD) learning often assumes a zero-mean Gaussian distribution for TD errors, leading to inaccurate error representations and compromised uncertainty estimation. We introduce a novel…

Machine Learning · Computer Science 2025-02-04 Seyeon Kim , Joonhun Lee , Namhoon Cho , Sungjun Han , Wooseop Hwang

Time series forecasting is crucial for applications across multiple domains and various scenarios. Although Transformer models have dramatically advanced the landscape of forecasting, their effectiveness remains debated. Recent findings…

Machine Learning · Computer Science 2024-12-24 Dongbin Kim , Jinseong Park , Jaewook Lee , Hoki Kim

Spatiotemporal data is ubiquitous, and forecasting it has important applications in many domains. However, its complex cross-component dependencies and non-linear temporal dynamics can be challenging for traditional techniques. Existing…

Machine Learning · Computer Science 2025-03-27 Hao Yuan Bai , Xue Liu

Several applications of Internet of Things (IoT) technology involve capturing data from multiple sensors resulting in multi-sensor time series. Existing neural networks based approaches for such multi-sensor or multivariate time series…

Machine Learning · Computer Science 2020-07-21 Vibhor Gupta , Jyoti Narwariya , Pankaj Malhotra , Lovekesh Vig , Gautam Shroff

Deep learning model (primarily convolutional networks and LSTM) for time series classification has been studied broadly by the community with the wide applications in different domains like healthcare, finance, industrial engineering and…

Machine Learning · Computer Science 2021-03-29 Minghao Liu , Shengqi Ren , Siyuan Ma , Jiahui Jiao , Yizhou Chen , Zhiguang Wang , Wei Song

Time series foundation models excel in zero-shot forecasting, handling diverse tasks without explicit training. However, the advancement of these models has been hindered by the lack of comprehensive benchmarks. To address this gap, we…

Machine Learning · Computer Science 2024-11-12 Taha Aksu , Gerald Woo , Juncheng Liu , Xu Liu , Chenghao Liu , Silvio Savarese , Caiming Xiong , Doyen Sahoo

The scattering transform is a multilayered, wavelet-based transform initially introduced as a model of convolutional neural networks (CNNs) that has played a foundational role in our understanding of these networks' stability and invariance…

Can meta-learning discover generic ways of processing time series (TS) from a diverse dataset so as to greatly improve generalization on new TS coming from different datasets? This work provides positive evidence to this using a broad…

Machine Learning · Computer Science 2020-12-16 Boris N. Oreshkin , Dmitri Carpov , Nicolas Chapados , Yoshua Bengio

Tabular foundation models, particularly Prior-data Fitted Networks like TabPFN have emerged as the leading contender in a myriad of tasks ranging from data imputation to label prediction on the tabular data format surpassing the historical…

Machine Learning · Computer Science 2026-04-10 Mayuka Jayawardhana , Nihal Sharma , Kazem Meidani , Bayan Bruss , Tom Goldstein , Doron Bergman

In recent years, generative pre-trained paradigms such as Large Language Models (LLMs) and Large Vision Models (LVMs) have achieved revolutionary advancements and widespread real-world applications. Particularly, the emergence of…

Computational Engineering, Finance, and Science · Computer Science 2024-06-05 Jiarui Yang , Tao Dai , Naiqi Li , Junxi Wu , Peiyuan Liu , Jinmin Li , Jigang Bao , Haigang Zhang , Shutao Xia

Multivariate time series forecasting is a pivotal task in several domains, including financial planning, medical diagnostics, and climate science. This paper presents the Neural Fourier Transform (NFT) algorithm, which combines…

Machine Learning · Computer Science 2024-05-24 Noam Koren , Kira Radinsky

In practical time series forecasting, covariates provide rich contextual information that can potentially enhance the forecast of target variables. Although some covariates extend into the future forecasting horizon (e.g., calendar events,…

Machine Learning · Computer Science 2025-08-07 Yosuke Yamaguchi , Issei Suemitsu , Wenpeng Wei