English
Related papers

Related papers: This Time is Different: An Observability Perspecti…

200 papers

This technical report describes the Time Series Optimized Transformer for Observability (Toto), a new state of the art foundation model for time series forecasting developed by Datadog. In addition to advancing the state of the art on…

Machine Learning · Computer Science 2024-07-12 Ben Cohen , Emaad Khwaja , Kan Wang , Charles Masson , Elise Ramé , Youssef Doubli , Othmane Abou-Amal

We show that time series foundation models scale: a single training recipe produces reliable forecast-quality improvements from 4M to 2.5B parameters. We release Toto 2.0, a family of five open-weights forecasting models trained under this…

Large time series models (LTMs) have emerged as powerful tools for universal forecasting, yet they often struggle with the inherent diversity and nonstationarity of real-world time series data, leading to an unsatisfactory trade-off between…

Machine Learning · Computer Science 2026-03-03 Yunzhong Qiu , Zhiyao Cen , Zhongyi Pei , Chen Wang , Jianmin Wang

Time series foundation models (TSFMs) are revolutionizing the forecasting landscape from specific dataset modeling to generalizable task evaluation. However, we contend that existing benchmarks exhibit common limitations in four dimensions:…

This work studies the problem of time series analysis with generalist (or foundation) models, which are models trained across many data domains. Drawing inspiration from the widespread success of large language models, we consider the…

Machine Learning · Computer Science 2025-01-03 Sabera Talukder , Yisong Yue , Georgia Gkioxari

We introduce TACO, an open-source, large-scale code generation dataset, with a focus on the optics of algorithms, designed to provide a more challenging training dataset and evaluation benchmark in the field of code generation models. TACO…

Artificial Intelligence · Computer Science 2023-12-29 Rongao Li , Jie Fu , Bo-Wen Zhang , Tao Huang , Zhihong Sun , Chen Lyu , Guang Liu , Zhi Jin , Ge Li

The recent boom of large pre-trained models witnesses remarkable success in developing foundation models (FMs) for time series forecasting. Despite impressive performance across diverse downstream forecasting tasks, existing time series FMs…

Machine Learning · Computer Science 2025-10-23 Hui He , Kun Yi , Yuanchi Ma , Qi Zhang , Zhendong Niu , Guansong Pang

Bases have become an integral part of modern deep learning-based models for time series forecasting due to their ability to act as feature extractors or future references. To be effective, a basis must be tailored to the specific set of…

Machine Learning · Computer Science 2024-01-19 Zelin Ni , Hang Yu , Shizhan Liu , Jianguo Li , Weiyao Lin

We introduce Timer-S1, a strong Mixture-of-Experts (MoE) time series foundation model with 8.3B total parameters, 0.75B activated parameters for each token, and a context length of 11.5K. To overcome the scalability bottleneck in existing…

Artificial Intelligence · Computer Science 2026-04-10 Yong Liu , Xingjian Su , Shiyu Wang , Haoran Zhang , Haixuan Liu , Yuxuan Wang , Zhou Ye , Yang Xiang , Jianmin Wang , Mingsheng Long

Recent advances in time-series forecasting increasingly rely on pre-trained foundation-style models. While these models often claim broad generalization, existing evaluation protocols provide limited evidence. Indeed, most current…

We introduce MOMENT, a family of open-source foundation models for general-purpose time series analysis. Pre-training large models on time series data is challenging due to (1) the absence of a large and cohesive public time series…

Machine Learning · Computer Science 2024-10-11 Mononito Goswami , Konrad Szafer , Arjun Choudhry , Yifu Cai , Shuo Li , Artur Dubrawski

Tracking transforming objects holds significant importance in various fields due to the dynamic nature of many real-world scenarios. By enabling systems accurately represent transforming objects over time, tracking transforming objects…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 You Wu , Yuelong Wang , Yaxin Liao , Fuliang Wu , Hengzhou Ye , Shuiwang Li

It is challenging to scale time series forecasting models such that they forecast accurately for multiple distinct domains and datasets, all with potentially different underlying collection procedures (e.g., sample resolution), patterns…

Machine Learning · Computer Science 2024-07-26 Luke Darlow , Qiwen Deng , Ahmed Hassan , Martin Asenov , Rajkarn Singh , Artjom Joosen , Adam Barker , Amos Storkey

With the development of astronomical facilities, large-scale time series data observed by these facilities is being collected. Analyzing anomalies in these astronomical observations is crucial for uncovering potential celestial events and…

Machine Learning · Computer Science 2024-03-18 Xinli Hao , Yile Chen , Chen Yang , Zhihui Du , Chaohong Ma , Chao Wu , Xiaofeng Meng

Traffic time series forecasting is challenging due to complex spatio-temporal dynamics time series from different locations often have distinct patterns; and for the same time series, patterns may vary across time, where, for example, there…

Machine Learning · Computer Science 2022-04-06 Razvan-Gabriel Cirstea , Bin Yang , Chenjuan Guo , Tung Kieu , Shirui Pan

The present study explores the interpretability of latent spaces produced by time series foundation models, focusing on their potential for visual analysis tasks. Specifically, we evaluate the MOMENT family of models, a set of…

Many businesses and industries nowadays rely on large quantities of time series data making time series forecasting an important research area. Global forecasting models that are trained across sets of time series have shown a huge…

Machine Learning · Computer Science 2021-10-25 Rakshitha Godahewa , Christoph Bergmeir , Geoffrey I. Webb , Rob J. Hyndman , Pablo Montero-Manso

Deep learning models are increasingly data-hungry, requiring significant resources to collect and compile the datasets needed to train them, with Earth Observation (EO) models being no exception. However, the landscape of datasets in EO is…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Alistair Francis , Mikolaj Czerkawski

We introduce the Cisco Time Series Model, a univariate zero-shot forecaster. This time series foundation model is the result of a general architectural innovation to a time series model enabling it to accept multiresolution input, applied…

Three challenges limit the progress of robot learning research: robots are expensive (few labs can participate), everyone uses different robots (findings do not generalize across labs), and we lack internet-scale robotics data. We take on…

‹ Prev 1 2 3 10 Next ›