English
Related papers

Related papers: TOTEM: TOkenized Time Series EMbeddings for Genera…

200 papers

The continued digitization of societal processes translates into a proliferation of time series data that cover applications such as fraud detection, intrusion detection, and energy management, where anomaly detection is often essential to…

Existing GUI agent models relying on coordinate-based one-step visual grounding struggle with generalizing to varying input resolutions and aspect ratios. Alternatives introduce coordinate-free strategies yet suffer from learning under…

Machine Learning · Computer Science 2026-02-04 Xiaoce Wang , Guibin Zhang , Junzhe Li , Jinzhe Tu , Chun Li , Ming Li

Multivariate time series forecasting requires models to simultaneously capture variable-wise structural dependencies and generalize across diverse tasks. While structural encoders are effective in modeling feature interactions, they lack…

Computation and Language · Computer Science 2025-06-26 Fengze Li , Yue Wang , Yangle Liu , Ming Huang , Dou Hong , Jieming Ma

Recent breakthroughs in large-scale generative modeling have demonstrated the potential of foundation models in domains such as natural language, computer vision, and protein structure prediction. However, their application in the energy…

Machine Learning · Computer Science 2025-01-29 Michael Fuest , Alfredo Cuesta , Kalyan Veeramachaneni

Deep learning has become a one-size-fits-all solution for technical and business domains thanks to its flexibility and adaptability. It is implemented using opaque models, which unfortunately undermines the outcome trustworthiness. In order…

Machine Learning · Computer Science 2022-08-04 Anh-Duy Pham , Anastassia Kuestenmacher , Paul G. Ploeger

The past decade has witnessed significant advances in time series modeling with deep learning. While achieving state-of-the-art results, the best-performing architectures vary highly across applications and domains. Meanwhile, for natural…

Machine Learning · Computer Science 2024-04-03 Defu Cao , Furong Jia , Sercan O Arik , Tomas Pfister , Yixiang Zheng , Wen Ye , Yan Liu

In this paper, we introduce TimeGPT, the first foundation model for time series, capable of generating accurate predictions for diverse datasets not seen during training. We evaluate our pre-trained model against established statistical,…

Machine Learning · Computer Science 2024-05-29 Azul Garza , Cristian Challu , Max Mergenthaler-Canseco

The ubiquity of time series data creates a strong demand for general-purpose foundation models, yet developing them for classification remains a significant challenge, largely due to the high cost of labeled data. Foundation models capable…

Machine Learning · Computer Science 2025-11-27 Chin-Chia Michael Yeh , Uday Singh Saini , Junpeng Wang , Xin Dai , Xiran Fan , Jiarui Sun , Yujie Fan , Yan Zheng

A time series represents a set of observations collected over time. Typically, these observations are captured with a uniform sampling frequency (e.g. daily). When data points are observed in uneven time intervals the time series is…

Machine Learning · Computer Science 2022-01-03 Pedro Costa , Vitor Cerqueira , João Vinagre

The zero-shot capabilities of foundation models (FMs) for time series forecasting offer promising potentials in conformal prediction, as most of the available data can be allocated to calibration. This study compares the performance of Time…

Machine Learning · Computer Science 2025-07-15 Sami Achour , Yassine Bouher , Duong Nguyen , Nicolas Chesneau

Astronomical time-series analysis faces a critical limitation: the scarcity of labeled observational data. We present a pre-training approach that leverages simulations, significantly reducing the need for labeled examples from real…

Instrumentation and Methods for Astrophysics · Physics 2025-10-16 Rithwik Gupta , Daniel Muthukrishna , Jeroen Audenaert

We investigate the impact of tokeniser pretraining on the accuracy and efficiency of physics emulation. Modern high-resolution simulations produce vast volumes of data spanning diverse physical regimes and scales. Training foundation models…

Machine Learning · Computer Science 2026-03-13 Hadi Sotoudeh , Payel Mukhopadhyay , Ruben Ohana , Michael McCabe , Neil D. Lawrence , Shirley Ho , Miles Cranmer

Data summarization is the process of generating interpretable and representative subsets from a dataset. Existing time series summarization approaches often search for recurring subsequences using a set of manually devised similarity…

Machine Learning · Computer Science 2023-08-29 Alireza Ghods , Trong Nghia Hoang , Diane Cook

Time series data has been demonstrated to be crucial in various research fields. The management of large quantities of time series data presents challenges in terms of deep learning tasks, particularly for training a deep neural network.…

Machine Learning · Computer Science 2024-06-11 Zhanyu Liu , Ke Hao , Guanjie Zheng , Yanwei Yu

Domain generalization aims at training machine learning models to perform robustly across different and unseen domains. Several recent methods use multiple datasets to train models to extract domain-invariant features, hoping to generalize…

Machine Learning · Computer Science 2021-05-19 Mattia Segu , Alessio Tonioni , Federico Tombari

Time series analysis is crucial in fields like finance, transportation, and industry. However, traditional models often focus solely on temporal features, limiting their ability to capture underlying information. This paper proposes a novel…

Machine Learning · Computer Science 2025-03-12 Shule Hao , Junpeng Bao , Chuncheng Lu

In the time-series domain, an increasing number of works combine text with temporal data to leverage the reasoning capabilities of large language models (LLMs) for various downstream time-series understanding tasks. This enables a single…

Computation and Language · Computer Science 2025-11-11 Zhirui Zhang , Changhua Pei , Tianyi Gao , Zhe Xie , Yibo Hao , Zhaoyang Yu , Longlong Xu , Tong Xiao , Jing Han , Dan Pei

Traditional time series analysis has long relied on pattern recognition, trained on static and well-established benchmarks. However, in real-world settings -- where policies shift, human behavior adapts, and unexpected events unfold --…

Artificial Intelligence · Computer Science 2025-10-16 Xinlei Wang , Mingtian Tan , Jing Qiu , Junhua Zhao , Jinjin Gu

Time series forecasting is critical across finance, healthcare, and cloud computing, yet progress is constrained by a fundamental bottleneck: the scarcity of large-scale, high-quality benchmarks. To address this gap, we introduce…

Machine Learning · Computer Science 2026-03-30 Siqiao Xue , Zhaoyang Zhu , Wei Zhang , Rongyao Cai , Rui Wang , Yixiang Mu , Fan Zhou , Jianguo Li , Peng Di , Hang Yu

In the wild, we often encounter collections of sequential data such as electrocardiograms, motion capture, genomes, and natural language, and sequences may be multichannel or symbolic with nonlinear dynamics. We introduce a new method to…

Machine Learning · Computer Science 2024-06-12 Jonathan Y. Zhou , Yao Xie