English
Related papers

Related papers: Time-TK: A Multi-Offset Temporal Interaction Frame…

200 papers

With the development of Internet of Things (IoT) systems, precise long-term forecasting method is requisite for decision makers to evaluate current statuses and formulate future policies. Currently, Transformer and MLP are two paradigms for…

Machine Learning · Computer Science 2023-12-12 Li Shen , Yuning Wei , Yangzhu Wang , Hongguang Li

Multivariate time series (MTS) classification is foundational to pervasive computing and financial analysis, yet existing multi-scale paradigms are often constrained by suboptimal representation fidelity. We identify two critical…

Machine Learning · Computer Science 2026-05-22 Fan Zhang , Yating Cui , Hua Wang

Transformer-based time series forecasting has recently gained strong interest due to the ability of transformers to model sequential data. Most of the state-of-the-art architectures exploit either temporal or inter-channel dependencies,…

Machine Learning · Computer Science 2025-03-25 Davide Villaboni , Alberto Castellini , Ivan Luciano Danesi , Alessandro Farinelli

In Transformer architectures, tokens\textemdash discrete units derived from raw data\textemdash are formed by segmenting inputs into fixed-length chunks. Each token is then mapped to an embedding, enabling parallel attention computations…

Machine Learning · Computer Science 2026-01-14 Zhenglun Kong , Yize Li , Fanhu Zeng , Lei Xin , Shvat Messica , Xue Lin , Pu Zhao , Manolis Kellis , Hao Tang , Marinka Zitnik

Root cause analysis in modern cloud infrastructure demands sophisticated understanding of heterogeneous data sources, particularly time-series performance metrics that involve core failure signatures. While large language models demonstrate…

Artificial Intelligence · Computer Science 2026-01-09 Gijun Park

We introduce a temporal feature encoding architecture called Time Series Representation Model (TSRM) for multivariate time series forecasting and imputation. The architecture is structured around CNN-based representation layers, each…

Machine Learning · Computer Science 2025-04-29 Robert Leppich , Michael Stenger , Daniel Grillmeyer , Vanessa Borst , Samuel Kounev

Token-based time series large language models (TS-LLMs) have emerged as a promising direction for time series analysis and reasoning. However, prior studies largely overlook the inherent continuity and ordinality of time series tokens,…

Machine Learning · Computer Science 2026-05-29 Musheng Li , Ziying Zhang , Cheng jin , Yuantao Gu

Multimodal time series forecasting is crucial in real-world applications, where decisions depend on both numerical data and contextual signals. The core challenge is to effectively combine temporal numerical patterns with the context…

Machine Learning · Computer Science 2026-02-04 Huu Hiep Nguyen , Minh Hoang Nguyen , Dung Nguyen , Hung Le

Long-term time series forecasting (LTSF) is a critical task across diverse domains. Despite significant advancements in LTSF research, we identify a performance bottleneck in existing LTSF methods caused by the inadequate modeling of…

Machine Learning · Computer Science 2025-09-22 Qi Xiong , Kai Tang , Minbo Ma , Ji Zhang , Jie Xu , Tianrui Li

Given a sequence of sets, where each set contains an arbitrary number of elements, the problem of temporal sets prediction aims to predict the elements in the subsequent set. In practice, temporal sets prediction is much more complex than…

Machine Learning · Computer Science 2020-07-09 Le Yu , Leilei Sun , Bowen Du , Chuanren Liu , Hui Xiong , Weifeng Lv

Long-term Time Series Forecasting is crucial across numerous critical domains, yet its accuracy remains fundamentally constrained by the receptive field bottleneck in existing models. Mainstream Transformer- and Multi-layer Perceptron…

Computational Engineering, Finance, and Science · Computer Science 2025-11-13 Weixu Wang , Xiaobo Zhou , Xin Qiao , Lei Wang , Tie Qiu

Identifying the qualitative changes in time-series data provides insights into the dynamics associated with such data. Such qualitative changes can be detected through topological approaches, which first embed the data into a…

Data Analysis, Statistics and Probability · Physics 2019-03-27 Quoc Hoan Tran , Yoshihiko Hasegawa

Pre-trained Large Language Models (LLMs) encapsulate large amounts of knowledge and take enormous amounts of compute to train. We make use of this resource, together with the observation that LLMs are able to transfer knowledge and…

Machine Learning · Computer Science 2025-01-14 Malcolm L. Wolff , Shenghao Yang , Kari Torkkola , Michael W. Mahoney

Real-time schedulers must reason about tight deadlines under strict compute budgets. We present TempoNet, a reinforcement learning scheduler that pairs a permutation-invariant Transformer with a deep Q-approximation. An Urgency Tokenizer…

Machine Learning · Computer Science 2026-04-15 Rong Fu , Yibo Meng , Guangzhen Yao , Jiaxuan Lu , Zeyu Zhang , Zhaolu Kang , Ziming Guo , Jia Yee Tan , Xiaojing Du , Simon James Fong

Multivariate time series forecasting is an important machine learning problem across many domains, including predictions of solar plant energy output, electricity consumption, and traffic jam situation. Temporal data arise in these…

Machine Learning · Computer Science 2018-04-20 Guokun Lai , Wei-Cheng Chang , Yiming Yang , Hanxiao Liu

Search engines operate under a strict time constraint as a fast response is paramount to user satisfaction. Thus, neural re-ranking models have a limited time-budget to re-rank documents. Given the same amount of time, a faster re-ranking…

Information Retrieval · Computer Science 2020-02-06 Sebastian Hofstätter , Markus Zlabinger , Allan Hanbury

Temporal link prediction, aiming at predicting future interactions among entities based on historical interactions, is crucial for a series of real-world applications. Although previous methods have demonstrated the importance of relative…

Machine Learning · Computer Science 2024-10-08 Xiaodong Lu , Leilei Sun , Tongyu Zhu , Weifeng Lv

Transformer has become one of the most popular architectures for multivariate time series (MTS) forecasting. Recent Transformer-based MTS models generally prefer channel-independent structures with the observation that channel independence…

Machine Learning · Computer Science 2024-03-06 Ce Chi , Xing Wang , Kexin Yang , Zhiyan Song , Di Jin , Lin Zhu , Chao Deng , Junlan Feng

Modern time series forecasting methods, such as Transformer and its variants, have shown strong ability in sequential data modeling. To achieve high performance, they usually rely on redundant or unexplainable structures to model complex…

Machine Learning · Computer Science 2023-11-30 Jingyi Hou , Zhen Dong , Jiayu Zhou , Zhijie Liu

Tucker decomposition has been widely used in a variety of applications to obtain latent factors of tensor data. In these applications, a common need is to compute Tucker decomposition for a given time range. Furthermore, real-world tensor…

Data Structures and Algorithms · Computer Science 2025-01-14 Ruizhong Qiu , Jun-Gi Jang , Xiao Lin , Lihui Liu , Hanghang Tong