English
Related papers

Related papers: NPMixer: Hierarchical Neighboring Patch Mixing for…

200 papers

Multivariate time series forecasting is crucial across a wide range of domains. While presenting notable progress for the Transformer architecture, iTransformer still lags behind the latest MLP-based models. We attribute this performance…

Machine Learning · Computer Science 2025-11-12 Zhiwei Zhang , Xinyi Du , Xuanchi Guo , Weihao Wang , Wenjuan Han

Time series forecasting is a significant problem in many applications, e.g., financial predictions and business optimization. Modern datasets can have multiple correlated time series, which are often generated with global (shared)…

Machine Learning · Computer Science 2021-11-10 Ling Chen , Weiqi Chen , Binqing Wu , Youdong Zhang , Bo Wen , Chenghu Yang

The classification of time-series data is pivotal for streaming data and comes with many challenges. Although the amount of publicly available datasets increases rapidly, deep neural models are only exploited in a few areas. Traditional…

Machine Learning · Computer Science 2021-09-27 Dominique Mercier , Andreas Dengel , Sheraz Ahmed

Deep models have demonstrated remarkable performance in time series forecasting. However, due to the partially-observed nature of real-world applications, solely focusing on the target of interest, so-called endogenous variables, is usually…

Machine Learning · Computer Science 2024-11-12 Yuxuan Wang , Haixu Wu , Jiaxiang Dong , Guo Qin , Haoran Zhang , Yong Liu , Yunzhong Qiu , Jianmin Wang , Mingsheng Long

Multivariate time series data provide a robust framework for future predictions by leveraging information across multiple dimensions, ensuring broad applicability in practical scenarios. However, their high dimensionality and mixing…

Machine Learning · Computer Science 2024-11-28 Xuanbing Zhu , Dunbin Shen , Zhongwen Rao , Huiyi Ma , Yingguang Hao , Hongyu Wang

Spatio-temporal traffic forecasting is challenging due to complex temporal patterns, dynamic spatial structures, and diverse input formats. Although Transformer-based models offer strong global modeling, they often struggle with rigid…

Artificial Intelligence · Computer Science 2025-08-20 Jiayu Fang , Zhiqi Shao , S T Boris Choy , Junbin Gao

Spatiotemporal graph neural networks have shown to be effective in time series forecasting applications, achieving better performance than standard univariate predictors in several settings. These architectures take advantage of a graph…

Machine Learning · Computer Science 2023-11-13 Andrea Cini , Ivan Marisca , Daniele Zambon , Cesare Alippi

Predicting multivariate time series is crucial, demanding precise modeling of intricate patterns, including inter-series dependencies and intra-series variations. Distinctive trend characteristics in each time series pose challenges, and…

Machine Learning · Computer Science 2024-07-08 Guoqi Yu , Jing Zou , Xiaowei Hu , Angelica I. Aviles-Rivero , Jing Qin , Shujun Wang

We propose an efficient design of Transformer-based models for multivariate time series forecasting and self-supervised representation learning. It is based on two key components: (i) segmentation of time series into subseries-level patches…

Machine Learning · Computer Science 2023-03-07 Yuqi Nie , Nam H. Nguyen , Phanwadee Sinthong , Jayant Kalagnanam

Since the introduction of the Transformer architecture for large language models, the softmax-based attention layer has faced increasing scrutinity due to its quadratic-time computational complexity. Attempts have been made to replace it…

Machine Learning · Computer Science 2026-02-02 Robert Forchheimer

We introduce a framework to dynamically combine heterogeneous models called \texttt{DYCHEM}, which forecasts a set of time series that are related through an aggregation hierarchy. Different types of forecasting models can be employed as…

Machine Learning · Computer Science 2023-01-18 Xing Han , Jing Hu , Joydeep Ghosh

Time-series is ubiquitous across applications, such as transportation, finance and healthcare. Time-series is often influenced by external factors, especially in the form of asynchronous events, making forecasting difficult. However,…

Machine Learning · Computer Science 2021-02-02 Longyuan Li , Jihai Zhang , Junchi Yan , Yaohui Jin , Yunhao Zhang , Yanjie Duan , Guangjian Tian

Dynamic link prediction plays a crucial role in diverse applications including social network analysis, communication forecasting, and financial modeling. While recent Transformer-based approaches have demonstrated promising results in…

Machine Learning · Computer Science 2026-03-05 Hantong Feng , Yonggang Wu , Duxin Chen , Wenwu Yu

Spatiotemporal forecasting is critical for real-world applications like traffic management, yet capturing reliable interactions remains challenging under noisy and non-stationary conditions. Existing methods primarily rely on historical…

Machine Learning · Computer Science 2026-05-20 Yinghao Ai , Yukai Zhou , Ruoxi Jiang , Junyi An , Chao Qu , Zhijian Zhou , Shiyu Wang , Fenglei Cao , Zenglin Xu , Furao Shen , Yuan Qi

Time series forecasting is widely used in the fields of equipment life cycle forecasting, weather forecasting, traffic flow forecasting, and other fields. Recently, some scholars have tried to apply Transformer to time series forecasting…

Machine Learning · Computer Science 2022-02-24 Benhan Li , Shengdong Du , Tianrui Li

In the real world, long sequence time-series forecasting (LSTF) is needed in many cases, such as power consumption prediction and air quality prediction.Multi-dimensional long time series model has more strict requirements on the model,…

Machine Learning · Computer Science 2022-05-11 Ning Wang

We present a new neighbor sampling method on temporal graphs. In a temporal graph, predicting different nodes' time-varying properties can require the receptive neighborhood of various temporal scales. In this work, we propose the TNS…

Social and Information Networks · Computer Science 2021-12-21 Yiwei Wang , Yujun Cai , Yuxuan Liang , Henghui Ding , Changhu Wang , Bryan Hooi

The adaptation of large language models (LLMs) to time series forecasting poses unique challenges, as time series data is continuous in nature, while LLMs operate on discrete tokens. Despite the success of LLMs in natural language…

Computation and Language · Computer Science 2025-08-05 Taibiao Zhao , Xiaobing Chen , Mingxuan Sun

Time series forecasting is critical across multiple domains, where time series data exhibit both local patterns and global dependencies. While Transformer-based methods effectively capture global dependencies, they often overlook short-term…

Machine Learning · Computer Science 2026-04-17 Wenjie Ou , Zhishuo Zhao , Cheng Chen , Dongyue Guo , Yi Lin

Transformers have established themselves as the leading neural network model in natural language processing and are increasingly foundational in various domains. In vision, the MLP-Mixer model has demonstrated competitive performance,…

Machine Learning · Computer Science 2024-06-19 Ryo Karakida , Toshihiro Ota , Masato Taki